What can you do with floating-point operations?

With 10¹⁷ FLOPS:

Train AlexNet

• Classify images

With 10¹⁹ FLOPS:

Train a Transformer

• Translate languages

With 10²¹ FLOPS:

Train GPT-2

• Generate coherent paragraphs
• Understand language

With 10²³ FLOPS:

Train GPT-3

• Write essays
• Answer questions
• Translate languages

With 10²⁵ FLOPS:

Train GPT-4

• Pass bar exams
• Write code
• Solve complex problems

With 10²⁶ FLOPS:

Train reasoning models

• Autonomous software engineering
• Scientific research
• Novel insights

With 10²⁷ FLOPS:

Train self-improving systems, models that can accelerate their own training with software, data analysis, and reinforcement learning.

With 10²⁸ FLOPS:

Build artificial superintelligence, recursive self-improvement beyond human cognitive limits.