Compute · Global · Feb 5, 2026
30% of OpenAI's compute spending in 2024 was used on inference
30%
of OpenAI's compute spending in 2024 was used on inference
Epoch AI's Trends in AI note on the split of compute spending.
The AI NumberGlobal
30%
Epoch AI · Feb 5, 2026theainumber.com
“Only 30% of OpenAI's compute spending in 2024 was used on inference.”
Related
Compute · Global
5×
per year growth in training compute for frontier language models since 2020
Epoch AI · Feb 5, 2026
Compute · Global
$0.07
per million tokens was the cost to query a GPT-3.5-level model by October 2024
Stanford HAI · Apr 7, 2025
Compute · Global
280fold
reduction in the cost of querying a GPT-3.5-level model in about 18 months
Stanford HAI · Apr 7, 2025