Compute · Global · Apr 7, 2025
280-fold reduction in the cost of querying a GPT-3.5-level model in about 18 months
280fold
reduction in the cost of querying a GPT-3.5-level model in about 18 months
From the 2025 AI Index summary of inference-cost declines.
280fold
“The cost of querying an AI model that scores the equivalent of GPT-3.5 (64.8% accuracy) on MMLU dropped from $20 per million tokens in November 2022 to just $0.07 per million tokens by October 2024 (Gemini-1.5-Flash-8B)—a more than 280-fold reduction in approximately 18 months.”
Related
Compute · Global
5×
per year growth in training compute for frontier language models since 2020
Epoch AI · Feb 5, 2026
Compute · Global
$0.07
per million tokens was the cost to query a GPT-3.5-level model by October 2024
Stanford HAI · Apr 7, 2025
Compute · Global
$38billion
in up-front capital expenditure for a typical AI data center with 1 gigawatt of IT power
Epoch AI · Feb 5, 2026