Capability · Global · Apr 7, 2025
71.7% of SWE-bench coding problems were solved by AI systems in 2024
71.7%
of SWE-bench coding problems were solved by AI systems in 2024
The 2025 AI Index technical-performance chapter tracks the jump from 2023.
The AI NumberGlobal
71.7%
Stanford HAI · Apr 7, 2025theainumber.com
“On SWE-bench, AI systems could solve just 4.4% of coding problems in 2023—a figure that jumped to 71.7% in 2024.”