OpenAI Explains How Two Settings Tripled ARC-AGI-3 Benchmark Scores

OpenAI published a technical post detailing how enabling two specific configuration settings caused their scores on the ARC-AGI-3 benchmark to triple, marking a substantial leap in performance on one of the most challenging general reasoning evaluations. ARC-AGI-3 is designed to test novel problem-solving rather than pattern recall, making this a meaningful signal about reasoning capability rather than memorization. The post provides direct insight into how inference-time settings — not just model architecture — can dramatically shift benchmark outcomes, which has immediate implications for developers tuning deployments. Engineers working with OpenAI models should examine whether similar configuration changes are accessible via the API and how they affect task performance in their own pipelines. This also raises questions about reproducibility and whether reported benchmark numbers reflect default or optimized settings.