Beyond Benchmarks: MathArena as an Evaluation Platform for Mathematics with LLMs
For researchers and developers tracking LLM mathematical reasoning capabilities, this provides a comprehensive, up-to-date evaluation platform that addresses benchmark saturation and narrow scope.
The authors expanded MathArena from a narrow benchmark into a continuously maintained evaluation platform for LLM mathematical reasoning, covering proof-based competitions, research-level problems, and formal proof generation. GPT-5.5 achieves 98% on the 2026 USA Math Olympiad and 74% on research-level questions, demonstrating the need for such platforms to track rapid progress.
Large language models (LLMs) are becoming increasingly capable mathematical collaborators, but static benchmarks are no longer sufficient for evaluating progress: they are often narrow in scope, quickly saturated, and rarely updated. This makes it hard to compare models reliably and track progress over time. Instead, we need evaluation platforms: continuously maintained systems that run, aggregate, and analyze evaluations across many benchmarks to give a comprehensive picture of model performance within a broad domain. In this work, we build on the original MathArena benchmark by substantially broadening its scope from final-answer olympiad problems to a continuously maintained evaluation platform for mathematical reasoning with LLMs. MathArena now covers a much wider range of tasks, including proof-based competitions, research-level arXiv problems, and formal proof generation in Lean. Additionally, we maintain a clear evaluation protocol for all models and regularly design new benchmarks as model capabilities improve to ensure that MathArena remains challenging. Notably, the strongest model, GPT-5.5, now reaches 98% on the 2026 USA Math Olympiad and 74% on research-level questions, showing that frontier models can now comfortably solve extremely challenging mathematical problems. This highlights the importance of continuously maintained evaluation platforms like MathArena to track the rapid progress of LLMs in mathematical reasoning.