LGSep 29, 2025
Putnam-like dataset summary: LLMs as mathematical competition contestantsBartosz Bieganowski, Daniel Strzelecki, Robert Skiba et al.
In this paper we summarize the results of the Putnam-like benchmark published by Google DeepMind. This dataset consists of 96 original problems in the spirit of the Putnam Competition and 576 solutions of LLMs. We analyse the performance of models on this set of problems to verify their ability to solve problems from mathematical contests.