Back to Explore
math.PRMathematics

Probability

Probability theory, stochastic processes

10.8LGMay 16
Propagation of Chaos in Contextual Flow Maps

Shi Chen, Zhengjiang Lin, Kaizhao Liu et al.

Provides rigorous statistical guarantees for transformer performance as context length grows, addressing a key theoretical gap for practitioners scaling models.

11.5PRApr 2
Homogenized Transformers

Hugo Koubbi, Borjan Geshkovski, Philippe Rigollet

This work addresses representation collapse in transformers, a key issue for AI practitioners, but it is incremental as it builds on existing theoretical frameworks without introducing new methods.

12.1PRMar 24
The Localization Method for High-Dimensional Inequalities

Yunbum Kook, Santosh S. Vempala

This is an incremental survey that reviews an existing method with broad applications in areas like isoperimetric inequalities, optimization, and Markov chains, but does not introduce new results.

10.5LGMay 8
Scaling Limits of Long-Context Transformers

Giuseppe Bruno, Shi Chen, Zhengjiang Lin et al.

For theorists studying transformer scaling, this provides precise phase transition boundaries and limiting laws, but the analysis is restricted to i.i.d. keys and fixed queries, limiting direct applicability.

2.5DMMar 10
Models of random spanning trees

Eric Babson, Moon Duchin, Annina Iseli et al.

This work provides foundational theoretical tools for analyzing random MST, a widely used but mathematically understudied object, benefiting researchers in probability and combinatorial optimization.

12.4PRMay 6
Grokability in five inequalities

Paata Ivanisvili, Xinyuan Xie

For mathematicians, these are incremental improvements on known inequalities and bounds, with no broad impact beyond the specific problems.

9.9LGApr 8
Diffusion Processes on Implicit Manifolds

Victor Kawasaki-Borruat, Clara Grotehans, Pierre Vandergheynst et al.

This provides a rigorous basis for manifold-aware sampling and generative modeling, addressing a fundamental challenge in high-dimensional data analysis.

4.3CLJun 5
How reliable are LLMs when it comes to playing dice?

Luca Avena, Gianmarco Bet, Bernardo Busoni

For researchers and practitioners relying on LLMs for reasoning tasks, this study reveals that current models lack robust probabilistic reasoning despite strong performance on standard benchmarks.

20.6CCJul 16
Space-Entropy Lower Bounds for Random Sampling

Thomas L. Draper, Feras A. Saad

This work provides the first known space lower bounds for entropy-efficient random sampling, addressing a fundamental question in information theory and algorithm design.

9.2CCApr 2
Average-Case Reductions for $k$-XOR and Tensor PCA

Guy Bresler, Alina Harbuzova

This work establishes a hardness partial order for planted tensor models, which is incremental but provides formal reductions that could impact theoretical computer science and machine learning by linking conjectured-hard problems.

9.3STApr 27
Estimating the size of a set using cascading exclusion

Sourav Chatterjee, Persi Diaconis, Susan Holmes

For statisticians and machine learning researchers, this work provides a unified theoretical framework with finite-sample guarantees for set size estimation across diverse domains.