LLM reasoning / chain-of-thought

Monte Carlo estimation

Superseded baseline#21 of 772 most-superseded

Cited as a baseline — critiqued by newer work, not yet beaten on a benchmark here

3 papers critique it · 0 beat it on benchmarks

What papers say

Verbatim critique sentences, each from a paper that cites Monte Carlo estimation as a baseline.

MC estimation typically evaluates only final outcomes, ignoring explicit assessment of intermediate step correctness, which misaligns the supervision signal with the objective of step-wise reasoning accuracy
GroundedPRM: Tree-Guided and Fidelity-Aware Process Reward Modeling for Step-Level Reasoning
While Monte Carlo (MC) scores are used as step-wise gold labels, they also introduce substantial noise into the training process.
Exploring Generative Process Reward Modeling for Semi-Structured Data: A Case Study of Table Question Answering
they often demand significant computational resources and may produce noisy or unreliable labels, which can degrade model performance
FreePRM: Training Process Reward Models Without Ground Truth Process Labels

What to use instead

Recent methods in the same sub-problem, not yet superseded in the knowledge base — arXiv benchmark leaders, not vetted production recommendations.