LLM quantization
RTN
Superseded — cited as a baseline and beaten by newer methods
2 papers critique it · 10 beat it on benchmarks
What papers say
Verbatim critique sentences, each from a paper that cites RTN as a baseline.
the quantization error increases significantly when the number of bits is small, especially when significant outliers exist.
“uniform grids spend disproportionate capacity on rare large magnitudes while under-resolving dense near-zero regions; the mismatch is exacerbated in layers whose weight magnitudes span multiple decades.”
Beaten on benchmarks
Head-to-head results where a newer method reports beating RTN. Values are copied from the source paper's tables — verify against the cited paper.
Reasoning-QAT beats RTN
62.38 vs 2.60
Avg. · [Qwen3-4B W3G128]
What Makes Low-Bit Quantization-Aware Training Work for Reasoning LLMs? A Systematic StudyBiLLM beats RTN
15.14 vs 1412020.25
perplexity · [LLaMA-13B 1-bit]
BiLLM: Pushing the Limit of Post-Training Quantization for LLMsBenford-Quant beats RTN
70.87 vs 755.19
Perplexity · [3 bits, Small models]
Benford's Law as a Distributional Prior for Post-Training Quantization of Large Language ModelsTimestep-Aware SVDQuant-GPTQ beats RTN
0.689 vs 0.389
Imaging Quality · [W4A4 quantization]
Timestep-Aware SVDQuant-GPTQ for W4A4 Quantization of Wan2.2-I2VFAIR-Calib beats RTN
64.64 vs 42.00
STaR-Quant beats RTN
57.07 vs 44.23
Avg. · [W4A4 (4-bit weight and activation) on LLADA-8B]
STaR-Quant: State-Time Consistent Post-Training Quantization for Diffusion Large Language ModelsADMM-Q beats RTN
11.86 vs 15.27
C4 PPL · [LLaMA-3 8B W4A4KV4 A, g128]
ADMM-Q: An Improved Hessian-based Weight Quantizer for Post-Training Quantization of Large Language ModelsApiQ beats RTN
5.77 vs 6.66
WikiText2 PPL · [LLaMA-2-7B, 3-bit]
Enhancing Ultra-Low-Bit Quantization of Large Language Models Through Saliency-Aware Partial Retraining
What to use instead
Recent methods in the same sub-problem, not yet superseded in the knowledge base — arXiv benchmark leaders, not vetted production recommendations.
- STaR-QuantSTaR-Quant: State-Time Consistent Post-Training Quantization for Diffusion Large Language ModelsJun 3, 2026
- May 26, 2026
- May 1, 2026
- Bit-by-BitBit-by-Bit: Progressive QAT Strategy with Outlier Channel Splitting for Stable Low-Bit LLMsApr 9, 2026
- Benford-QuantBenford's Law as a Distributional Prior for Post-Training Quantization of Large Language ModelsJan 29, 2026
- HestiaHESTIA: A Hessian-Guided Differentiable Quantization-Aware Training Framework for Extremely Low-Bit LLMsJan 28, 2026
- Layer-Wise High-Impact Parameter Ratio OptimizationLayer-Wise High-Impact Parameter Ratio Optimization in Post-Training Quantization for Large Language ModelsNov 21, 2025
- Sep 28, 2025