Scholar Feed

Retrieval-augmented generation

RetRobust

Superseded baseline#26 of 1,179 most-superseded

Superseded — cited as a baseline and beaten by newer methods

3 papers critique it · 6 beat it on benchmarks

What papers say

Verbatim critique sentences, each from a paper that cites RetRobust as a baseline.

However, a limitation remains regarding the granularity of adaptation. By relying on dense optimization strategies such as full-parameter fine-tuning or layer-level parameter-efficient fine-tuning, existing approaches overlook the potential of neuron-level sparsity.
— Neuro-RIT: Neuron-Guided Instruction Tuning for Robust Retrieval-Augmented Language Model
“However, it neglect the importance of clean data, which is essential for enabling RALMs to extract and utilize relevant information effectively, and offer no benefit toward retriever optimization.”
— DACL-RAG: Data Augmentation Strategy with Curriculum Learning for Retrieval-Augmented Generation
“However, these robust training approaches are primarily applied to small or weak LMs with fewer than 7 billion parameters. Thus, there's an urgent need to explore whether complex robust training is still necessary to improve the robustness and generalization of bigger or stronger models when dealing with noisy contexts.”
— On the Diminishing Returns of Complex Robust RAG Training in the Era of Powerful LLMs

Beaten on benchmarks

Head-to-head results where a newer method reports beating RetRobust. Values are copied from the source paper's tables — verify against the cited paper.

What to use instead

Recent methods in the same sub-problem, not yet superseded in the knowledge base — arXiv benchmark leaders, not vetted production recommendations.