CLLGApr 28, 2025

Context-Guided Dynamic Retrieval for Improving Generation Quality in RAG Models

arXiv:2504.19436v112 citationsh-index: 102025 IEEE 7th International Conference on Communications, Information System and Computer Engineering (CISCE)
Originality Incremental advance
AI Analysis

This addresses context adaptation and knowledge access limitations in RAG models for open-domain question answering and complex generation tasks, representing an incremental advancement.

The paper tackles the problem of static retrieval in Retrieval-Augmented Generation (RAG) models by proposing a dynamic retrieval mechanism, resulting in significant improvements in BLEU and ROUGE-L scores on the Natural Questions dataset.

This paper focuses on the dynamic optimization of the Retrieval-Augmented Generation (RAG) architecture. It proposes a state-aware dynamic knowledge retrieval mechanism to enhance semantic understanding and knowledge scheduling efficiency in large language models for open-domain question answering and complex generation tasks. The method introduces a multi-level perceptive retrieval vector construction strategy and a differentiable document matching path. These components enable end-to-end joint training and collaborative optimization of the retrieval and generation modules. This effectively addresses the limitations of static RAG structures in context adaptation and knowledge access. Experiments are conducted on the Natural Questions dataset. The proposed structure is thoroughly evaluated across different large models, including GPT-4, GPT-4o, and DeepSeek. Comparative and ablation experiments from multiple perspectives confirm the significant improvements in BLEU and ROUGE-L scores. The approach also demonstrates stronger robustness and generation consistency in tasks involving semantic ambiguity and multi-document fusion. These results highlight its broad application potential and practical value in building high-quality language generation systems.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes