C2-Evo: Co-Evolving Multimodal Data and Model for Self-Improving Reasoning
This work addresses the problem of scalable, high-quality multimodal data generation for improving MLLMs, which is incremental as it builds on existing self-improving models by introducing a co-evolution approach.
The paper tackles the challenge of enhancing multimodal large language models (MLLMs) by addressing issues in existing self-improving methods, such as discrepancies in data complexity and mismatched difficulty levels between data and models. The result is C2-Evo, a framework that jointly evolves training data and model capabilities, achieving considerable performance gains across multiple mathematical reasoning benchmarks.
Recent advances in multimodal large language models (MLLMs) have shown impressive reasoning capabilities. However, further enhancing existing MLLMs necessitates high-quality vision-language datasets with carefully curated task complexities, which are both costly and challenging to scale. Although recent self-improving models that iteratively refine themselves offer a feasible solution, they still suffer from two core challenges: (i) most existing methods augment visual or textual data separately, resulting in discrepancies in data complexity (e.g., over-simplified diagrams paired with redundant textual descriptions); and (ii) the evolution of data and models is also separated, leading to scenarios where models are exposed to tasks with mismatched difficulty levels. To address these issues, we propose C2-Evo, an automatic, closed-loop self-improving framework that jointly evolves both training data and model capabilities. Specifically, given a base dataset and a base model, C2-Evo enhances them by a cross-modal data evolution loop and a data-model evolution loop. The former loop expands the base dataset by generating complex multimodal problems that combine structured textual sub-problems with iteratively specified geometric diagrams, while the latter loop adaptively selects the generated problems based on the performance of the base model, to conduct supervised fine-tuning and reinforcement learning alternately. Consequently, our method continuously refines its model and training data, and consistently obtains considerable performance gains across multiple mathematical reasoning benchmarks. Our code, models, and datasets will be released.