Label What Matters: Modality-Balanced and Difficulty-Aware Multimodal Active Learning
This work addresses the problem of efficient data annotation for multimodal models, offering an incremental improvement over existing active learning methods by dynamically balancing modalities and prioritizing difficult samples.
The paper tackles the challenge of costly labeled data in multimodal learning by proposing RL-MBA, a reinforcement-learning framework for active learning that adapts to dynamic modality importance and sample difficulty, resulting in improved classification accuracy and modality fairness on datasets like Food101, KineticsSound, and VGGSound under limited labeling budgets.
Multimodal learning integrates complementary information from different modalities such as image, text, and audio to improve model performance, but its success relies on large-scale labeled data, which is costly to obtain. Active learning (AL) mitigates this challenge by selectively annotating informative samples. In multimodal settings, many approaches implicitly assume that modality importance is stable across rounds and keep selection rules fixed at the fusion stage, which leaves them insensitive to the dynamic nature of multimodal learning, where the relative value of modalities and the difficulty of instances shift as training proceeds. To address this issue, we propose RL-MBA, a reinforcement-learning framework for modality-balanced, difficulty-aware multimodal active learning. RL-MBA models sample selection as a Markov Decision Process, where the policy adapts to modality contributions, uncertainty, and diversity, and the reward encourages accuracy gains and balance. Two key components drive this adaptability: (1) Adaptive Modality Contribution Balancing (AMCB), which dynamically adjusts modality weights via reinforcement feedback, and (2) Evidential Fusion for DifficultyAware Policy Adjustment (EFDA), which estimates sample difficulty via uncertainty-based evidential fusion to prioritize informative samples. Experiments on Food101, KineticsSound, and VGGSound demonstrate that RL-MBA consistently outperforms strong baselines, improving both classification accuracy and modality fairness under limited labeling budgets.