DiMaS: Distribution Matching for Steering Vision-Language-Action Models
This work provides a novel method for achieving behavioral control in VLA models, which is important for enabling more nuanced and adaptable robotic manipulation.
The paper addresses the problem of fine-grained behavioral control in flow-matching-based vision-language-action (VLA) models for robotic manipulation. The authors propose DiMaS, a distribution-matching steering strategy that outperforms classical linear steering methods, effectively controlling behavior across two state-of-the-art VLAs.
Flow-matching-based vision-language-action (VLA) models have emerged as powerful policies for robotic manipulation, yet a critical capability remains underexplored: fine-grained behavioral control, the ability to govern how a robot performs a task by intervening on its internal representations. Representation steering is a well-established interpretability tool for language and vision-language models, where behavioral features are typically encoded as linear directions, but we show that these classic methods fall short in VLAs. We propose DiMaS, a Distribution-Matching Steering strategy tailored to flow-matching VLAs, which transports between representation distributions rather than shifting along a fixed direction, and show that it effectively controls behavior across two state-of-the-art VLAs. We further examine the generalizability of this strategy as the tasks it is learned from and evaluated on grow increasingly dissimilar, characterizing where behavioral control transfers and where it weakens. Finally, through an analysis of the representation structure of the action expert, we explain why classical linear steering falls short in the visuomotor setting: behavioral features are linearly decodable but not linearly steerable, which motivates the distribution-matching design of DiMaS. Our code is publicly available at https://github.com/pegah-kh/dimas, with additional results and videos at https://pegah-kh.github.io/dimas/