CRAFT: A Neuro-Symbolic Framework for Visual Functional Affordance Grounding
This addresses the challenge of interpretable affordance grounding for robust scene understanding, though it appears incremental as it builds on existing neuro-symbolic and vision-language methods.
The paper tackles the problem of identifying objects in a scene that enable specific actions (e.g., 'cut') by introducing CRAFT, a neuro-symbolic framework that integrates commonsense priors with visual evidence. It demonstrates improved accuracy and interpretability in multi-object, label-free settings.
We introduce CRAFT, a neuro-symbolic framework for interpretable affordance grounding, which identifies the objects in a scene that enable a given action (e.g., "cut"). CRAFT integrates structured commonsense priors from ConceptNet and language models with visual evidence from CLIP, using an energy-based reasoning loop to refine predictions iteratively. This process yields transparent, goal-driven decisions to ground symbolic and perceptual structures. Experiments in multi-object, label-free settings demonstrate that CRAFT enhances accuracy while improving interpretability, providing a step toward robust and trustworthy scene understanding.