A Survey on Segment Anything Model (SAM): Vision Foundation Model Meets Prompt Engineering
It provides a comprehensive overview for researchers and practitioners in computer vision, though it is incremental as a survey rather than original research.
This survey explores the Segment Anything Model (SAM) family, highlighting its advancements in granularity and contextual understanding for image and video segmentation, while identifying limitations in high-granularity scenarios and without explicit prompts.
The Segment Anything Model (SAM), developed by Meta AI Research, represents a significant breakthrough in computer vision, offering a robust framework for image and video segmentation. This survey provides a comprehensive exploration of the SAM family, including SAM and SAM 2, highlighting their advancements in granularity and contextual understanding. Our study demonstrates SAM's versatility across a wide range of applications while identifying areas where improvements are needed, particularly in scenarios requiring high granularity and in the absence of explicit prompts. By mapping the evolution and capabilities of SAM models, we offer insights into their strengths and limitations and suggest future research directions, including domain-specific adaptations and enhanced memory and propagation mechanisms. We believe that this survey comprehensively covers the breadth of SAM's applications and challenges, setting the stage for ongoing advancements in segmentation technology.