Visual Large Language Models for Generalized and Specialized Applications
It addresses the need for a unified overview of VLLM applications for researchers and practitioners, but it is incremental as it is a survey rather than presenting new methods or results.
This survey paper synthesizes the diverse applications of visual large language models (VLLMs) across vision, action, and language modalities, aiming to provide a comprehensive guide for future innovations and broader use.
Visual-language models (VLM) have emerged as a powerful tool for learning a unified embedding space for vision and language. Inspired by large language models, which have demonstrated strong reasoning and multi-task capabilities, visual large language models (VLLMs) are gaining increasing attention for building general-purpose VLMs. Despite the significant progress made in VLLMs, the related literature remains limited, particularly from a comprehensive application perspective, encompassing generalized and specialized applications across vision (image, video, depth), action, and language modalities. In this survey, we focus on the diverse applications of VLLMs, examining their using scenarios, identifying ethics consideration and challenges, and discussing future directions for their development. By synthesizing these contents, we aim to provide a comprehensive guide that will pave the way for future innovations and broader applications of VLLMs. The paper list repository is available: https://github.com/JackYFL/awesome-VLLMs.