CNVSRC 2024: The Second Chinese Continuous Visual Speech Recognition Challenge
This work addresses the problem of improving visual speech recognition for Chinese language applications, but it is incremental as it builds directly on a prior challenge with similar datasets and goals.
The paper presents the second Chinese Continuous Visual Speech Recognition Challenge (CNVSRC 2024), which builds on a previous challenge to advance research in Chinese Large Vocabulary Continuous Visual Speech Recognition by evaluating reading and Internet speech scenarios, with key improvements including a stronger baseline system and an additional dataset to enhance data volume and diversity.
This paper presents the second Chinese Continuous Visual Speech Recognition Challenge (CNVSRC 2024), which builds on CNVSRC 2023 to advance research in Chinese Large Vocabulary Continuous Visual Speech Recognition (LVC-VSR). The challenge evaluates two test scenarios: reading in recording studios and Internet speech. CNVSRC 2024 uses the same datasets as its predecessor CNVSRC 2023, which involves CN-CVS for training and CNVSRC-Single/Multi for development and evaluation. However, CNVSRC 2024 introduced two key improvements: (1) a stronger baseline system, and (2) an additional dataset, CN-CVS2-P1, for open tracks to improve data volume and diversity. The new challenge has demonstrated several important innovations in data preprocessing, feature extraction, model design, and training strategies, further pushing the state-of-the-art in Chinese LVC-VSR. More details and resources are available at the official website.