NFDI4DS Shared Tasks for Scholarly Document Processing
This work addresses the need for standardized evaluation and FAIR practices in scholarly document processing for the broader research community, but it is incremental as it updates and consolidates existing tasks.
The paper presents an overview of twelve shared tasks under the NFDI4DS consortium, tackling challenges in scholarly document processing to advance research through community-based evaluation, resulting in open-access datasets, models, and tools integrated into a research data infrastructure.
Shared tasks are powerful tools for advancing research through community-based standardised evaluation. As such, they play a key role in promoting findable, accessible, interoperable, and reusable (FAIR), as well as transparent and reproducible research practices. This paper presents an updated overview of twelve shared tasks developed and hosted under the German National Research Data Infrastructure for Data Science and Artificial Intelligence (NFDI4DS) consortium, covering a diverse set of challenges in scholarly document processing. Hosted at leading venues, the tasks foster methodological innovations and contribute open-access datasets, models, and tools for the broader research community, which are integrated into the consortium's research data infrastructure.