SDJun 24

FoleySet: A Multi-Level Human-Annotated Foley Sound Dataset

arXiv:2606.259804.0
Predicted impact top 83% in SD · last 90 daysOriginality Synthesis-oriented
AI Analysis

It provides a standardized, Creative Commons-licensed resource for researchers working on data-driven Foley sound processing.

The paper introduces FoleySet, a publicly available dataset of 10,000 audio clips with a two-level Foley taxonomy, to address the scarcity of high-quality annotated Foley sound data for tasks like classification, retrieval, and generation.

In audiovisual post-production, Foley refers to synchronous sound effects associated with human actions, such as footsteps, cloth rustle, and prop handling, that are recreated to match the on-screen movements and interactions of characters. These sounds are often recorded by professional Foley artists using physical props. This resource-intensive workflow has motivated data-driven research on Foley, including tasks such as classification, retrieval, and generation; however, high-quality annotated Foley datasets for training remain scarce. To address this gap, we present FoleySet, a publicly available Foley dataset of 10,000 audio clips annotated with a two-level Foley taxonomy. This dataset provides a standardized, Creative Commons-licensed resource for data-driven Foley classification, retrieval, and generation.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes