Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces FoleySet, a publicly available dataset comprising 10,000 human-annotated audio clips specifically designed for Foley sound effects in audiovisual post-production. The dataset is structured around a two-level Foley taxonomy, addressing the critical shortage of high-quality annotated resources that can enhance data-driven research in Foley classification, retrieval, and generation. By providing a standardized and accessible resource, FoleySet aims to facilitate advancements in the creation and manipulation of synchronous sound effects, ultimately improving the quality of audio-visual content.
A new dataset, FoleySet, empowers researchers to tackle the challenges of Foley sound effect classification and generation with 10,000 expertly annotated audio clips.
In audiovisual post-production, Foley refers to synchronous sound effects associated with human actions, such as footsteps, cloth rustle, and prop handling, that are recreated to match the on-screen movements and interactions of characters. These sounds are often recorded by professional Foley artists using physical props. This resource-intensive workflow has motivated data-driven research on Foley, including tasks such as classification, retrieval, and generation; however, high-quality annotated Foley datasets for training remain scarce. To address this gap, we present FoleySet, a publicly available Foley dataset of 10,000 audio clips annotated with a two-level Foley taxonomy. This dataset provides a standardized, Creative Commons-licensed resource for data-driven Foley classification, retrieval, and generation.