Track synthesis, materials and catalysis as it is published.
Search papers, labs, and topics across Lattice.
This paper introduces PhysicsSliders (PXS), a generative model for audio foley that learns to control sound generation via physical parameters like material, geometry, and contact dynamics. PXS is trained on simulated contact sounds and demonstrates predictable control over hardness, size, speed, and damping, even when combining parameters and incorporating room descriptions. The model achieves high fidelity in matching real-world audio targets, with a mean grouped Spearman correlation of 0.976 and low class-median error, by mapping real-audio measurements to simulator inversion inputs.
Physical controls like damping and size can precisely guide audio foley generation, achieving near-perfect correlation with real-world sound targets without fine-tuning.
Physical properties provide intuitive controls for sounds made by interacting objects. The challenge is to make a generative model respond predictably to these controls, both individually and in combination. We present \method\ (PXS), trained on simulated contact sounds with 15 material, geometry and contact parameters. Two separately trained variants accept direct parameter inputs or numerical captions. PXS controls hardness, size, speed and damping, supports room descriptions and produces spectrally distinct outputs at fixed targets. When controlling damping and size together, specifying thickness improves frequency accuracy and joint target delivery. Measurements from real recordings define effective-damping targets, which simulator inversion maps to generation inputs without real-audio fine-tuning. Across 18 impact classes from five real-audio datasets, PXS-Physical follows these targets with mean grouped Spearman correlation $ρ=0.976$ and class-median error 0.094 dex (a factor of 1.24).