Search papers, labs, and topics across Lattice.
This paper introduces ELSA, a novel reference-free evaluation metric designed to enhance the assessment of text-to-audio (TTA) generation by focusing on fine-grained acoustic event-level semantic alignment. By decomposing generated audio based on distinct acoustic events derived from text queries, ELSA provides a more accurate evaluation that correlates better with human judgments compared to existing CLAP-based metrics. Experimental results across four TTA benchmarks demonstrate that ELSA significantly improves the reliability of TTA evaluations, making it a valuable tool for advancing TTA models.
ELSA outperforms existing metrics by aligning audio evaluations with human judgments at the level of individual acoustic events, transforming TTA assessment.
Text-to-audio (TTA) generation, synthesizing audio from natural language, has been widely studied for its ability to capture precise user intent. To effectively advance TTA models, it is essential to reliably evaluate generated audio without relying on costly human subjective ratings, motivating the development of automatic evaluation metrics that correlate well with human judgments. While recent CLAP-based metrics provide practical reference-free solutions, their coarse-grained text-audio similarity matching often correlates poorly with human ratings. To address this, we propose ELSA, a reference-free evaluation metric for fine-grained text-audio alignment. ELSA decomposes generated audio guided by distinct acoustic events derived from the text query and assesses event-level alignment. Experiments across four TTA benchmarks show that ELSA reveals a higher correlation with human subjective ratings than prior metrics, highlighting its effectiveness for reliable TTA evaluation.
