Search papers, labs, and topics across Lattice.
This paper introduces ATCCaps, a novel dataset specifically designed for air traffic control (ATC) speech recognition that emphasizes call-sign awareness. By leveraging real ATC radiotelephony recordings, the dataset comprises 202.94 hours of audio and 170,385 utterances, enabling advanced evaluation of automatic speech recognition (ASR) systems and call-sign matching. Key findings indicate that while ATCCaps supports scalable audio-grounded call-sign supervision, it also underscores the necessity for rigorous validation of call-sign and numeric accuracy in ATC communications.
ATCCaps reveals that effective call-sign recognition in ATC communications hinges not just on quantity, but on the quality and accuracy of audio-text supervision.
Call signs are safety-critical entities in air traffic control (ATC) communications because they identify the target aircraft of each spoken instruction. This paper presents ATCCaps, a call-sign-aware ATC speech dataset with caption-level audio-text supervision. Built from real ATC radiotelephony recordings, ATCCaps contains 202.94 hours of curated audio, 170,385 utterances, and 922 unique normalized call signs. The construction pipeline combines confidence-aware transcript parsing, ADS-B-derived call-sign metadata, call-sign normalization, rule-based quality filtering, and LLM-assisted caption generation. Each retained sample is paired with transcript descriptions, call-sign descriptions, and ATC-style captions, supporting ASR evaluation, call-sign matching, and call-sign-aware audio-text retrieval. We further characterize ATCCaps through split statistics, call-sign coverage, seen/unseen call-sign analysis, filtering audits, and caption quality evaluation. The evaluation subset is derived from the human-annotated ATCO2-test-set, enabling reference evaluation with manual transcripts. Results show that ATCCaps provides scalable audio-grounded call-sign supervision, while caption analysis highlights the need to explicitly validate call-sign and numeric fidelity. Reference ASR and CLAP-based baselines demonstrate the usability of ATCCaps for call-sign-aware ATC speech modeling.
