Search papers, labs, and topics across Lattice.
This paper details FBK's submission to the IWSLT 2026 Instruction Following task, focusing on the development of SpeechLLMs for both short-form and long-form speech instruction following. The study achieves notable performance in the short track with a SIFS score of 2.0708 and explores three speech segmentation methods for the long track, identifying fixed 30-second segmentation as optimal, yielding a HIFS score of 2.0663. Analysis reveals that while hallucination primarily results in repetitive insertions affecting ASR and SSUM, the models maintain their short-form capabilities even when extended to long-form tasks.
Fixed 30-second segmentation emerges as the key to robust long-form speech instruction following, outperforming other methods.
This paper describes our submission to the IWSLT 2026 Instruction Following shared task. SpeechLLMs are developed for both short-form and long-form speech instruction following under constrained settings. For the short track, strong performance is achieved on MCIF, with a SIFS score of 2.0708. For the long track, three speech segmentation methods are explored, and the HIFS score is introduced to account for unstable long-form generation. Experimental results show that fixed 30-second segmentation provides the most robust long-form performance, achieving the highest HIFS score of 2.0663. Further analysis shows that hallucination mainly manifests as repetitive insertions in generated outputs, substantially affecting ASR and SSUM, while short-form capabilities are largely retained after long-form extension.
