Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Latent Ordinal Prototype Alignment (LOPA) as a novel approach to Spoken Language Assessment (SLA), addressing the limitations of existing multimodal large language models (MLLMs) by incorporating an ordinal geometric prior into the latent space. By integrating LOPA with Semantic-Anchored Layer Routing (SALR), which leverages multi-depth representations from a frozen Whisper encoder, the proposed framework achieves a root mean square error (RMSE) of 0.361, competing with large-scale models without requiring extensive fine-tuning. The results highlight the potential for a more interpretable and efficient SLA methodology that prioritizes ordinal structure over sheer model size.
LOPA achieves SLA performance comparable to billion-parameter models while sidestepping the need for large-scale fine-tuning.
Fueled by increasing model scale and multimodal inputs, Multimodal Large Language Models (MLLMs) have emerged as a promising paradigm for Spoken Language Assessment (SLA). While effective, this paradigm often overlooks the intrinsic ordinal structure of language acquisition. This paper works around the necessity of large-scale MLLMs by introducing Latent Ordinal Prototype Alignment (LOPA) for SLA, a prototype-based regularizer that enforces an ordinal geometric prior directly on the latent space. Coupled with Semantic-Anchored Layer Routing (SALR), which adaptively harvests multi-depth representations from a frozen Whisper encoder, our framework achieves an RMSE of 0.361. This performance rivals billion-parameter systems without the need for LLM-based fine-tuning. Further analysis reveals that SALR's synergy with LOPA offers interpretable, criterion-aligned preferences, thereby supporting an efficient and ordinal-aware modeling alternative to current scaling-centric models for SLA.