Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces AnySimLite, a lightweight few-shot similarity encoder designed for on-device speech-adjacent classification, addressing the dual challenges of privacy and inference latency on edge devices. By reformulating multiple classification tasks into a text similarity framework and employing a novel dataset transformation strategy, the model achieves state-of-the-art performance while significantly reducing memory requirements. Notably, AnySimLite maintains a performance drop of less than 7% compared to the larger qLLaMA_LoRA-7B baseline, even with a model size that is less than 1/250th of its counterpart.
AnySimLite achieves state-of-the-art performance in few-shot speech-adjacent classification tasks while being over 250 times smaller than leading models.
To minimize privacy concerns and inference latency on edge devices like smartphones, lightweight on-device models remain important for end-user applications. Many of these applications involve natural language classification, but deploying multiple specialized models creates a memory footprint challenge. We investigate: Can a single lightweight architecture solve multiple Speech-Adjacent (SA) classification tasks through reduction to a nuanced text similarity formulation? We propose AnySimLite, a lightweight similarity encoder that combines word-level and character-level channels. Together with a dataset transformation strategy, we evaluate AnySimLite across multiple SA classification tasks and show that it consistently achieves state-of-the-art (SOTA) or SOTA-competitive performance in few-shot settings while maintaining a low memory footprint. Even in the worst case, the performance drop remains below 7% while using $<\frac{1}{250}^{\mathrm{th}}$ of the model size of the SOTA qLLaMA_LoRA-7B baseline.