Search papers, labs, and topics across Lattice.
This paper introduces FLEXRec, a discriminative framework that enhances compact large language models (LLMs) for recommendation systems by integrating multiple layer-wise exits to improve expressiveness and scalability. By employing an adaptive continuous router to dynamically select exits and a novel target-k hinge loss to regulate routing sparsity, FLEXRec achieves state-of-the-art accuracy on three real-world datasets while maintaining computational efficiency. The results demonstrate that compact LLMs can effectively compete with larger models without incurring significant latency, addressing a critical challenge in deploying LLMs in practical applications.
FLEXRec shows that compact LLMs can achieve state-of-the-art recommendation accuracy without the computational burden of larger models.
Large language model-based recommender systems (LLM-RSs) have demonstrated remarkable capabilities, but are computationally unsustainable for many real-world applications. Compact LLMs offer a practical alternative, yet their reduced capacity often requires reasoning or knowledge distillation methods that increase latency or depend on larger models. Combined with autoregressive generation, these approaches face severe scalability bottlenecks. In contrast, discriminative LLM-RSs enable efficient full-corpus ranking through embedding similarity, but compact backbones remain limited in expressiveness and structural adaptivity. We propose the Fusion of Layer-wise Exits for Sequential Recommendation (FLEXRec), a discriminative framework that enhances compact LLMs while retaining scalable full-corpus ranking. FLEXRec inserts prediction heads (i.e., exits) at multiple transformer layers and adaptively fuses their score distributions. An adaptive continuous router (AC-Router) dynamically selects both the number and identity of exits for each user sequence, while a novel target-k hinge loss regulates routing sparsity. Experiments on three real-world datasets with Qwen 3 1.7B and Llama 3.2 3B show that FLEXRec achieves state-of-the-art accuracy among compact-backbone methods while remaining highly efficient. Code: https://github.com/xurong-liang/FLEXRec
