Search papers, labs, and topics across Lattice.
The paper introduces EyeLayer, a lightweight attention-augmentation module that integrates human eye-gaze patterns into LLM-based code summarization to improve performance. EyeLayer models human attention using a Multimodal Gaussian Mixture to redistribute token embeddings based on learned gaze parameters, effectively injecting human expertise into the LLM's attention mechanism. Experiments across LLaMA-3.2, Qwen3, and CodeBERT show that EyeLayer consistently outperforms fine-tuning baselines, achieving up to 13.17% improvement on BLEU-4, demonstrating the value of human gaze patterns for enhancing LLM code summarization.
Human eye-tracking data can significantly boost LLM code summarization performance, improving BLEU-4 scores by over 13% via a lightweight attention module that distills gaze patterns into learned priors.
Code summarization is the task of generating natural language descriptions of source code, which is critical for software comprehension and maintenance. While large language models (LLMs) have achieved remarkable progress on this task, an open question remains: can human expertise in code understanding further guide and enhance these models? We propose EyeLayer, a lightweight attention-augmentation module that incorporates human eye-gaze patterns, as a proxy of human expertise, into LLM-based code summarization. EyeLayer models human attention during code reading via a Multimodal Gaussian Mixture, redistributing token embeddings based on learned parameters (μ_i, σ_i^2) that capture where and how intensively developers focus. This design enables learning generalizable attention priors from eye-tracking data and incorporating them into LLMs seamlessly, without disturbing existing representations. We evaluate EyeLayer across diverse model families (i.e., LLaMA-3.2, Qwen3, and CodeBERT) covering different scales and architectures. EyeLayer consistently outperforms strong fine-tuning baselines across standard metrics, achieving gains of up to 13.17% on BLEU-4. These results demonstrate that human gaze patterns encode complementary attention signals that enhance the semantic focus of LLMs and transfer effectively across diverse models for code summarization.
