Search papers, labs, and topics across Lattice.
This paper investigates the internal representations of Large Vision Language Models (LVLMs) during Visual Document Understanding (VDU) tasks using linear probing to assess information encoding across different layers. They find a significant discrepancy between the information present in internal representations and the information reflected in the final generated responses, with intermediate layers often encoding task-relevant information more clearly. Based on this, they show that fine-tuning intermediate layers improves both the accuracy of linear probes and the quality of generated responses, effectively bridging the representation-response gap.
LVLMs know more than they say: critical information for visual document understanding is often better represented in intermediate layers than in the final output, suggesting a bottleneck in the generation process.
Visual document understanding (VDU) is a challenging task for large vision language models (LVLMs), requiring the integration of visual perception, text recognition, and reasoning over structured layouts. Although recent LVLMs have shown progress on VDU benchmarks, their performance is typically evaluated based on generated responses, which may not necessarily reflect whether the model has actually captured the required information internally. In this paper, we investigate how information required to solve VDU tasks is represented across different layers of LLMs within LVLMs using linear probing. Our study reveals that (1) there is a clear gap between internal representations and generated responses, and (2) information required to solve the task is often encoded more linearly from intermediate layers than from the final layer. Motivated by these findings, we explore fine-tuning strategies that target intermediate layers. Experiments show that fine-tuning intermediate layers improves both linear probing accuracy and response accuracy while narrowing the gap.
