Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
RenderRank replaces standard text token sequences in cross-encoder reranking by rendering candidate documents as images and encoding them via compressed visual tokens in a vision-language model. This directly amortizes the quadratic attention cost across large candidate pools, cutting token counts while maintaining dense semantic representation. Across 11 BEIR benchmarks and four long-document datasets, the model matches or exceeds sub-4B text baselines with 16.5–50% fewer input tokens and achieves up to a 1.70× throughput gain.
Turning text into images cuts reranking token overhead by up to 50% and yields a 1.70× throughput boost—all while outperforming standard sub-4B text rerankers across BEIR.
Rendering document text as images allows vision-language models to encode documents as visual tokens, which can reduce input sequence length compared with text input. This reduction in input length is particularly useful for reranking, where each query involves scoring multiple candidate documents and token savings apply to each candidate evaluation. We introduce RenderRank, a reranker that learns query-dependent relevance scoring from compressed visual document representations instead of the text token sequences used by conventional text-based rerankers. Training first aligns relevance scores from visual inputs with those of a text-based teacher, then refines the relative scores of positive and negative documents for the same query. Across 11 datasets from BEIR, RenderRank uses 16.5-35.5% fewer input tokens while achieving an average NDCG@10 of 55.96, outperforming all evaluated text-based baselines below 4B parameters and some larger models. Across four long-document datasets, it achieves an average NDCG@10 of 88.27 with approximately half the average input token count of the evaluated text-based rerankers. In this setting, RenderRank delivers 1.70x the highest average throughput of the evaluated baselines. These results demonstrate that compressed visual representations can support accurate document relevance scoring, providing an alternative to text token representations for reranking.