Search papers, labs, and topics across Lattice.
This paper introduces an LLM-based tool to automatically generate traces linking research ideas described in a paper to their corresponding code implementations. The tool aims to reduce onboarding time for new researchers and improve the evaluation of replication packages by conference reviewers. Experiments demonstrate the tool's ability to create useful mappings between paper concepts and code locations.
Cut onboarding time and improve reproducibility: an LLM automatically maps research papers to their code implementations.
Modern research heavily relies on software. A significant challenge researchers face is understanding the complex software used in specific research fields. We target two scenarios in this context, namely long onboarding times for newcomers and conference reviewers evaluating replication packages. We hypothesize that both scenarios can be significantly improved when there is a clear link between the paper's ideas and the code that implements them. As a time- and staff-saving approach, we propose an LLM-based automation tool that takes in a paper and the software implementing the paper, and generates a trace mapping between research ideas and their locations in code. Initial experiments have shown that the tool can generate quite useful mappings.
