Search papers, labs, and topics across Lattice.
The paper introduces MITRA, a RAG-based AI assistant tailored for knowledge retrieval within large physics collaborations like CERN's CMS experiment. MITRA uses Selenium for document retrieval, OCR with layout parsing for text extraction, and a two-tiered vector database to improve retrieval accuracy by first identifying the relevant analysis. The system is deployed on-premise to maintain data privacy and demonstrates superior retrieval performance compared to keyword-based baselines.
Tired of sifting through mountains of internal docs? This RAG system uses a clever two-tiered vector DB to surface the right physics analysis, not just keywords.
Large-scale scientific collaborations, such as the Compact Muon Solenoid (CMS) at CERN, produce a vast and ever-growing corpus of internal documentation. Navigating this complex information landscape presents a significant challenge for both new and experienced researchers, hindering knowledge sharing and slowing down the pace of scientific discovery. To address this, we present a prototype of MITRA, a Retrieval-Augmented Generation (RAG) based system, designed to answer specific, context-aware questions about physics analyses. MITRA employs a novel, automated pipeline using Selenium for document retrieval from internal databases and Optical Character Recognition (OCR) with layout parsing for high-fidelity text extraction. Crucially, MITRA's entire framework, from the embedding model to the Large Language Model (LLM), is hosted on-premise, ensuring that sensitive collaboration data remains private. We introduce a two-tiered vector database architecture that first identifies the relevant analysis from abstracts before focusing on the full documentation, resolving potential ambiguities between different analyses. We demonstrate the prototype's superior retrieval performance against a standard keyword-based baseline on realistic queries and discuss future work towards developing a comprehensive research agent for large experimental collaborations.
