Search papers, labs, and topics across Lattice.
This paper introduces PETRA, a novel dataset and pipeline designed to enhance retrieval performance in the petroleum engineering domain by transforming noisy web text into a curated corpus with synthetic supervision. The approach leverages a combination of high-recall curation, an accurate energy-domain classifier, and advanced query generation techniques to create a dataset comprising 1.36 million curated chunks and 400,000 teacher-scored candidate rows. PETRA significantly boosts retrieval effectiveness, achieving a 0.763 nDCG score and improving performance on both public benchmarks and reasoning-intensive tasks, highlighting the importance of effective data repackaging for retrieval success.
Transforming noisy web text into a high-quality petroleum engineering dataset boosts retrieval performance by over 44% on benchmark tasks.
Petroleum-engineering search exposes a supervision gap for strong general retrievers: relevant evidence exists in public web text, but domain relevance labels are scarce. To address this gap, we propose PETRA, a large-scale Petroleum Engineering Text for Retrieval Adaptation dataset and pipeline that converts noisy public web data into a curated domain corpus and synthetic supervision for dense retrieval and reranking. PETRA contains 1.36M curated chunks, approximately 2B token equivalents, $\approx$859k, embedding training rows from $\approx$224k anchors, and roughly 400k teacher-scored reranker candidate rows. Its construction combines high-recall energy-domain curation, an energy-domain classifier with 98.4% test accuracy, chunk-grounded query generation, LLM-written hard negatives, and retrieval-mined candidate lists. PETRA improves first-stage in-domain Normalized Discounted Cumulative Gain (nDCG) from 0.703 to 0.763 through score fusion. Reranker adaptation improves the public Earth Science benchmark by 44% relative and a six-task reasoning-intensive panel by 23%. Failed training recipes show that high train-holdout accuracy on synthetic labels does not predict retrieval gains; retrieval-mined data helps only after being repackaged as teacher-scored candidate lists sampled from the inference-time candidate distribution.
