Search papers, labs, and topics across Lattice.
The paper introduces OPERA, an operator-residual framework that enhances the reliability of autonomous agents in optical experiments by using physically interpretable feedback. By representing experimental actions as optical operators and evaluating outcomes through residuals, the framework significantly reduces the incidence of decisions that improve scores without actual physical success. In three optical tasks, OPERA demonstrated a marked improvement in achieving task targets and reduced experimental costs compared to traditional score-only feedback methods.
Operator-residual feedback slashes the rate of misleading score-only decisions from nearly 40% to under 2%, ensuring that autonomous agents make choices grounded in physical reality.
Autonomous agents choose actions using scores that may not reflect experimental success. We developed OPERA, an operator-residual framework for optical experiments. It represents experimental actions as optical operators and evaluates their outcomes using physically interpretable residuals. Operators specify executable changes to measurement, control or reconstruction, while residuals report departures from specified physical conditions. The agent uses both to select, combine or generate operators, and physical performance is evaluated independently against a withheld reference. Across three optical tasks, score-only feedback produced score increases without physical improvement in 23.6--39.0\% of decisions, compared with 0.9--1.9\% for operator-residual feedback. Operator-residual feedback increased the probability of reaching and maintaining task targets and reduced experimental budgets. Protocols selected in digital twins were transferred to three optical instruments, and repeated experiments showed a lower projection budget in structured-light reconstruction. Together, operators and residuals guide autonomous decisions using measurable physical evidence.
Tsinghua AI