Search papers, labs, and topics across Lattice.
JustDiag is a diagnostic justification engine designed to enhance accountability in root cause analysis (RCA) by maintaining an explicit process state that tracks evidence, findings, competing hypotheses, and unresolved conflicts. Evaluated on 66 real-world incidents, JustDiag demonstrated superior outcome and process scores compared to a control system lacking diagnostic justification, although it resulted in slightly lower terminal completion due to a more calibrated approach to uncertainty. This study highlights the necessity of incorporating explicit diagnostic artifacts in RCA to ensure accountability beyond merely providing fluent answers.
JustDiag reveals that accountability in root cause analysis hinges on explicit justification rather than just fluent conclusions.
Large language models can produce fluent root cause analyses, but fluent final answers alone are insufficient evidence for accountability in high-stakes operations. In real incident response, engineers need to know what evidence supported a diagnosis, which alternatives were considered, where contradictions remained, and whether the system resolved the case or preserved uncertainty. We address this gap with JustDiag, a diagnostic justification engine for RCA that maintains an explicit process state over evidence, findings, competing hypotheses, conflicts, and next checks. We evaluated the system on 66 real-world incidents using a two-layer protocol that separately scores final-answer quality and process quality. Relative to a matched control without diagnostic justification, JustDiag achieved stronger outcome and process scores, while accepting slightly lower terminal completion due to more calibrated non-closure. These results suggest that accountable RCA requires explicit diagnostic justification artifacts and process-aware evaluation, not only fluent final answers.
