Search papers, labs, and topics across Lattice.
This paper introduces candidate-fate accounting, an audit framework designed to enhance the transparency of automated sensor diagnostic pipeline searches by retaining comprehensive records of all candidate pipelines, including those that are invalid or skipped. By implementing this framework, the authors demonstrate its ability to detect previously omitted candidates and ensure complete candidate accounting without sacrificing diagnostic performance. Experiments reveal that their approach identifies 30-41 additional candidates that traditional fitted-trial-only reports fail to capture, thus improving the robustness of the diagnostic process.
A novel audit framework reveals that traditional AutoML practices overlook up to 41 critical candidates, enhancing transparency in sensor diagnostics.
Industrial sensor diagnostics relies on preprocessing, representation, and classification pipelines, making automated pipeline search useful for reducing manual design cost. However, existing automated machine/deep learning (AutoML/AutoDL) reports typically retain only fitted trials, scores, and winners, omitting generated candidates that are invalid, pruned, skipped, cached, or unfitted. This omission limits reviewers' ability to check signal constraints, budget use, and unevaluated legal alternatives. To address this, we propose candidate-fate accounting, a candidate-level audit framework for diagnostic search traces. It records each observed candidate as auditable evidence: hashes merge repeated observations, legality checks flag invalid candidates, allocation rationales explain budget decisions, and a closed fate ledger assigns one terminal fate to each candidate. Experiments on three bearing-diagnostic datasets show that the framework detects invalid candidates and identifies 30--41 candidates omitted by fitted-trial-only reports, with closed fate records verifying complete candidate accounting while maintaining competitive diagnostic performance. The code is available at https://github.com/XXIE999/candidate-fate-accounting.
