Search papers, labs, and topics across Lattice.
To evaluate whether model reasoning traces genuinely assist human oversight, this work investigates six reasoning representations across varying task difficulties as human-facing interfaces rather than proxies for model reasoning. While such representations are increasingly deployed as explanations, standard model-centric benchmarks like faithfulness overlook whether users can reliably spot bugs or calibrate trust. The study uncovers a stark divergence between user preference and verification performance: participants strongly favor planning- and decomposition-based traces, yet simpler chain-of-thought prompts yield significantly higher error detection accuracy, fewer false alarms, and superior trust calibration.
The structured reasoning traces users prefer actively degrade oversight, triggering higher false-alarm rates and unearned trust compared to plain chain-of-thought.
Reasoning representations are increasingly used as explanations for large language model outputs. Yet they are typically evaluated with model-centric criteria, such as answer accuracy and faithfulness, leaving it unclear whether they help people evaluate model responses. In this work, we study reasoning representations as human-facing interfaces rather than proxies for model reasoning ability. We conduct a controlled human study of six reasoning formats across tasks of varying complexity, supported by a web-based framework that randomizes task domains, problem instances, and representation order. The study collects fine-grained judgments of structural understanding, error detection and localization, and trust calibration. Our study shows a mismatch between perceived preference and support for human evaluation. Participants prefer planning- and decomposition-based representations, but simpler chain-of-thought traces better support verification, trust, and interpretability. Preferred representations also introduce calibration risks, with more false alarms on correct traces and high trust despite low willingness to verify.
