Search papers, labs, and topics across Lattice.
This study identifies and quantifies derived-feature over-trust (DFOT) in large language models (LLMs), where LLMs mistakenly treat derived measurements as direct facts, potentially leading to erroneous conclusions. Using physiological sensing data, the authors evaluate the impact of misleading derived measurements through two experimental designs that assess acceptance and rejection of PPG-derived rhythms against offline ECG references. The results show that a privileged distillation approach significantly enhances the accuracy of LLMs, improving repair and specificity metrics while also highlighting the importance of context in mitigating over-trust errors.
LLMs can misinterpret derived measurements as direct facts, leading to critical errors that can be mitigated with a novel privileged distillation approach.
Derived measurements increasingly enter large language model (LLM) pipelines as direct facts despite their instance-dependent validity. We define derived-feature over-trust (DFOT) as the failure in which a downstream LLM assigns such a measurement the epistemic status of a direct fact or uses it outside its valid scope. Using physiological sensing as a case study, D1 tests acceptance of a PPG-derived rhythm contradicted by offline ECG, whereas D2 tests rejection of an offline-confirmed reliable PPG rhythm under misleading severe history. ECG supplies training supervision and offline reference construction but is never shown to the LLM. Five estimands quantify this chain: conflict over-trust rate (COTR) and context-induced error rate (CIR) characterize D1/D2; correct repair rate (CRR) measures frozen-error repair; evidence-specific repair margin (ESRM) contrasts matched and patient-disjoint shuffled evidence; and utility harm rate (UHR) measures unnecessary verification among HIGH-reliability cases used without verification at baseline. The framework does not depend on a particular reliability generator. We demonstrate it on 50,000 paired PPG-ECG records using ECG-to-PPG privileged distillation as an illustrative baseline and PPG-only inference. On a protocol-locked 187-patient test, the baseline improves four repair and specificity endpoints by 1.82-6.69 percentage points, with all paired confidence intervals excluding zero; UHR increases by 0.67 percentage points (95% CI: -0.4 to +1.7). DFOT provides a common evaluation target for stronger mitigation methods. The code is available at https://github.com/Zongheng-Guo/When-Derived-Measurements-Mislead.
