Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper investigates the feasibility of detecting deception without transmitting raw video data by utilizing a compact digest extracted from on-device speech and vision data. The authors demonstrate that their method, Whissle, achieves comparable deception detection performance to state-of-the-art models while preserving privacy, reporting an AUC of 0.755 with a large language model and 7.8 times fewer input tokens. The findings highlight the potential for effective multimodal deception detection that maintains user privacy by avoiding the need for heavy media transmission.
Achieving deception detection accuracy on par with leading models while keeping sensitive video data on-device could revolutionize privacy in AI applications.
Frontier multimodal models can guess whether a person is lying from a testimony video. To do so, they stream that raw face and voice to a third-party model. We ask whether the heavy media is needed at all. On the Real-life Trial Deception dataset, Whissle on-device speech and vision stack extracts a compact digest: transcript, emotion, age, gender, intent distributions, a deception intent filter, fluency and rhythm, per-frame facial behaviour, and prosody. Under speaker-independent evaluation, we report three findings. A small classifier on this digest reaches AUC 0.741, matching Gemini 2.5 Pro on full video. Handing the digest to a frontier LLM reaches AUC 0.755 with Claude Opus 4.8 at 7.8X fewer input tokens, with no media leaving the device. The reported 75% accuracy is a speaker-leakage artifact. We release code and experiments.