Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper presents an in silico model of the RAMPHO episodic buffer, a cognitive bottleneck in multi-talker speech comprehension, using frame-by-frame phonetic entropy from wav2vec 2.0. By contrasting semantically intact and phase-decorrelated distractors across an SNR sweep, the study dissociates informational and energetic masking. The simulation reveals a cognitive-acoustic Pareto frontier: semantic destruction of distractors reduces informational masking at high SNRs but impairs temporal glimpsing at low SNRs.
Destroying a competing speaker's semantic content can paradoxically *hurt* speech intelligibility in noisy environments, even as it helps in clearer conditions.
The fundamental challenge of listening in multi-talker environments is a cognitive bottleneck, defined by the Ease of Language Understanding (ELU) model as a failure within the RAMPHO episodic buffer. Current deep neural networks for speech enhancement optimize purely for physical acoustics, failing to account for the cognitive penalty of informational masking. Here, we present an in silico simulation of the RAMPHO buffer using the frame-by-frame phonetic entropy of a self-supervised acoustic model (wav2vec 2.0). By contrasting a semantically intact distractor with a phase-decorrelated distractor (the Concentration Shield) across a signal-to-noise ratio (SNR) sweep, we successfully dissociate the cognitive penalty of informational distraction from the physical penalty of energetic decay. The simulation reveals a cognitive-acoustic Pareto optimization problem: destroying a distractor's semantic payload provides a release from informational masking at high SNRs, but fundamentally degrades temporal glimpsing cues at low SNRs.