Search papers, labs, and topics across Lattice.
This paper introduces TTT-PLC, a self-supervised test-time tuning framework that adapts packet loss concealment (PLC) models using only the received audio packets, enhancing their ability to reconstruct missing data. By synthetically masking parts of the available signal, the method trains the model to conceal these gaps without requiring clean reference signals or external data. The results demonstrate significant improvements in PLC performance across both non-causal and causal deployment settings, highlighting the potential for dynamic model adaptation in real-time applications.
Pretrained PLC models can be dynamically adapted at inference time, leading to substantial improvements in audio reconstruction even in lossy conditions.
Packet loss concealment (PLC) reconstructs audio packets that are missing at the receiver, usually with a trained model whose parameters remain fixed at deployment time. This treats the PLC model as static, even though each call or recording exposes signal-specific information through the packets that did arrive. We present TTT-PLC, a self-supervised test-time tuning framework that adapts existing PLC models using only those received packets. The method creates supervision by synthetically masking portions of the available signal, training the model to conceal them with its native PLC objective, and then using the adapted model to reconstruct the true packet losses. No clean reference signal, external adaptation data, or architectural modification is required. We study TTT-PLC in two deployment settings. In the non-causal setting, the received file is available before reconstruction, allowing repeated self-supervised adaptation passes and providing a per-file adaptation ceiling. In the causal setting, audio is streamed without revising emitted samples; adaptation is performed only on completed past blocks, and updated parameters affect only future audio. We instantiate the framework on two public PLC backbones, FRN, a recurrent full-band speech PLC model, and PARCnet, a hybrid autoregressive-neural model for networked music. Across these settings, the results show that pretrained PLC systems do not need to be treated as fixed at inference time, the still-observed portions of a lossy signal can provide an effective training signal for improving concealment on that same signal.
