Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Joint Source-Channel-Generation Coding (JSCGC), a novel communication framework that replaces traditional decoders with generative models to enhance the quality of image transmission over wireless channels. By reformulating the communication process to prioritize mutual information maximization under perceptual constraints, JSCGC addresses the limitations of conventional coding methods that fail to adequately represent human visual perception. Experimental results show that JSCGC significantly improves the semantic-level and distributional quality of transmitted images, demonstrating a unique error behavior that prioritizes semantic consistency over mere distortion minimization.
JSCGC transforms wireless communications by prioritizing semantic consistency over distortion, leading to superior image quality in challenging conditions.
Conventional communication systems, including both separation-based coding and learning-based joint source-channel coding (JSCC), are typically designed under Shannon's rate-distortion theory. However, relying on generic distortion metrics fails to capture complex human visual perception, often resulting in blurred or unrealistic reconstructions. In this paper, we propose Joint Source-Channel-Generation Coding (JSCGC), a generative communication paradigm that replaces the conventional decoder with a generative model at the receiver. The received signal is treated as a condition that controls the sampling process into the learned conditional distribution, reformulating communication from deterministic reconstruction for distortion minimization to controlled generation for mutual information maximization under perceptual constraints. Based on this formulation, we develop a unified joint training and efficient stochastic sampling framework, and provide theoretical analysis of its effectiveness in both learning and inference stages. Extensive experiments on latent-space image transmission demonstrate that the JSCGC consistently improves feature-based, semantic-level, and distributional quality across diverse channel conditions, while exhibiting a distinct error behavior characterized by semantic inconsistency rather than distortion.