Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper expands the cooperative multi-task semantic communication (CMT-SemCom) framework to effectively manage heterogeneous classification and regression tasks using the complex Cityscapes dataset. By employing the information maximization (InfoMax) principle, the framework accommodates both discrete and continuous semantic variables, enhancing its applicability in real-world scenarios. The results show that CMT-SemCom significantly outperforms traditional benchmarks, providing valuable insights into the impact of common unit capacity on joint task performance.
CMT-SemCom achieves superior performance on complex heterogeneous tasks, revealing the critical role of common unit capacity in multi-task learning.
Multi-Task semantic communication (SemCom) prioritizes simultaneous execution of multiple tasks over bit-accurate reconstruction in future intelligent networks. In our prior work [1], we introduced the cooperative multi-task SemCom (CMT-SemCom) framework, in which the semantic encoder is divided into a common unit (CU) and multiple specific units (SUs) to facilitate cooperative multi-task processing. However, CMT-SemCom has been evaluated on homogeneous classification tasks on simplistic datasets, limiting its applicability to real-world perception systems. In this paper, we extend our CMT-SemCom to jointly handle heterogeneous classification and regression tasks on the complex Cityscapes dataset. We adopt the information maximization (InfoMax) principle so that it accommodates mixed discrete and continuous semantic variables. In particular, we benchmark the proposed framework against independent single-task training, a conventional task-agnostic digital transmission, and single-encoder multi-decoder SemCom. Additionally, we investigate the impact of CU capacity on joint task performance, providing design insights. Extensive evaluations demonstrate that CMT-SemCom significantly outperforms the benchmarks.