论文标题

反对语义噪声的语义通信强大

Robust Semantic Communications Against Semantic Noise

论文作者

Hu, Qiyu, Zhang, Guangyi, Qin, Zhijin, Cai, Yunlong, Yu, Guanding, Li, Geoffrey Ye

论文摘要

尽管语义通信在大量任务中表现出令人满意的表现,但是语义噪声的影响和系统的鲁棒性尚未得到很好的研究。语义噪声是语义通信系统中一种特殊的噪声,它指的是预期的语义符号和接收到的噪声。在本文中,我们首先提出了一个框架,用于稳健的端到端语义通信系统来对抗语义噪声。特别是,我们分析了语义噪声的原因,并提出了一种实用方法来产生它。为了消除语义噪声的效果,提出了对抗性训练,以将带有语义噪声的样品纳入训练数据集中。然后,蒙版自动编码器(MAE)被设计为稳健的语义通信系统的体系结构,其中一部分输入被掩盖。为了进一步提高语义通信系统的鲁棒性,我们首先采用了矢量量化变量自动编码器(VQ-VAE)来设计发射器共享的离​​散代码簿和用于编码功能表示的接收器。因此,发射器只需要在代码簿中传输这些功能的索引即可。仿真结果表明,我们提出的方法可显着提高语义通信系统针对语义噪声的鲁棒性,并大大减少了传输开销。

Although the semantic communications have exhibited satisfactory performance in a large number of tasks, the impact of semantic noise and the robustness of the systems have not been well investigated. Semantic noise is a particular kind of noise in semantic communication systems, which refers to the misleading between the intended semantic symbols and received ones. In this paper, we first propose a framework for the robust end-to-end semantic communication systems to combat the semantic noise. Particularly, we analyze the causes of semantic noise and propose a practical method to generate it. To remove the effect of semantic noise, adversarial training is proposed to incorporate the samples with semantic noise in the training dataset. Then, the masked autoencoder (MAE) is designed as the architecture of a robust semantic communication system, where a portion of the input is masked. To further improve the robustness of semantic communication systems, we firstly employ the vector quantization-variational autoencoder (VQ-VAE) to design a discrete codebook shared by the transmitter and the receiver for encoded feature representation. Thus, the transmitter simply needs to transmit the indices of these features in the codebook. Simulation results show that our proposed method significantly improves the robustness of semantic communication systems against semantic noise with significant reduction on the transmission overhead.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源