论文标题
LPCSE:通过线性预测编码增强神经语音
LPCSE: Neural Speech Enhancement through Linear Predictive Coding
论文作者
论文摘要
5G/B5G沟通系统中经验质量的越来越严格的要求导致了新兴的神经语音增强技术,但是,这些技术已与现有的基于专家规定的语音发音和失真模型隔离开发,例如经典线性预测编码(LPC)语音模型,因为它很难与自动学习机器进行自动学习模型集成模型,因为它很难将其集成在一起。在本文中,为了提高神经语音增强的效率,我们引入了基于LPC的语音增强(LPCSE)体系结构,该体系结构利用LPC语音模型中强烈的归纳偏见以及神经网络的表现力。在LPCSE中,通过两个新颖的块实现了可区分的端到端学习:在将LPC语音模型集成到神经网络中时,利用专家规则来减少计算开销,并通过将线性预测系数映射到过滤器中,从而确保模型的稳定性并避免在端到端训练中爆炸梯度。实验结果表明,LPCSE成功地恢复了因传播损失而扭曲的语音的共振体,并且在LJ Speek Corpus上的语音质量(PESQ)和短期客观的可理解性(PESQ)和短期客观可理解性(STOI)方面,胜过两种可比神经网络大小的现有神经语音增强方法。
The increasingly stringent requirement on quality-of-experience in 5G/B5G communication systems has led to the emerging neural speech enhancement techniques, which however have been developed in isolation from the existing expert-rule based models of speech pronunciation and distortion, such as the classic Linear Predictive Coding (LPC) speech model because it is difficult to integrate the models with auto-differentiable machine learning frameworks. In this paper, to improve the efficiency of neural speech enhancement, we introduce an LPC-based speech enhancement (LPCSE) architecture, which leverages the strong inductive biases in the LPC speech model in conjunction with the expressive power of neural networks. Differentiable end-to-end learning is achieved in LPCSE via two novel blocks: a block that utilizes the expert rules to reduce the computational overhead when integrating the LPC speech model into neural networks, and a block that ensures the stability of the model and avoids exploding gradients in end-to-end training by mapping the Linear prediction coefficients to the filter poles. The experimental results show that LPCSE successfully restores the formants of the speeches distorted by transmission loss, and outperforms two existing neural speech enhancement methods of comparable neural network sizes in terms of the Perceptual evaluation of speech quality (PESQ) and Short-Time Objective Intelligibility (STOI) on the LJ Speech corpus.