论文标题

视频编码中学习的环内过滤的复杂性降低

Complexity Reduction of Learned In-Loop Filtering in Video Coding

论文作者

Bayliss, Woody, Murn, Luka, Izquierdo, Ebroul, Zhang, Qianni, Mrak, Marta

论文摘要

在视频编码中,在存储输出框架之前,将循环过滤器应用于重建的视频帧上以增强其感知质量。传统的环内过滤器是通过手工制作的方法获得的。最近,基于利用注意力机制的卷积神经网络的过滤器已显示出对传统技术的改进。但是,这些解决方案通常在计算上更加昂贵,从而限制了它们用于实际应用的潜力。所提出的方法将稀疏性和结构化修剪的新型组合用于降低学习环内过滤器的复杂性。这是通过三步训练过程进行的,该训练的体重级修剪,微不足道的神经元识别和去除以及微调。通过初始测试,我们发现网络参数可以大大降低,对网络性能的影响最小。

In video coding, in-loop filters are applied on reconstructed video frames to enhance their perceptual quality, before storing the frames for output. Conventional in-loop filters are obtained by hand-crafted methods. Recently, learned filters based on convolutional neural networks that utilize attention mechanisms have been shown to improve upon traditional techniques. However, these solutions are typically significantly more computationally expensive, limiting their potential for practical applications. The proposed method uses a novel combination of sparsity and structured pruning for complexity reduction of learned in-loop filters. This is done through a three-step training process of magnitude-guidedweight pruning, insignificant neuron identification and removal, and fine-tuning. Through initial tests we find that network parameters can be significantly reduced with a minimal impact on network performance.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源