论文标题

同时推断和插值网络,以进行连续模型生成

Concurrently Extrapolating and Interpolating Networks for Continuous Model Generation

论文作者

Zhao, Lijun, Zhang, Jinjing, Zhang, Fan, Wang, Anhong, Bai, Huihui, Zhao, Yao

论文摘要

当使用不同参数配置的每种算法作为标签图像时,大多数深层图像平滑运算符总是经过重复训练。这种培训策略通常需要很长时间,并以昂贵的方式花费设备资源。为了解决这个具有挑战性的问题,我们将连续网络插值概括为更强大的模型生成工具,然后提出一种简单而有效的模型生成策略,以形成仅需要一组特定效果标签图像的模型序列。要精确地学习图像平滑操作员,我们提出了一个双状态聚合(DSA)模块,可以轻松地将其插入当前的大多数网络体系结构中。基于此模块,我们设计了具有局部特征聚合块和非局部特征聚合块的双状态聚集神经网络结构,以获得具有较大表达能力的运算符。通过评估许多客观和视觉实验结果,我们表明所提出的方法能够产生一系列连续模型并实现比几种用于图像平滑的最先进方法更好的性能。

Most deep image smoothing operators are always trained repetitively when different explicit structure-texture pairs are employed as label images for each algorithm configured with different parameters. This kind of training strategy often takes a long time and spends equipment resources in a costly manner. To address this challenging issue, we generalize continuous network interpolation as a more powerful model generation tool, and then propose a simple yet effective model generation strategy to form a sequence of models that only requires a set of specific-effect label images. To precisely learn image smoothing operators, we present a double-state aggregation (DSA) module, which can be easily inserted into most of current network architecture. Based on this module, we design a double-state aggregation neural network structure with a local feature aggregation block and a nonlocal feature aggregation block to obtain operators with large expression capacity. Through the evaluation of many objective and visual experimental results, we show that the proposed method is capable of producing a series of continuous models and achieves better performance than that of several state-of-the-art methods for image smoothing.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源