论文标题

AugShuffLenet:沟通更多,计算更少

AugShuffleNet: Communicate More, Compute Less

论文作者

Ye, Longqing

论文摘要

作为一个非凡的紧凑型模型,ShuffleNetV2提供了一个很好的示例来设计有效的弯头,但很少注意到它的极限。在本文中,我们重新考虑了ShufflenetV2的设计模式,并发现通过渠道的冗余问题仍然限制了更宽的ShufflenETV2中的Shuffle Block的效率提高。为了解决这个问题,我们提出了另一个增强的变种块变体,以类似瓶颈的结构和更隐含的短相连接的形式。为了验证该构件的有效性,我们进一步建立了一个更强大,更有效的模型家族,称为Augshufflenets。在CIFAR-10和CIFAR-100数据集上进行了评估,AugshuffLenet始终以较少的计算成本和更少的参数计数来超过ShuffleNetv2的表现。

As a remarkable compact model, ShuffleNetV2 offers a good example to design efficient ConvNets but its limit is rarely noticed. In this paper, we rethink the design pattern of ShuffleNetV2 and find that the channel-wise redundancy problem still constrains the efficiency improvement of Shuffle block in the wider ShuffleNetV2. To resolve this issue, we propose another augmented variant of shuffle block in the form of bottleneck-like structure and more implicit short connections. To verify the effectiveness of this building block, we further build a more powerful and efficient model family, termed as AugShuffleNets. Evaluated on the CIFAR-10 and CIFAR-100 datasets, AugShuffleNet consistently outperforms ShuffleNetV2 in terms of accuracy with less computational cost and fewer parameter count.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源