论文标题
$ \ mathbb {x} $分辨率通信网络
$\mathbb{X}$Resolution Correspondence Networks
论文作者
论文摘要
在本文中,我们旨在在具有挑战性的照明变化,观点变化和样式差异下建立具有重叠视野的一对图像之间的准确密集对应关系。通过对最先进的对应网络进行的广泛消融研究,我们出人意料地发现,广泛采用的4D相关张量及其相关的学习和处理模块可以被取消参数和从培训中删除,仅在最终匹配准确性上仅带来较小的影响。禁用这些计算昂贵的模块会大大加快训练过程,并允许使用更大的批次尺寸,从而弥补了准确性下降。与多GPU推断阶段一起,我们的方法促进了对匹配准确性与1280至4K的天然测试图像的匹配精度和上采样分辨率之间的关系的系统研究。这导致发现了最佳分辨率$ \ Mathbb {X} $的存在,该$ \ Mathbb {X} $可产生准确的匹配性能,超过了最新的方法,尤其是在拟议网络的公共基准标准上的较低错误频段上。
In this paper, we aim at establishing accurate dense correspondences between a pair of images with overlapping field of view under challenging illumination variation, viewpoint changes, and style differences. Through an extensive ablation study of the state-of-the-art correspondence networks, we surprisingly discovered that the widely adopted 4D correlation tensor and its related learning and processing modules could be de-parameterised and removed from training with merely a minor impact over the final matching accuracy. Disabling these computational expensive modules dramatically speeds up the training procedure and allows to use 4 times bigger batch size, which in turn compensates for the accuracy drop. Together with a multi-GPU inference stage, our method facilitates the systematic investigation of the relationship between matching accuracy and up-sampling resolution of the native testing images from 1280 to 4K. This leads to discovery of the existence of an optimal resolution $\mathbb{X}$ that produces accurate matching performance surpassing the state-of-the-art methods particularly over the lower error band on public benchmarks for the proposed network.