论文标题
手持相机的图像缝合和纠正
Image Stitching and Rectification for Hand-Held Cameras
论文作者
论文摘要
在本文中,我们得出了一个新的差分均匀同构象,可以说明扫描线相机在滚动快门(RS)摄像机中的姿势,并演示其应用于一次冲程进行RS感知图像缝合和整流的应用。尽管RS几何形状的复杂性很高,但我们将重点放在一个特殊但共同的输入上 - 视频流的两个连续帧,其中框架间的运动受到任意大型的限制。这使我们能够采用更简单的差分运动模型,从而导致直接且实用的最小求解器。为了处理缝线中的非平面场景和相机视差,我们进一步提出了一个可以在空间变化的同构图领域,该字段是可以实现的原则(APAP)。我们在RS图像缝合和整流过程中表现出优于最先进方法的性能,尤其是用于手持式摇动相机捕获的图像。
In this paper, we derive a new differential homography that can account for the scanline-varying camera poses in Rolling Shutter (RS) cameras, and demonstrate its application to carry out RS-aware image stitching and rectification at one stroke. Despite the high complexity of RS geometry, we focus in this paper on a special yet common input -- two consecutive frames from a video stream, wherein the inter-frame motion is restricted from being arbitrarily large. This allows us to adopt simpler differential motion model, leading to a straightforward and practical minimal solver. To deal with non-planar scene and camera parallax in stitching, we further propose an RS-aware spatially-varying homography field in the principle of As-Projective-As-Possible (APAP). We show superior performance over state-of-the-art methods both in RS image stitching and rectification, especially for images captured by hand-held shaking cameras.