论文标题
暴露轨迹从运动模糊中恢复
Exposure Trajectory Recovery from Motion Blur
论文作者
论文摘要
动态场景中的运动模糊是一个重要但具有挑战性的研究主题。最近,深度学习方法为动态场景造成了令人印象深刻的表现。但是,模糊图像中包含的运动信息尚未得到充分的探索和准确表达,因为:(i)难以获得动态运动的基础真理; (ii)在暴露期间,时间顺序被破坏; (iii)模糊图像的运动估计值高度不足。通过重新审视相机暴露的原理,可以通过相对于每个裸露位置的尖锐内容的相对运动来描述运动模糊。在本文中,我们定义了暴露轨迹,该轨迹代表模糊图像中包含的运动信息并解释运动模糊的原因。提出了一个新型的运动偏移估计框架,以在多个时间点上对潜在尖锐图像的像素位移进行建模。在轻度约束下,我们的方法可以恢复致密的(非)线性暴露轨迹,从而显着减少颞障碍和不良问题。最后,实验表明,回收的曝光轨迹不仅从模糊图像中捕获准确且可解释的运动信息,而且还使运动吸引的图像脱毛和基于扭曲的视频提取任务受益。代码可在https://github.com/yjzhang96/motion-etr上找到。
Motion blur in dynamic scenes is an important yet challenging research topic. Recently, deep learning methods have achieved impressive performance for dynamic scene deblurring. However, the motion information contained in a blurry image has yet to be fully explored and accurately formulated because: (i) the ground truth of dynamic motion is difficult to obtain; (ii) the temporal ordering is destroyed during the exposure; and (iii) the motion estimation from a blurry image is highly ill-posed. By revisiting the principle of camera exposure, motion blur can be described by the relative motions of sharp content with respect to each exposed position. In this paper, we define exposure trajectories, which represent the motion information contained in a blurry image and explain the causes of motion blur. A novel motion offset estimation framework is proposed to model pixel-wise displacements of the latent sharp image at multiple timepoints. Under mild constraints, our method can recover dense, (non-)linear exposure trajectories, which significantly reduce temporal disorder and ill-posed problems. Finally, experiments demonstrate that the recovered exposure trajectories not only capture accurate and interpretable motion information from a blurry image, but also benefit motion-aware image deblurring and warping-based video extraction tasks. Codes are available on https://github.com/yjzhang96/Motion-ETR.