论文标题

相机校准的多任务学习

Multi-task Learning for Camera Calibration

论文作者

Butt, Talha Hanif, Taj, Murtaza

论文摘要

对于许多任务,例如3D重建,机器人接口,自动驾驶等,相机校准至关重要。在这项研究中,我们提出了一种独特的方法,可预测一对图像的固有(主要点偏移和焦距)和外部(基线,音高和翻译)特性。我们提出了一种新颖的方法,在多任务学习框架中,相机模型方程表示为神经网络,与现有方法相比,这构建了全面的解决方案。通过使用摄像机模型神经网络重建3D点,然后使用重建中的丢失来获得相机规范,则这种创新的相机投影损失(CPL)方法使我们应估算所需的参数。据我们所知,我们的方法是第一个使用方法进行多任务学习的方法,该方法包括数学公式在学习框架中以估算摄像机参数以共同预测外在和内在参数的框架。此外,我们提供了一个名为CVGL摄像机校准数据集[1]的新数据集,该数据集已使用CARLA模拟器[2]收集。实际上,我们表明,我们建议的策略同时在使用真实数据和合成数据评估的10个参数中的6个参数中同时执行常规方法和方法。我们的代码和生成的数据集可从https://github.com/thanif/camera-calibration-though-camera-camera-prodoction-loss获得。

For a number of tasks, such as 3D reconstruction, robotic interface, autonomous driving, etc., camera calibration is essential. In this study, we present a unique method for predicting intrinsic (principal point offset and focal length) and extrinsic (baseline, pitch, and translation) properties from a pair of images. We suggested a novel method where camera model equations are represented as a neural network in a multi-task learning framework, in contrast to existing methods, which build a comprehensive solution. By reconstructing the 3D points using a camera model neural network and then using the loss in reconstruction to obtain the camera specifications, this innovative camera projection loss (CPL) method allows us that the desired parameters should be estimated. As far as we are aware, our approach is the first one that uses an approach to multi-task learning that includes mathematical formulas in a framework for learning to estimate camera parameters to predict both the extrinsic and intrinsic parameters jointly. Additionally, we provided a new dataset named as CVGL Camera Calibration Dataset [1] which has been collected using the CARLA Simulator [2]. Actually, we show that our suggested strategy out performs both conventional methods and methods based on deep learning on 6 out of 10 parameters that were assessed using both real and synthetic data. Our code and generated dataset are available at https://github.com/thanif/Camera-Calibration-through-Camera-Projection-Loss.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源