论文标题
激光雷达引导的立体声匹配与空间一致性约束
LiDAR-guided Stereo Matching with a Spatial Consistency Constraint
论文作者
论文摘要
光检测和范围(LIDAR)数据和图像数据的互补融合是产生高精度和高密度点云的有前途但挑战性的任务。这项研究提出了一种创新的激光雷达引导的立体匹配方法,称为LiDAR引导的立体声匹配(LGSM),该方法考虑了图像均匀区域中连续差异或深度变化表示的空间一致性。 LGSM首先根据其颜色或强度相似性检测每个激光雷达投影点的均匀像素。接下来,我们提出一个河床增强功能,以优化激光雷达投影点及其均匀像素的成本体积,以提高匹配的鲁棒性。我们的公式通过图像信息的指导扩大了稀疏激光雷达投影点的约束范围,以尽可能优化像素的成本量。我们将LGSM应用于模拟和真实数据集上的半全球匹配和AD-CENSUS。当模拟数据集中的LiDAR点的百分比为0.16%时,我们方法的匹配精度达到了子像素级别,而原始立体声匹配算法的匹配度为3.4像素。实验结果表明,LGSM适用于室内,街道,空中和卫星图像数据集,并在半全球匹配和AD-CENSUS上提供了良好的可传递性。此外,定性和定量评估表明,LGSM优于两种最先进的优化成本量方法,尤其是在减少困难匹配区域的错配和完善物体边界的不匹配时。
The complementary fusion of light detection and ranging (LiDAR) data and image data is a promising but challenging task for generating high-precision and high-density point clouds. This study proposes an innovative LiDAR-guided stereo matching approach called LiDAR-guided stereo matching (LGSM), which considers the spatial consistency represented by continuous disparity or depth changes in the homogeneous region of an image. The LGSM first detects the homogeneous pixels of each LiDAR projection point based on their color or intensity similarity. Next, we propose a riverbed enhancement function to optimize the cost volume of the LiDAR projection points and their homogeneous pixels to improve the matching robustness. Our formulation expands the constraint scopes of sparse LiDAR projection points with the guidance of image information to optimize the cost volume of pixels as much as possible. We applied LGSM to semi-global matching and AD-Census on both simulated and real datasets. When the percentage of LiDAR points in the simulated datasets was 0.16%, the matching accuracy of our method achieved a subpixel level, while that of the original stereo matching algorithm was 3.4 pixels. The experimental results show that LGSM is suitable for indoor, street, aerial, and satellite image datasets and provides good transferability across semi-global matching and AD-Census. Furthermore, the qualitative and quantitative evaluations demonstrate that LGSM is superior to two state-of-the-art optimizing cost volume methods, especially in reducing mismatches in difficult matching areas and refining the boundaries of objects.