论文标题
TCDM:基于转换复杂性的失真度量,用于感知点云质量评估
TCDM: Transformational Complexity Based Distortion Metric for Perceptual Point Cloud Quality Assessment
论文作者
论文摘要
客观点云质量评估(PCQA)研究的目的是开发定量指标,以感知一致的方式测量点云质量。在本文中,合并了人类视觉系统(HVS)的认知科学和直觉的研究,我们通过测量将扭曲的点云转换回其参考的复杂性来评估点云质量,实际上,当给出另一个云时的代码长度可以近似。为此,我们首先基于3D Voronoi图进行参考和扭曲点云的空间分割,以获得一系列局部补丁对。接下来,受到预测编码理论的启发,我们利用了一个空间感知的矢量自回归(SA-VAR)模型来编码每个参考贴片的几何图形和带有和没有扭曲贴片的颜色通道。假设残余误差遵循多变量高斯分布,则使用协方差矩阵计算参考和参考样品和变形样品之间的参考和变换复杂性的自复杂性。此外,将SA-VAR产生的预测术语作为辅助功能引入,以促进最终质量预测。通过对五个公共点云质量评估数据库进行的广泛实验,评估了提出的基于转化型复杂度度量(TCDM)的有效性。结果表明,TCDM实现了最新的(SOTA)性能,进一步的分析证实了其在各种情况下的稳健性。该代码可在https://github.com/zyj1318053/tcdm上公开获取。
The goal of objective point cloud quality assessment (PCQA) research is to develop quantitative metrics that measure point cloud quality in a perceptually consistent manner. Merging the research of cognitive science and intuition of the human visual system (HVS), in this paper, we evaluate the point cloud quality by measuring the complexity of transforming the distorted point cloud back to its reference, which in practice can be approximated by the code length of one point cloud when the other is given. For this purpose, we first make space segmentation for the reference and distorted point clouds based on a 3D Voronoi diagram to obtain a series of local patch pairs. Next, inspired by the predictive coding theory, we utilize a space-aware vector autoregressive (SA-VAR) model to encode the geometry and color channels of each reference patch with and without the distorted patch, respectively. Assuming that the residual errors follow the multi-variate Gaussian distributions, the self-complexity of the reference and transformational complexity between the reference and distorted samples are computed using covariance matrices. Additionally, the prediction terms generated by SA-VAR are introduced as one auxiliary feature to promote the final quality prediction. The effectiveness of the proposed transformational complexity based distortion metric (TCDM) is evaluated through extensive experiments conducted on five public point cloud quality assessment databases. The results demonstrate that TCDM achieves state-of-the-art (SOTA) performance, and further analysis confirms its robustness in various scenarios. The code is publicly available at https://github.com/zyj1318053/TCDM.