论文标题

无知的价格:在低级矩阵估计中忘记噪声结构的成本是多少?

The price of ignorance: how much does it cost to forget noise structure in low-rank matrix estimation?

论文作者

Barbier, Jean, Hou, TianQi, Mondelli, Marco, Sáenz, Manuel

论文摘要

我们考虑了估计由结构化旋转不变噪声损坏的等级1信号的问题,并解决了以下问题:当噪声统计数据未知并且假定高斯噪声时,推理算法的性能如何?虽然对具有非结构化噪声的匹配的贝叶斯最佳设置有充分的理解,但对这个不匹配的问题的分析仅在其前提下。在本文中,我们朝着理解不匹配的强度来源(即噪声统计数据)的效果迈出了一步。我们的主要技术贡献是对贝叶斯估计器的严格分析和近似消息传递(AMP)算法的严格分析,这两者都错误地假设了高斯设置。第一个结果利用了球形积分和低级矩阵扰动的理论。第二个背后的想法是设计和分析人工放大器,该放大器通过利用Denoisers的灵活性,能够“纠正”不匹配。通过这些尖锐的渐近特征,我们揭露了一种丰富且经常出乎意料的现象学。例如,尽管AMP原则上是设计用于有效计算贝叶斯估计量的,但前者在均方误差方面的表现均优于后者。我们表明,这种性能差距是由于对信号规范的估计不正确。实际上,当SNR足够大时,AMP和贝叶斯估计器的重叠重合,甚至可以考虑到噪声结构的最佳估计器。

We consider the problem of estimating a rank-1 signal corrupted by structured rotationally invariant noise, and address the following question: how well do inference algorithms perform when the noise statistics is unknown and hence Gaussian noise is assumed? While the matched Bayes-optimal setting with unstructured noise is well understood, the analysis of this mismatched problem is only at its premises. In this paper, we make a step towards understanding the effect of the strong source of mismatch which is the noise statistics. Our main technical contribution is the rigorous analysis of a Bayes estimator and of an approximate message passing (AMP) algorithm, both of which incorrectly assume a Gaussian setup. The first result exploits the theory of spherical integrals and of low-rank matrix perturbations; the idea behind the second one is to design and analyze an artificial AMP which, by taking advantage of the flexibility in the denoisers, is able to "correct" the mismatch. Armed with these sharp asymptotic characterizations, we unveil a rich and often unexpected phenomenology. For example, despite AMP is in principle designed to efficiently compute the Bayes estimator, the former is outperformed by the latter in terms of mean-square error. We show that this performance gap is due to an incorrect estimation of the signal norm. In fact, when the SNR is large enough, the overlaps of the AMP and the Bayes estimator coincide, and they even match those of optimal estimators taking into account the structure of the noise.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源