论文标题

高分辨率事件摄像机真的需要吗?

Are High-Resolution Event Cameras Really Needed?

论文作者

Gehrig, Daniel, Scaramuzza, Davide

论文摘要

由于它们在具有挑战性的条件下的出色特性,事件摄像机在广泛的应用中变得必不可少,范围从汽车,计算摄影和大满贯。但是,随着对传感器设计的进一步改进,现代事件摄像机趋向于更高和更高的传感器分辨率,这会导致下游任务的更高带宽和计算要求。尽管有这种趋势,但使用高分辨率事件摄像头解决标准计算机视觉任务的好处仍不清楚。在这项工作中,我们报告了一个令人惊讶的发现,即在低弹片条件下,在高速摄像机下,低分辨率摄像头可以胜过高分辨率的相机,同时需要较低的带宽。我们为该主张提供经验和理论证据,这表明高分辨率事件摄像机显示出较高的每像素事件发生率,从而在低弹片条件下和高速时会导致较高的时间噪声。结果,在大多数情况下,与在这些条件下的分辨率较低的传感器相比,高分辨率事件摄像机显示出较低的任务性能。我们从综合数据和真实数据上进行了经验验证跨多个任务的发现,即图像重建,光流估计和摄像头姿势跟踪。我们认为,这些发现将为事件摄像机开发的未来趋势提供重要的指南。

Due to their outstanding properties in challenging conditions, event cameras have become indispensable in a wide range of applications, ranging from automotive, computational photography, and SLAM. However, as further improvements are made to the sensor design, modern event cameras are trending toward higher and higher sensor resolutions, which result in higher bandwidth and computational requirements on downstream tasks. Despite this trend, the benefits of using high-resolution event cameras to solve standard computer vision tasks are still not clear. In this work, we report the surprising discovery that, in low-illumination conditions and at high speeds, low-resolution cameras can outperform high-resolution ones, while requiring a significantly lower bandwidth. We provide both empirical and theoretical evidence for this claim, which indicates that high-resolution event cameras exhibit higher per-pixel event rates, leading to higher temporal noise in low-illumination conditions and at high speeds. As a result, in most cases, high-resolution event cameras show a lower task performance, compared to lower resolution sensors in these conditions. We empirically validate our findings across several tasks, namely image reconstruction, optical flow estimation, and camera pose tracking, both on synthetic and real data. We believe that these findings will provide important guidelines for future trends in event camera development.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源