论文标题

Illuminet:在增强现实中将照明从平面表面转移到虚拟物体

IllumiNet: Transferring Illumination from Planar Surfaces to Virtual Objects in Augmented Reality

论文作者

Xu, Di, Li, Zhen, Zhang, Yanning, Cao, Qi

论文摘要

本文通过学习为实际环境中的虚拟对象提供了一种照明估计方法。尽管以前的作品通过重建高动态范围(HDR)环境图或相应的球形谐波来解决此问题,但我们并不寻求恢复整个场景的照明环境。鉴于单个RGB图像,我们的方法通过将从场景中平面表面提取的照明特征转移到所需的几何形状来直接侵入重新的虚拟对象。与以前的作品相比,我们的方法在室内和室外环境中都具有空间变化的照明。实验和评估结果表明,我们的方法在定量和定性上优于最先进的方法,从而实现了现实的增强体验。

This paper presents an illumination estimation method for virtual objects in real environment by learning. While previous works tackled this problem by reconstructing high dynamic range (HDR) environment maps or the corresponding spherical harmonics, we do not seek to recover the lighting environment of the entire scene. Given a single RGB image, our method directly infers the relit virtual object by transferring the illumination features extracted from planar surfaces in the scene to the desired geometries. Compared to previous works, our approach is more robust as it works in both indoor and outdoor environments with spatially-varying illumination. Experiments and evaluation results show that our approach outperforms the state-of-the-art quantitatively and qualitatively, achieving realistic augmented experience.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源