论文标题
Photoscene：室内场景的感性材料和照明转移
PhotoScene: Photorealistic Material and Lighting Transfer for Indoor Scenes
论文作者
论文摘要
大多数室内3D场景重建方法都致力于恢复3D几何和场景布局。在这项工作中，我们超越了这一点，提出了Photoscene，该框架是一个场景的输入图像以及大约对齐的CAD几何形状（自动或手动指定的重建），并构建具有高质量材料和类似照明的光真逼真的数字双胞胎。我们使用程序材料图对场景材料进行建模；这样的图代表了逼真的和分辨率无关的材料。我们优化了这些图的参数及其纹理量表和旋转，以及场景照明，以通过可区分的渲染层最好地匹配输入图像。我们评估了从扫描仪，Sun RGB-D和库存照片的对象和布局重建的技术，并证明我们的方法重建高质量的，完全可重新可重新可重新的3D场景，这些场景可以在任意观点，Zooms，Zooms和Lighting下重新构成。
Most indoor 3D scene reconstruction methods focus on recovering 3D geometry and scene layout. In this work, we go beyond this to propose PhotoScene, a framework that takes input image(s) of a scene along with approximately aligned CAD geometry (either reconstructed automatically or manually specified) and builds a photorealistic digital twin with high-quality materials and similar lighting. We model scene materials using procedural material graphs; such graphs represent photorealistic and resolution-independent materials. We optimize the parameters of these graphs and their texture scale and rotation, as well as the scene lighting to best match the input image via a differentiable rendering layer. We evaluate our technique on objects and layout reconstructions from ScanNet, SUN RGB-D and stock photographs, and demonstrate that our method reconstructs high-quality, fully relightable 3D scenes that can be re-rendered under arbitrary viewpoints, zooms and lighting.
