论文标题

SILVR:合成的沉浸式大批量数据集

SILVR: A Synthetic Immersive Large-Volume Plenoptic Dataset

论文作者

Courteaux, Martijn, Artois, Julie, De Pauw, Stijn, Lambert, Peter, Van Wallendael, Glenn

论文摘要

在六度的自由型光场(LF)体验中,观众的自由受到采样元素功能的程度的限制。现有的LF数据集仅代表元素功能的一小部分,因此它们要么覆盖少量,要么具有有限的视野。因此,我们提出了一个新的LF图像数据集“ SILVR”,该数据集允许在更大卷中进行六度自由式导航,同时保持完整的全景视野。我们在各种配置中渲染了三个不同的虚拟场景,其中的视图范围从642到2226。其中之一(称为Zen Garden)是一个新颖的场景,并可以公开使用。我们选择将虚拟摄像机紧密地放在大型立方体和球形组织中(220万美元^3美元至4800万美元^3 $),配备了180°鱼眼镜头。每个视图都呈现到2048px $ \ times $ 2048px的颜色图像和深度图。此外,我们介绍用于自动化多视图渲染过程的软件,以及一个镜头反射工具,该工具将带有全景或鱼眼投影的图像之间转换为标准直发性(即透视图)投影。最后,我们演示了建议的数据集和软件如何用于评估LF编码/渲染技术(在这种情况下,用于使用Instant-NGP培训NERF)。因此,我们为大量光线提供了第一个公共可用的LF数据集,并提供全景图。

In six-degrees-of-freedom light-field (LF) experiences, the viewer's freedom is limited by the extent to which the plenoptic function was sampled. Existing LF datasets represent only small portions of the plenoptic function, such that they either cover a small volume, or they have limited field of view. Therefore, we propose a new LF image dataset "SILVR" that allows for six-degrees-of-freedom navigation in much larger volumes while maintaining full panoramic field of view. We rendered three different virtual scenes in various configurations, where the number of views ranges from 642 to 2226. One of these scenes (called Zen Garden) is a novel scene, and is made publicly available. We chose to position the virtual cameras closely together in large cuboid and spherical organisations ($2.2m^3$ to $48m^3$), equipped with 180° fish-eye lenses. Every view is rendered to a color image and depth map of 2048px $\times$ 2048px. Additionally, we present the software used to automate the multi-view rendering process, as well as a lens-reprojection tool that converts between images with panoramic or fish-eye projection to a standard rectilinear (i.e., perspective) projection. Finally, we demonstrate how the proposed dataset and software can be used to evaluate LF coding/rendering techniques(in this case for training NeRFs with instant-ngp). As such, we provide the first publicly-available LF dataset for large volumes of light with full panoramic field of view

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源