论文标题

MPIB:基于MPI的散景渲染框架,用于现实的部分遮挡效果

MPIB: An MPI-Based Bokeh Rendering Framework for Realistic Partial Occlusion Effects

论文作者

Peng, Juewen, Zhang, Jianming, Luo, Xianrui, Lu, Hao, Xian, Ke, Cao, Zhiguo

论文摘要

部分遮挡效应是一种现象,即相机附近的模糊物体是半透明的,导致部分外观被遮挡的背景。但是,由于现有的散景渲染方法,由于在全焦点图像中遮挡区域缺少信息,因此模拟现实的部分遮挡效果是一项挑战。受到可学习的3D场景表示的启发,我们尝试通过引入一种基于新颖的MPI高分辨率的Bokeh渲染框架来解决部分遮挡,称为MPIB。为此,我们首先介绍了如何将MPI表示形式应用于散布渲染的分析。基于此分析,我们提出了一个MPI表示模块与背景介入模块相结合,以实现高分辨率场景表示。然后,可以将此表示形式重新使用以根据控制参数呈现各种散景效应。为了训练和测试我们的模型,我们还为数据生成设计了一个基于射线追踪的散景生成器。对合成和现实世界图像的广泛实验验证了该框架的有效性和灵活性。

Partial occlusion effects are a phenomenon that blurry objects near a camera are semi-transparent, resulting in partial appearance of occluded background. However, it is challenging for existing bokeh rendering methods to simulate realistic partial occlusion effects due to the missing information of the occluded area in an all-in-focus image. Inspired by the learnable 3D scene representation, Multiplane Image (MPI), we attempt to address the partial occlusion by introducing a novel MPI-based high-resolution bokeh rendering framework, termed MPIB. To this end, we first present an analysis on how to apply the MPI representation to bokeh rendering. Based on this analysis, we propose an MPI representation module combined with a background inpainting module to implement high-resolution scene representation. This representation can then be reused to render various bokeh effects according to the controlling parameters. To train and test our model, we also design a ray-tracing-based bokeh generator for data generation. Extensive experiments on synthesized and real-world images validate the effectiveness and flexibility of this framework.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源