论文标题

潜在分区与3D表示的表面代码隐含

Latent Partition Implicit with Surface Codes for 3D Representation

论文作者

Chen, Chao, Liu, Yu-Shen, Han, Zhizhong

论文摘要

深层隐式功能在各种3D计算机视觉任务中显示出显着的形状建模能力。一个缺点是,他们很难将3D形状表示为多个部分。当前的解决方案学习了各种原语,并直接在空间空间中融合了原始素,这些原始物仍然难以准确地近似3D形状。为了解决这个问题,我们引入了一种新颖的隐式表示形式,以将单个3D形状表示为潜在空间中的一组零件,朝着高度准确和可解释的形状建模。我们在这里的洞察力是,在潜在空间中,零件学习和零件混合都比在空间空间中容易得多。我们将方法命名为潜在分区隐式(LPI),因为它可以将全局形状建模施放到多个局部零件建模中,从而将全局形状统一分开。 LPI使用表面代码表示形状作为签名距离函数(SDF)。每个表面代码是一个潜在代码,代表中心位于表面的部分,这使我们能够灵活采用形状的内在属性或其他表面属性。最终,LPI可以重建形状上的形状和部分,它们都是合理的网格。 LPI是一种多级表示,可以在训练后将形状划分为不同数量的零件。可以在没有地面真相签名的距离,点正常或任何部分分区的任何监督的情况下学习LPI。从重建精度和建模可解释性方面,LPI的表现优于广泛使用的基准下的最新方法。我们的代码,数据和模型可在https://github.com/chenchao15/lpi上找到。

Deep implicit functions have shown remarkable shape modeling ability in various 3D computer vision tasks. One drawback is that it is hard for them to represent a 3D shape as multiple parts. Current solutions learn various primitives and blend the primitives directly in the spatial space, which still struggle to approximate the 3D shape accurately. To resolve this problem, we introduce a novel implicit representation to represent a single 3D shape as a set of parts in the latent space, towards both highly accurate and plausibly interpretable shape modeling. Our insight here is that both the part learning and the part blending can be conducted much easier in the latent space than in the spatial space. We name our method Latent Partition Implicit (LPI), because of its ability of casting the global shape modeling into multiple local part modeling, which partitions the global shape unity. LPI represents a shape as Signed Distance Functions (SDFs) using surface codes. Each surface code is a latent code representing a part whose center is on the surface, which enables us to flexibly employ intrinsic attributes of shapes or additional surface properties. Eventually, LPI can reconstruct both the shape and the parts on the shape, both of which are plausible meshes. LPI is a multi-level representation, which can partition a shape into different numbers of parts after training. LPI can be learned without ground truth signed distances, point normals or any supervision for part partition. LPI outperforms the latest methods under the widely used benchmarks in terms of reconstruction accuracy and modeling interpretability. Our code, data and models are available at https://github.com/chenchao15/LPI.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源