Learning Representations and Generative Models for 3D Point Clouds

转 计算机小白学习中查看完整翻译.
点击下载英文论文

Abstract

Three-dimensional geometric data offer an excellent domain for studying representation learning and generative modeling. In this paper, we look at geometric data represented as point clouds. We introduce a deep AutoEncoder (AE) network with state-of-the-art reconstruction quality and generalization ability. The learned representations outperform existing methods on 3D recognition tasks and enable shape editing via simple alge- braic manipulations, such as semantic part editing, shape analogies and shape interpolation, as well as shape completion. We perform a thorough study of different generative models including GANs operating on the raw point clouds, significantly improved GANs trained in the fixed latent space of our AEs, and Gaussian Mixture Models (GMMs). To quantitatively evaluate generative models we introduce measures of sample fidelity and diversity based on matchings between sets of point clouds. Interestingly, our evaluation of generalization, fidelity and diversity reveals that GMMs trained in the latent space of our AEs yield the best results overall.

摘要

三维几何数据为研究表示学习和生成建模提供了一个很好的领域。在本文中，我们研究用点云表示的几何数据。介绍了一种具有最先进的重构质量和泛化能力的deep AutoEncoder (AE) 网络。学习表示在三维识别任务上优于现有方法，通过简单的代数操作实现了形状编辑，如语义部分编辑、形状类比和形状插值以及形状补全。我们对不同的生成模型进行了深入的研究，包括在原始点云上运行的GANs、在我们AEs的固定潜空间中训练的具有显著提升的GANs以及高斯混合模型(GMMs)。为了定量地评估生成模型，我们引入了基于点云组间匹配的样本保真度和多样性度量。有趣的是，我们对泛化、保真度和多样性的评估表明，在我们的AEs的潜在空间中训练过的GMMs总体效果最好。