摘要 Abstract
我们提出了一种潜在的三维表示方法,通过在三维空间中将三维表面建模为概率密度函数(即p(x,y,z)),并采用流匹配技术实现。该表示特别设计用于机器学习模型的输入,其构造方式保证了连续性和紧凑性,同时仅需点云数据且需要最少的数据预处理。尽管这是一种数据驱动的方法,但我们利用三维空间中的流匹配技术,赋予了该表示有趣的几何特性,包括零样本估计表面法线和形变场的能力。我们在多个机器学习任务中进行了评估,包括3D-CLIP、无条件生成模型、单图像条件生成模型以及交点估计。在所有实验中,我们的模型相对于现有基线表现出具有竞争力的性能,同时所需的预处理和训练数据的辅助信息更少。
We introduce a latent 3D representation that models 3D surfaces as probability density functions in 3D, i.e., p(x,y,z), with flow-matching. Our representation is specifically designed for consumption by machine learning models, offering continuity and compactness by construction while requiring only point clouds and minimal data preprocessing. Despite being a data-driven method, our use of flow matching in the 3D space enables interesting geometry properties, including the capabilities to perform zero-shot estimation of surface normal and deformation field. We evaluate with several machine learning tasks, including 3D-CLIP, unconditional generative models, single-image conditioned generative model, and intersection-point estimation. Across all experiments, our models achieve competitive performance to existing baselines, while requiring less preprocessing and auxiliary information from training data.