模拟器HC:基于回归的在线模拟几何视觉同伦连续性问题-解对

Simulator HC: Regression-based Online Simulation of Starting Problem-Solution Pairs for Homotopy Continuation in Geometric Vision

摘要 Abstract

虽然自动产生的多项式消元模板在三维计算机视觉领域引发了巨大进步,但仍有许多问题由于约束的次数或未知数的数量导致难以处理。近年来,同伦连续性被引入作为一种可行的替代方法。然而,该方法目前依赖于昂贵的复杂数域内所有可能解的并行追踪,或者是在有限的真实世界示例集上训练的问题-解对分类网络。我们的创新之处在于一种新颖的方法,即仅需预测一个粗略的初始解,而相应的问题由在线模拟器生成。随后,应用同伦连续性跟踪该单一解回到原始问题。我们将这种方法应用于广义相机重标定,并且还提出了一个解决具有挑战性的广义相对姿态和尺度问题的新方案。如演示所示,所提出的方法成功补偿了单独使用回归器产生的原始误差,并实现了最先进的效率和成功率。

While automatically generated polynomial elimination templates have sparked great progress in the field of 3D computer vision, there remain many problems for which the degree of the constraints or the number of unknowns leads to intractability. In recent years, homotopy continuation has been introduced as a plausible alternative. However, the method currently depends on expensive parallel tracking of all possible solutions in the complex domain, or a classification network for starting problem-solution pairs trained over a limited set of real-world examples. Our innovation lies in a novel approach to finding solution-problem pairs, where we only need to predict a rough initial solution, with the corresponding problem generated by an online simulator. Subsequently, homotopy continuation is applied to track that single solution back to the original problem. We apply this elegant combination to generalized camera resectioning, and also introduce a new solution to the challenging generalized relative pose and scale problem. As demonstrated, the proposed method successfully compensates the raw error committed by the regressor alone, and leads to state-of-the-art efficiency and success rates.