基于NeRF的农业应用点云重建方法:利用固定相机
NeRF-based Point Cloud Reconstruction using a Stationary Camera for Agricultural Applications
摘要 Abstract
本文提出了一种基于NeRF的点云(PCD)重建框架,专门设计用于室内高通量植物表型设施。传统的基于NeRF的重建方法需要相机围绕静止物体移动,但在高通量环境中,这种方法不切实际,因为物体通常在传送带或旋转底座上快速移动进行成像。为了解决这一限制,我们开发了一种基于NeRF的PCD重建变体,该方法使用单个固定相机捕捉物体在底座上旋转时的图像。我们的工作流程包括COLMAP基础的姿态估计、简单的姿态变换以模拟相机运动,然后进行标准的NeRF训练。定义的感兴趣区域(ROI)排除了无关的场景数据,从而生成高分辨率点云(10M点)。实验结果表明,重建保真度极佳,在所有评估的植物对象上的精确度-召回率分析得出的F分数接近100.00。尽管固定相机设置下的姿态估计仍然计算密集,但整体训练和重建时间具有竞争力,验证了该方法在实际高通量室内表型应用中的可行性。我们的研究结果表明,使用固定相机可以实现高质量的基于NeRF的3D重建,无需复杂的相机运动或昂贵的成像设备。这种方法特别适用于使用昂贵且精密的仪器(如高光谱相机)进行3D植物表型研究。未来的工作将集中在优化姿态估计技术并进一步简化方法,以便无缝集成到自动化、高通量的3D表型流水线中。
This paper presents a NeRF-based framework for point cloud (PCD) reconstruction, specifically designed for indoor high-throughput plant phenotyping facilities. Traditional NeRF-based reconstruction methods require cameras to move around stationary objects, but this approach is impractical for high-throughput environments where objects are rapidly imaged while moving on conveyors or rotating pedestals. To address this limitation, we develop a variant of NeRF-based PCD reconstruction that uses a single stationary camera to capture images as the object rotates on a pedestal. Our workflow comprises COLMAP-based pose estimation, a straightforward pose transformation to simulate camera movement, and subsequent standard NeRF training. A defined Region of Interest (ROI) excludes irrelevant scene data, enabling the generation of high-resolution point clouds (10M points). Experimental results demonstrate excellent reconstruction fidelity, with precision-recall analyses yielding an F-score close to 100.00 across all evaluated plant objects. Although pose estimation remains computationally intensive with a stationary camera setup, overall training and reconstruction times are competitive, validating the method's feasibility for practical high-throughput indoor phenotyping applications. Our findings indicate that high-quality NeRF-based 3D reconstructions are achievable using a stationary camera, eliminating the need for complex camera motion or costly imaging equipment. This approach is especially beneficial when employing expensive and delicate instruments, such as hyperspectral cameras, for 3D plant phenotyping. Future work will focus on optimizing pose estimation techniques and further streamlining the methodology to facilitate seamless integration into automated, high-throughput 3D phenotyping pipelines.