1-DREAM: 噪声环境中一维流形恢复、提取与分析工具
1-DREAM: 1D Recovery, Extraction and Analysis of Manifolds in noisy environments
摘要 Abstract
星系丝状结构在天文数据集中普遍存在。无论是粒子模拟还是观测数据,丝状结构总是作为研究系统平衡扰动的示踪体,蕴含了其历史及未来演化的关键信息。然而,在观测空间中,大量背景噪声和横向噪声的存在往往使这类结构的恢复变得复杂化。一般而言,背景噪声对分析具有破坏性,而横向噪声则可归因于测量误差,且可能包含关于结构的重要信息。此外,一维流形(丝状结构)通常是非线性的,其几何结构难以提取和建模。为了研究数据集中的隐藏流形,必须特别关注背景噪声去除和横向噪声建模,同时确保几何结构恢复的准确性。我们提出了1-DREAM:一个由五种主要机器学习方法组成的工具箱,旨在简化此类情况下的流形提取工作。每种方法均针对处理受噪声干扰的复杂低维结构的问题进行了设计,并已在先前发表的工作中经过广泛测试。本文详细介绍了这些方法,并在一个统一的框架下联合展示,同时应用于三个有趣的天文案例:模拟的章鱼星系、从宇宙网模拟中提取的丝状结构以及通过GAIA DR2观测到的Omega-半人马座恒星流。此外,还提出两种新的可视化技术,充分利用了1-DREAM所得结果的优势。代码已公开发布,供社区使用。在专门构建的数据集上的控制实验证明了该流程在恢复隐藏结构方面的准确性。
Filaments are ubiquitous in astronomical data sets. Be it in particle simulations or observations, filaments are always tracers of a perturbation in the equilibrium of the studied system and hold essential information on its history and future evolution. However, the recovery of such structures is often complicated by the presence of a large amount of background and transverse noise in the observation space. While the former is generally detrimental to the analysis, the latter can be attributed to measurement errors and it can hold essential information about the structure. To further complicate the scenario, 1D manifolds (filaments) are generally non-linear and their geometry difficult to extract and model. In order to study hidden manifolds within the dataset, particular care has to be devoted to background noise removal and transverse noise modelling, while still maintaining accuracy in the recovery of their geometrical structure. We propose 1-DREAM: a toolbox composed of five main Machine Learning methodologies whose aim is to facilitate manifold extraction in such cases. Each methodology has been designed to address issues when dealing with complicated low-dimensional structures convoluted with noise and it has been extensively tested in previously published works. In this work all methodologies are presented in detail, joint within a cohesive framework and demonstrated for three interesting astronomical cases: a simulated jellyfish galaxy, a filament extracted from a simulated cosmic web and the stellar stream of Omega-Centauri as observed with the GAIA DR2. Two newly developed visualization techniques are also proposed, that take full advantage of the results obtained with 1-DREAM. The code is made publicly available to benefit the community. The controlled experiments on a purposefully built data set prove the accuracy of the pipeline in recovering the hidden structures.