摘要 Abstract
我们提出了进化选择器(EVOS),这是一种加速隐式神经表征(INR)训练的有效训练范式。与传统INR训练在每次迭代中对所有样本进行神经网络处理的方法不同,我们的方法仅针对经过策略性选择的点进行训练,通过消除冗余的前向传递来减少计算开销。具体而言,我们将每个样本视为进化过程中的一个个体,只有适应度最高的个体才能存活并被纳入训练中,从而与神经网络的动力学自适应演化。尽管这在概念上类似于进化算法,但由于其目标的不同(选择用于加速而非迭代优化求解),需要为我们的应用场景重新定义进化机制。为此,我们设计了稀疏适应度评估、频率引导的交叉操作以及增强的无偏突变操作来构成EVOS。这些组件分别以较低的计算成本指导样本选择,通过频域平衡提升性能,并缓解缓存评估带来的选择偏差。大量实验表明,该方法能够在确保优越收敛性的前提下,将训练时间减少约48%-66%,且无需额外成本,在基于采样的最新策略中达到了最先进的加速效果。
We propose EVOlutionary Selector (EVOS), an efficient training paradigm for accelerating Implicit Neural Representation (INR). Unlike conventional INR training that feeds all samples through the neural network in each iteration, our approach restricts training to strategically selected points, reducing computational overhead by eliminating redundant forward passes. Specifically, we treat each sample as an individual in an evolutionary process, where only those fittest ones survive and merit inclusion in training, adaptively evolving with the neural network dynamics. While this is conceptually similar to Evolutionary Algorithms, their distinct objectives (selection for acceleration vs. iterative solution optimization) require a fundamental redefinition of evolutionary mechanisms for our context. In response, we design sparse fitness evaluation, frequency-guided crossover, and augmented unbiased mutation to comprise EVOS. These components respectively guide sample selection with reduced computational cost, enhance performance through frequency-domain balance, and mitigate selection bias from cached evaluation. Extensive experiments demonstrate that our method achieves approximately 48%-66% reduction in training time while ensuring superior convergence without additional cost, establishing state-of-the-art acceleration among recent sampling-based strategies.