Hilbert空间上线性高斯逆问题的最优低秩近似,第一部分:后验协方差近似

Optimal low-rank approximations for linear Gaussian inverse problems on Hilbert spaces, Part I: posterior covariance approximation

摘要 Abstract

对于具有高斯先验和高斯观测噪声的线性反问题,后验分布为高斯分布,其均值和协方差由条件公式确定。利用Feldman-Hajek定理,我们分析了无限维Hilbert参数空间和有限维观测下的先验到后验更新及其低秩近似。我们证明后验分布与先验分布在有限维子空间上不同,并在保持均值不变的情况下构建后验协方差的低秩近似。由于在无限维情况下,并非所有的低秩协方差近似都能使对应的近似后验分布与原后验分布及先验分布等价,我们刻画了能够保证这种等价性的低秩协方差近似及其对应的逆矩阵(即“精度”矩阵)。对于这些近似,通过同时最小化多种损失函数,解决了一类测度近似问题。这些损失函数包括Rényi散度族、Amari $\alpha$-散度($\alpha\in(0,1)$)、Hellinger度量和Kullback-Leibler散度。我们的结果将Spantini等人(SIAM J. Sci. Comput. 2015)的结果推广到了Hilbert空间情形,并为构造无限维反问题离散化版本的低秩近似提供了理论支持,通过提出不依赖离散化的结果实现了这一目标。

For linear inverse problems with Gaussian priors and Gaussian observation noise, the posterior is Gaussian, with mean and covariance determined by the conditioning formula. Using the Feldman-Hajek theorem, we analyse the prior-to-posterior update and its low-rank approximation for infinite-dimensional Hilbert parameter spaces and finite-dimensional observations. We show that the posterior distribution differs from the prior on a finite-dimensional subspace, and construct low-rank approximations to the posterior covariance, while keeping the mean fixed. Since in infinite dimensions, not all low-rank covariance approximations yield approximate posterior distributions which are equivalent to the posterior and prior distribution, we characterise the low-rank covariance approximations which do yield this equivalence, and their respective inverses, or `precisions'. For such approximations, a family of measure approximation problems is solved by identifying the low-rank approximations which are optimal for various losses simultaneously. These loss functions include the family of R\'enyi divergences, the Amari $\alpha$-divergences for $\alpha\in(0,1)$, the Hellinger metric and the Kullback-Leibler divergence. Our results extend those of Spantini et al. (SIAM J. Sci. Comput. 2015) to Hilbertian parameter spaces, and provide theoretical underpinning for the construction of low-rank approximations of discretised versions of the infinite-dimensional inverse problem, by formulating discretization independent results.

Hilbert空间上线性高斯逆问题的最优低秩近似,第一部分:后验协方差近似 - arXiv