类别概率中的经验测度与大数定律的强形式

Empirical Measures and Strong Laws of Large Numbers in Categorical Probability

摘要 Abstract

Glivenko-Cantelli定理是强大数定律的统一版本。它表明,对于任意独立同分布的随机变量序列,经验测度会收敛到其底层分布(以累积分布函数的一致收敛为意义)。在本文中,我们提供了研究类别概率中此类经验测度极限的工具。我们提出了两个公理,即排列不变性和经验充分性,这些公理应由类型为\(X^{\mathbb{N}} \to X\)的态射满足,以便将其解释为接受无限序列为输入并产生其经验测度样本输出的过程。由于并非所有序列都有明确的经验测度,“这类经验采样态射”存在于拟马尔可夫范畴中,与马尔可夫范畴不同,拟马尔可夫范畴允许部分态射。给定一个经验采样态射和其他一些性质后,我们证明了表征性以及Glivenko-Cantelli定理、强大数定律的抽象版本和de Finetti定理的抽象版本。我们通过标准Borel空间上的部分定义的马尔可夫核给出了多个经验采样态射的具体构造。实例化我们的抽象结果后,可以恢复有限一阶矩随机变量的标准Glivenko-Cantelli定理和强大数定律。因此,我们的工作从第一原理出发,联合证明了这两个定理与de Finetti定理。

The Glivenko-Cantelli theorem is a uniform version of the strong law of large numbers. It states that for every IID sequence of random variables, the empirical measure converges to the underlying distribution (in the sense of uniform convergence of the CDF). In this work, we provide tools to study such limits of empirical measures in categorical probability. We propose two axioms, permutation invariance and empirical adequacy, that a morphism of type $X^\mathbb{N} \to X$ should satisfy to be interpretable as taking an infinite sequence as input and producing a sample from its empirical measure as output. Since not all sequences have a well-defined empirical measure, ``such empirical sampling morphisms'' live in quasi-Markov categories, which, unlike Markov categories, allow partial morphisms. Given an empirical sampling morphism and a few other properties, we prove representability as well as abstract versions of the de Finetti theorem, the Glivenko-Cantelli theorem and the strong law of large numbers. We provide several concrete constructions of empirical sampling morphisms as partially defined Markov kernels on standard Borel spaces. Instantiating our abstract results then recovers the standard Glivenko-Cantelli theorem and the strong law of large numbers for random variables with finite first moment. Our work thus provides a joint proof of these two theorems in conjunction with the de Finetti theorem from first principles.

类别概率中的经验测度与大数定律的强形式 - arXiv