Schur正定网络:具有结构的SPD锥内深度学习
Schur's Positive-Definite Network: Deep Learning in the SPD cone with structure
摘要 Abstract
在对称正定(SPD)锥中估计矩阵对于从计算机视觉到图学习的许多应用都具有重要意义。尽管存在各种基于凸优化的估计器,但由于其基于模型的方法,它们的表达能力仍然受到限制。深度学习的成功促使人们采用基于学习的方法,以数据驱动的方式利用神经网络估计SPD矩阵。然而,设计有效的SPD学习神经架构具有挑战性,特别是当任务需要额外的结构约束(如元素级稀疏性)时。当前的方法要么无法确保输出满足所有所需特性,要么缺乏表达能力。在本文中,我们引入了SpodNet,这是一种新颖且通用的学习模块,能够保证SPD输出并支持额外的结构约束。值得注意的是,它解决了联合学习SPD和稀疏矩阵这一具有挑战性的任务。我们的实验展示了SpodNet层在这类应用中的多样性和相关性。
Estimating matrices in the symmetric positive-definite (SPD) cone is of interest for many applications ranging from computer vision to graph learning. While there exist various convex optimization-based estimators, they remain limited in expressivity due to their model-based approach. The success of deep learning motivates the use of learning-based approaches to estimate SPD matrices with neural networks in a data-driven fashion. However, designing effective neural architectures for SPD learning is challenging, particularly when the task requires additional structural constraints, such as element-wise sparsity. Current approaches either do not ensure that the output meets all desired properties or lack expressivity. In this paper, we introduce SpodNet, a novel and generic learning module that guarantees SPD outputs and supports additional structural constraints. Notably, it solves the challenging task of learning jointly SPD and sparse matrices. Our experiments illustrate the versatility and relevance of SpodNet layers for such applications.