Anna-Laura Sattelberger

2papers

2 Papers

12.6AGMay 25
Connection Matrices in Macaulay2

Paul Görlach, Joris Koefler, Anna-Laura Sattelberger et al.

In this article, we describe the theoretical foundations of the Macaulay2 package ConnectionMatrices and explain how to use it. For a left ideal in the Weyl algebra that is of finite holonomic rank, we implement the computation of the encoded system of linear PDEs in connection form with respect to an elimination term order that depends on a chosen positive weight vector. We also implement the gauge transformation for carrying out a change of basis over the field of rational functions. We demonstrate all implemented algorithms with examples.

LGSep 24, 2023Code
Geometry of Linear Neural Networks: Equivariance and Invariance under Permutation Groups

Kathlén Kohn, Anna-Laura Sattelberger, Vahid Shahverdi

The set of functions parameterized by a linear fully-connected neural network is a determinantal variety. We investigate the subvariety of functions that are equivariant or invariant under the action of a permutation group. Examples of such group actions are translations or $90^\circ$ rotations on images. We describe such equivariant or invariant subvarieties as direct products of determinantal varieties, from which we deduce their dimension, degree, Euclidean distance degree, and their singularities. We fully characterize invariance for arbitrary permutation groups, and equivariance for cyclic groups. We draw conclusions for the parameterization and the design of equivariant and invariant linear networks in terms of sparsity and weight-sharing properties. We prove that all invariant linear functions can be parameterized by a single linear autoencoder with a weight-sharing property imposed by the cycle decomposition of the considered permutation. The space of rank-bounded equivariant functions has several irreducible components, so it can not be parameterized by a single network-but each irreducible component can. Finally, we show that minimizing the squared-error loss on our invariant or equivariant networks reduces to minimizing the Euclidean distance from determinantal varieties via the Eckart-Young theorem.