Riemannian Structure and Optimization for a Class of Low-Parametric Orthogonal Matrices
In this paper, we are concerned with matrices formed by block-diagonal factors interleaved with fixed permutations -- a flexible family of structured matrices. This class has recently drawn interest in deep learning architectures for its balanced expressivity-efficiency trade-off, yet efficient computational strategies for working with it remain to be found. We approach this problem through…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
