Sven: Singular Value Descent as a Computationally Efficient Natural Gradient Method
arXiv:2604.01279v1 Announce Type: new Abstract: We introduce Sven (Singular Value dEsceNt), a new optimization algorithm for neural networks that exploits the natural decomposition of loss …
Samuel Bright-Thonney, Thomas R. Harvey, Andre Lukas, Jesse Thaler
5 views
