Rational Neural Networks have Expressivity Advantages
arXiv:2602.12390v1 Announce Type: cross Abstract: We study neural networks with trainable low-degree rational activation functions and show that they are more expressive and parameter-efficient than …
Maosen Tang, Alex Townsend
16 views