Sensitivity and Sharpness of n-Simplicial Attention
Towards a maximal update parameterization of n-simplicial attention
Architecture-Optimizer Codesign
Fast, Numerically Stable, and Auto-Differentiable Spectral Clipping via Newton-Schulz Iteration
A small step towards hardware-architecture-optimizer codesign in deep learning.