A Loss Curvature Perspective on Training Instability in Deep Learning
In this meeting together with Justin Gilmer we discussed his paper with Behrooz Ghorbani, Ankush Garg, Sneha Kudugunta, Behnam Neyshabur, David Cardoze, George Dahl, Zack Nado, and Orhan Firat “A Loss Curvature Perspective on Training Instability in Deep Learning” published at ICLR 2022.
You can find the presentation that was held here.