Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models - Kunstner, Frederik; Milligan, Alan; Yadav, Robin; Schmidt, Mark; Bietti, Alberto (Advances in Neural Information Processing Systems, 2024)