Universality of AdaGrad Stepsizes for Stochastic Optimization: Inexact Oracle, Acceleration and Variance Reduction - Rodomanov, Anton; Jiang, Xiaowen; Stich, Sebastian (Advances in Neural Information Processing Systems, 2024)