First Order Methods with Markovian Noise: from Acceleration to Variational Inequalities - Beznosikov, Aleksandr; Samsonov, Sergey; Sheshukova, Marina; Gasnikov, Alexander; Naumov, Alexey; Moulines, Eric (Advances in Neural Information Processing Systems, 2023)