Computing the Bias of Constant-step Stochastic Approximation with Markovian Noise - Allmeier, Sebastian; Gast, Nicolas (Advances in Neural Information Processing Systems, 2024)