The paper presents solid theoretical contributions for online kernel regression, illustrated with experiments, While the novelty of the work is somewhat limited, the results seem interesting and non-trivial. Thus, based on the reviews (a new expert review was solicited to increase the confidence in the reviewers' pool) and my own reading, I am happy to recommend acceptance.