The reviewers agree that the paper is interesting and a good contribution. Some suggestions for the final version: - spell checker - Have a look at the meta-RL literature that also deals with latent variables: http://auai.org/uai2018/proceedings/papers/235.pdf https://openreview.net/forum?id=rk07ZXZRb