All reviewers agree that this paper should be accepted. The work bridges techniques often associated with medical image analysis with those of the NeurIPS community.