The paper provides a better understanding of the task of quantizing LSTMs. This understanding is translated to simpler methods essentially involving standard normalizations combined with standard quantization methods. On the one hand, the reviewers feel the analysis is not very complicated and the conclusion that normalization helps quantization is not surprising. On the other hand, the paper does provide a convincing analysis resulting in a simple and effective solution improving the results of previous papers. Despite not having any major breakthrough, the paper is likely to be interesting for the NeurIPS audience. It is borderline, but I tend to recommend accepting it, pending the quality of other submitted papers.