Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference Feedback - Ivison, Hamish; Wang, Yizhong; Liu, Jiacheng; Wu, Zeqiu; Pyatkin, Valentina; Lambert, Nathan; Smith, Noah A.; Choi, Yejin; Hajishirzi, Hannaneh (Advances in Neural Information Processing Systems, 2024)