Eliminating Biased Length Reliance of Direct Preference Optimization via Down-Sampled KL Divergence (2024)
Abstract
No abstract provided
Bibliographic Information
Digital Object Identifier: http://dx.doi.org/10.18653/v1/2024.emnlp-main.60
Publication URI: http://dx.doi.org/10.18653/v1/2024.emnlp-main.60
Type: Conference/Paper/Proceeding/Abstract