Add length-normalized sigmoid loss type to DPO trainer#5406

BrownianNotion wants to merge 5 commits intohuggingface:mainhuggingface/trl:mainfrom

BrownianNotion:dpo-add-sigmoid-norm-loss-typeBrownianNotion/trl:dpo-add-sigmoid-norm-loss-typeCopy head branch name to clipboard