Skip to content

Add length-normalized sigmoid loss type to DPO trainer #5406

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
BrownianNotion wants to merge 5 commits into
base: main
Choose a base branch
from
+12 −3

Merge branch 'main' into dpo-add-sigmoid-norm-loss-type

8f55007
Select commit
Loading
Failed to load commit list.
Open

Add length-normalized sigmoid loss type to DPO trainer #5406

Merge branch 'main' into dpo-add-sigmoid-norm-loss-type
8f55007
Select commit
Loading
Failed to load commit list.
Cursor / Cursor Bugbot completed Apr 7, 2026 in 3m 8s

Bugbot Review

Bugbot Analysis Progress (3m 10s elapsed)

✅ Gathered PR context (2s)
✅ Completed bug detection (3m 3s)
✅ Posted analysis results (5s)

Final Result: Bugbot completed review - no new issues found. 2 previously reported issues remain unresolved.

Request ID: serverGenReqId_0a7594f7-137b-44b7-a95d-30267c39b3d5

Details

View more details on Cursor