feat: Add support for DPO - #556

Open

sandeepchittilla wants to merge 11 commits into

CarperAI:mainfrom

sandeepchittilla:504-dpo-trainer

Commits on Sep 12, 2023

Initial commit DPO support
sandeepchittilla
committed
a34219c
Add default config for DPO and trainer functionality
sandeepchittilla
committed
cd923c1
Add DPO training example and fix minor bugs
sandeepchittilla
committed
deb71c1

Commits on Sep 13, 2023

Update .gitignore and minor refactor
sandeepchittilla
committed
ca7a828
Add type hinting and minor refactor
sandeepchittilla
committed
02bd944

Commits on Sep 14, 2023

Update docstrings
sandeepchittilla
committed
00d0f2c

Commits on Sep 27, 2023

Add Deepspeed init support when using stage 3
sandeepchittilla
committed
9b43dd5

Commits on Nov 14, 2023

Add dpo example
sandeepchittilla
committed
737a496

Commits on Nov 15, 2023

Update hyperparementers
sandeepchittilla
committed
dfa814d

Commits on Nov 20, 2023

Fix prompt truncation bug and handle deepspeed preparation
sandeepchittilla
committed
6d63004

Commits on Nov 23, 2023

Use slower training parameters
sandeepchittilla
committed
4a24603