Fix NaN loss in SFT by using token-based label masking#339

Draft

sfc-gh-aponnusamy wants to merge 6 commits into

mainfrom

ac-sft-fix-token-based-label-masking

Commits on Jan 8, 2026

Fix NaN loss in SFT by using token-based label masking
sfc-gh-aponnusamy
committed

Commits on Jan 10, 2026

Fix NaN loss with all-masked batches in sequence parallel mode
sfc-gh-aponnusamy
committed

Commits on Jan 11, 2026

fix(sft): add robust NaN handling and fix marker tokenization consistency
sfc-gh-aponnusamy
committed
fix(chat_markers): fix heuristic marker extraction including previous turn's end marker
sfc-gh-aponnusamy
committed

Commits on Jan 12, 2026