Repository navigation

Add vocabulary-parallel logprobs, entropy and KL ops - #8791

Open

jinyouzhi wants to merge 6 commits into

deepspeedai:masterfrom

jinyouzhi:vocab-parallel-distill-ops

Commits on Oct 9, 2026
- Add vocabulary-parallel logprobs, entropy and KL ops
  
  jinyouzhi
  and
  Copilot
  committed
  8d853fb
Commits on Oct 10, 2026
- Fix precision loss and masked-vocabulary NaNs in vocab-parallel ops
  
  jinyouzhi
  and
  Copilot
  committed
  99261be
- Keep KL infinite when a finite probability underflows
  
  jinyouzhi
  and
  Copilot
  committed
  f2ade50
- Zero logprobs gradients for fully ignored rows
  
  jinyouzhi
  and
  Copilot
  committed
  ee94d8e
- Zero gradients of undefined rows and allow empty shards in vocab-parallel ops
  
  jinyouzhi
  and
  Copilot
  committed
  e31b42c
- Merge branch 'master' into vocab-parallel-distill-ops
  jinyouzhi
  authored
  4019279