Skip to content

Average sparse gradients by world size regardless of gradient_predivide_factor - #8772

Draft
vineethsaivs wants to merge 1 commit into
deepspeedai:masterfrom
vineethsaivs:fix/sparse-allreduce-predivide-factor
Draft

Average sparse gradients by world size regardless of gradient_predivide_factor#8772
vineethsaivs wants to merge 1 commit into
deepspeedai:masterfrom
vineethsaivs:fix/sparse-allreduce-predivide-factor

Average sparse gradients by world size regardless of predivide factor

3d12acc
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Oct 7, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO