Skip to content

Average sparse gradients by world size regardless of gradient_predivide_factor - #8772

Draft
vineethsaivs wants to merge 1 commit into
deepspeedai:masterfrom
vineethsaivs:fix/sparse-allreduce-predivide-factor
Draft

Average sparse gradients by world size regardless of gradient_predivide_factor#8772
vineethsaivs wants to merge 1 commit into
deepspeedai:masterfrom
vineethsaivs:fix/sparse-allreduce-predivide-factor

Commits

  1. Commits on Oct 7, 2026