Repository navigation

Keep empty gradient-norm ranks in collective reductions - #8918

Open

Levius-Fubuki wants to merge 3 commits into

deepspeedai:masterfrom

Levius-Fubuki:fix/empty-global-norm-ranks

Open

Keep empty gradient-norm ranks in collective reductions#8918
Levius-Fubuki wants to merge 3 commits into
deepspeedai:masterfrom
Levius-Fubuki:fix/empty-global-norm-ranks

Commits on Oct 27, 2026
- Keep empty gradient-norm ranks in collective reductions
  Levius-Fubuki
  committed
  9ed909a
- Extract local norm contributions and share global reductions
  Levius-Fubuki
  committed
  3db49c4
Commits on Oct 30, 2026
- Handle zero-element tensors in global infinity norms
  Levius-Fubuki
  committed
  5cffa02