Skip to content

ZeRO-3: reuse the weight partition as the master copy when it already has the master dtype - #8842

Open
pengdurice wants to merge 4 commits into
deepspeedai:masterfrom
pengdurice:peng-fix-zero3-master-copy-device-v1
Open

pengdurice wants to merge 4 commits into
deepspeedai:masterfrom
pengdurice:peng-fix-zero3-master-copy-device-v1

Commits

  1. Commits on Oct 15, 2026

  2. Commits on Oct 21, 2026

  3. Commits on Oct 25, 2026