Fix incorrectly set decoupled_grad and DistOpt mechanics for MFSDP.#4133

Merged

cspades merged 3 commits intoNVIDIA:mainfrom

cspades:cye/decgrad-argfix

Apr 10, 2026

Commits on Apr 8, 2026

Fix incorrectly set decoupled_grad in training.py for MFSDP.
cspades
committed
Cleanup Megatron-FSDP decoupled_grad logic in DistributedOptimizer.
cspades
committed

Commits on Apr 9, 2026

Merge branch 'main' into cye/decgrad-argfix
cspades
authored