Skip to content

fix(optimizer): clip by global grad norm across FSDP ranks in BF16Optimizer#663

Open
jessiewei7 wants to merge 1 commit into
sgl-project:mainfrom
jessiewei7:pr/fsdp-clip-grad-norm
Open

fix(optimizer): clip by global grad norm across FSDP ranks in BF16Optimizer#663
jessiewei7 wants to merge 1 commit into
sgl-project:mainfrom
jessiewei7:pr/fsdp-clip-grad-norm

Commits