Skip to content

AutoTP: sequence sharding for training - #8860

Draft
pengdurice wants to merge 3 commits into
deepspeedai:masterfrom
pengdurice:peng-add-autotp-sequence-sharding-v1
Draft

pengdurice wants to merge 3 commits into
deepspeedai:masterfrom
pengdurice:peng-add-autotp-sequence-sharding-v1