Skip to content

Add an opt-in route_norm flag for the legacy MoE gate - #8769

Open
Aravind-11 wants to merge 1 commit into
deepspeedai:masterfrom
Aravind-11:moe-optin-route-norm
Open

Aravind-11 wants to merge 1 commit into
deepspeedai:masterfrom
Aravind-11:moe-optin-route-norm