Add an opt-in route_norm flag for the legacy MoE gate - #8769

Add an opt-in route_norm flag for the legacy MoE gate#8769

Aravind-11 wants to merge 1 commit into

deepspeedai:masterdeepspeedai/DeepSpeed:masterfrom

Aravind-11:moe-optin-route-normAravind-11/DeepSpeed:moe-optin-route-normCopy head branch name to clipboard