tests/mimo-7B: switch ROCm path to async 4+4 to avoid 8-rank RCCL hang and no gradient accumulation fusion#1615

Open

sreerohi wants to merge 2 commits into

radixark:mainfrom

sreerohi:rocm/mimo-7B-mtp-async-4plus4

Commits on Jul 9, 2026

tests/mimo-7B: switch ROCm path to async 4+4 to avoid 8-rank RCCL hang

sreerohi
authored and
Sree Rohith Pulipaka
committed

Commits on Jul 10, 2026

tests/mimo-7B: import torch and guard hip attr for ROCm GPU-count check
Sree Rohith Pulipaka
committed