Skip to content

Accept torch.int8 in init_inference's dtype validation gate - #8578

Open
udsy19 wants to merge 3 commits into
deepspeedai:masterfrom
udsy19:fix/init-inference-int8-dtype-gate-1454
Open

Accept torch.int8 in init_inference's dtype validation gate#8578
udsy19 wants to merge 3 commits into
deepspeedai:masterfrom
udsy19:fix/init-inference-int8-dtype-gate-1454

Recognize tensor_parallel.mpu in the int8 dtype gate

6a116ac
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Oct 1, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO