Skip to content

reduce memory for gemma4 moe model in tp#45219

Open
sywangyi wants to merge 1 commit intohuggingface:mainfrom
sywangyi:reduce_memory_gemma4
Open

reduce memory for gemma4 moe model in tp#45219
sywangyi wants to merge 1 commit intohuggingface:mainfrom
sywangyi:reduce_memory_gemma4

Commits

Commits on Apr 3, 2026