Skip to content

Measure first-call and post-update costs of continuous rollout CUDA Graphs - #8853

Draft
nathon-lee wants to merge 13 commits into
deepspeedai:masterfrom
nathon-lee:bench/rollout-cuda-graph-first-call
Draft

nathon-lee wants to merge 13 commits into
deepspeedai:masterfrom
nathon-lee:bench/rollout-cuda-graph-first-call