Skip to content

make ginQueueDepth configurable#646

Open
GuangguanWang wants to merge 2 commits into
deepseek-ai:mainfrom
GuangguanWang:upstream
Open

make ginQueueDepth configurable#646
GuangguanWang wants to merge 2 commits into
deepseek-ai:mainfrom
GuangguanWang:upstream

Conversation

@GuangguanWang

@GuangguanWang GuangguanWang commented May 26, 2026

Copy link
Copy Markdown
Contributor

make ginQueueDepth configurable as GIN PROXY mode requires ginQueueDepth = 0

relative error msg when run in GIN PROXY mode with 1024 ginQueueDepth

Traceback (most recent call last):
  File "/root/miniconda3/envs/deepepv2/lib/python3.10/site-packages/torch/multiprocessing/spawn.py", line 87, in _wrap
    fn(i, *args)
  File "/root/miniconda3/envs/deepepv2/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 124, in decorate_context
    return func(*args, **kwargs)
  File "/mnt/deepep-v2/DeepEP/tests/elastic/test_barrier.py", line 36, in test_loop
    buffer = deep_ep.ElasticBuffer(
  File "/root/miniconda3/envs/deepepv2/lib/python3.10/site-packages/deep_ep/buffers/elastic.py", line 217, in __init__
    self.runtime = _C.ElasticBuffer(group.rank(), group.size(),
RuntimeError: NCCL exception (/mnt/deepep-v2/DeepEP/csrc/kernels/backend/nccl.cu:105): 5 (GIN_IB_PROXY does not support specifying qp depth)

…pth = 0

Signed-off-by: Guangguan Wang <guangguan.wang@linux.alibaba.com>
Signed-off-by: Guangguan Wang <guangguan.wang@linux.alibaba.com>
@isayoften

isayoften commented May 26, 2026

Copy link
Copy Markdown

++

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants