All pull requests

Pull requests

• Add independent DFlash2 body quantization

  #291·voipmonitor opened Nov 13, 2026Collaborator·

  ·

• feat(runtime): make mixed prefill selectable at load time

  #290·shadownetX opened Nov 13, 2026·

  ·

• fix(helios): bound history proposals by logical lane length

  #289·shadownetX opened Nov 13, 2026·

  ·
  1

• Gather routes instead of router logits for row-sharded DeepSeek V4.1 prefill

  area:kernelsarea:preparationenhancementmodel:deepseek-v4.1performancetriage:validation
  #284·FujitsuPolycom opened Nov 13, 2026Contributor·

  ·
  1

• Row-shard DeepSeek V4.1 prefill attention so each rank attends only its rows

  area:kernelsarea:memoryarea:preparationenhancementmodel:deepseek-v4.1performancetriage:design-review
  #283·FujitsuPolycom opened Nov 13, 2026Contributor·

  ·
  1

• Reduce-scatter DeepSeek V4.1 prefill so each rank runs mHC on its own rows

  area:kernelsarea:preparationenhancementmodel:deepseek-v4.1performancetriage:design-review
  #282·FujitsuPolycom opened Nov 13, 2026Contributor·

  ·
  1

• Stop tokenizing user content as special - track trust in the jinja template VM

  area:apibugpriority:P1triage:design-review
  #281·llitz opened Nov 13, 2026·

  ·
  6

  

• perf(qwen): prepare packed Flash Next DFlash2 verification

  area:kernelsarea:preparationenhancementmodel:qwen3.8-flash-nextperformancetriage:validation
  #233·shadownetX opened Nov 8, 2026·

  ·
  6

• Route multi-host RoCE rails over direct cables

  area:orbitarea:rocenanteenhancementperformancetriage:design-review
  #232·original-el8 opened Nov 8, 2026Collaborator·

  ·
  12

• Race a Triton tile kernel against cuBLAS for GLM's BF16 head projections

  area:kernelsarea:preparationenhancementmodel:glm-5.3performancetriage:design-review
  #231·original-el8 opened Nov 8, 2026Collaborator·

  ·
  2

• Muse Glimmer 30B NVFP4: single-GPU serving with images, DFlash2 drafting, and a 1,048,576-token context

  area:apiarea:packagingarea:preparationenhancementmodel:muse-glimmertriage:design-review
  #229·Raydius opened Nov 7, 2026·

  ·
  4

• Report conversion phases while ignition convert verifies and writes a package

  area:packagingenhancementtriage:review
  #223·kyonjova opened Nov 6, 2026Contributor·

  ·

• Recognize GB300 DGX Station GPU device ID 0x31c2

  area:packagingbugpriority:P2triage:review
  #221·YouNeedCryDear opened Nov 6, 2026·

  ·
  2

• Share the first GLM draft pass's sparse selection with later passes

  area:kernelsarea:preparationbugmodel:glm-5.3performancepriority:P2triage:review
  #218·original-el8 opened Nov 6, 2026Collaborator·

  ·
  2

• Decode GLM width-one rounds in place without KDA records

  area:kernelsarea:preparationmodel:glm-5.3performancetriage:review
  #217·original-el8 opened Nov 6, 2026Collaborator·

  ·
  2

• Track FlashInfer main in the preparation dependency instead of a pinned commit

  area:preparationenhancementtriage:design-review
  #215·brandonmmusic-max opened Nov 6, 2026Contributor·

  ·
  6

• Read every checkpoint through b12x's pinned-host reader

  area:memoryarea:preparationbugpriority:P2triage:design-review
  #213·original-el8 opened Nov 5, 2026Collaborator·

  ·
  2

• Qwen3.8 Flash Next: declared YaRN rope scaling and --rope-parameters for 1M-token serving

  model:qwen3.8-flash-nexttriage:design-review
  #212·Raydius opened Nov 5, 2026·

  ·
  5

• Export mixed rounds with speculation again

  area:preparationbugmodel:qwen3.8-flash-nextpriority:P1triage:review
  #211·Raydius opened Nov 5, 2026·

  ·
  1

• Report checkpoint source failures to preparation peers

  bugmodel:deepseek-v4.1priority:P2triage:review
  #198·0z5a opened Nov 4, 2026·

  ·
  1

• Report the selected deployment rebuild manifest in inspection

  area:packagingbugpriority:P2triage:review
  #196·0z5a opened Nov 4, 2026·

  ·
  1

  3

• Add Muse Glimmer mixed-precision text recipe

  area:preparationmodel:muse-glimmertriage:validation
  #192·YouNeedCryDear opened Nov 4, 2026·

  ·
  3

• Add Inkling-Small NVFP4 recipe for one DGX Station

  area:preparationmodel:inkling-smalltriage:design-review
  #191·YouNeedCryDear opened Nov 4, 2026·

  ·
  2

• Clear released snapshot-alias pages before their first KV use

  area:cachingarea:memorymodel:qwen3.8-27btriage:verify-for-closure
  #181·mark-yong opened Nov 3, 2026Contributor·

  ·
  1

  3

• Keep the default Windows Ctrl-C termination while loading

  area:apibugpriority:P2triage:review
  #178·mark-yong opened Nov 3, 2026Contributor·

  ·
  1