Repository navigation

feat(rollout): segment-based kernel injection for hybrid-engine greedy decode - #8602

Open

delock wants to merge 40 commits into

masterfrom

gma/qwen_ki_expr

Commits on Sep 26, 2026
- feat: segment-based kernel injection for hybrid-engine rollout
  delock
  committed
  d41c914
- style: apply yapf and clang-format (CI formatting checks)
  delock
  committed
  1ae2d48
- fix: gate decode_attn/fused_norm injection on use_segki
  delock
  committed
  2bbb133
Commits on Sep 27, 2026
Commits on Sep 28, 2026
Commits on Oct 5, 2026
- fix(decode_loop): include cuda_bf16.h and pybind11/functional.h explicitly
  delock
  committed
  5ae7bd7
- fix(segment_ki): keep no-autograd kernels on no-grad paths only
  delock
  committed
  e555539
- fix(segment_ki): do not truth-test the cu_seq_lens tensor
  delock
  committed
  6946a91
- fix(segment_ki): fall back to SDPA attention for padded prompts
  delock
  committed
  c3c8c1f
- fix(rollout): restore GDN states after capture regardless of step kernel
  delock
  committed
  1121aaa
- fix(rollout): gate full-step-graph decode loop on actual kernel mounting
  delock
  committed
  3b17495
- fix(rollout): pad the token buffer in absolute coordinates after EOS
  delock
  committed
  229b5fa
- fix(segment_ki): route 3-D single-token GLU activations to the fused kernel
  delock
  committed
  11d6241
- fix(segment_ki): fall back for non-bf16 decode attention inputs
  delock
  committed
  4f79316
- refactor: move segment-KI op builders into op_builder
  delock
  committed
  51a791a
- test(segment_ki): gate kernel tests on op-builder registration
  delock
  committed
  b9872af
- docs: drop Gemma from the seg-KI family list
  delock
  committed
  efba6c8
- refactor: drop the C++ decode-loop fallback layer
  delock
  committed
  3459bda
- fix(segment_ki): gate gdn_gates native dispatch on bf16 too
  delock
  committed
  77121e4
- fix(rollout): route padded prompts away from the graph path
  delock
  committed
  c2f9b5c
- fix(segment_ki): best-effort native op load keyed on builder registration
  delock
  committed
  6239052
- fix(rollout): reject continuous batching on hybrid models up front
  delock
  committed
  2340597
- style: apply yapf to the review-fix changes
  delock
  committed
  0f1d1b0
- Merge master into gma/qwen_ki_expr
  delock
  committed
  ff93f09
- style: reword a comment codespell flags
  delock
  committed
  e484d2d
Commits on Oct 8, 2026

Commits

Commits on Sep 26, 2026

Commits on Sep 27, 2026

Commits on Sep 28, 2026

Commits on Oct 5, 2026

Commits on Oct 8, 2026