Repository navigation

Selene: store only what a request may resume, once, and use VRAM for snapshots - #168

Merged

lukealonso merged 4 commits into

NVIDIA:mainfrom

yatesdr:selene-tiering

Nov 2, 2026

Merged

Selene: store only what a request may resume, once, and use VRAM for snapshots#168
lukealonso merged 4 commits into
NVIDIA:mainfrom
yatesdr:selene-tiering

Commits on Nov 2, 2026
- Drop host rows a conversation has moved past
  yatesdr
  committed
  08b7150
- Store TP-rank-identical record data once
  yatesdr
  committed
  140a088
- Offer the host store only checkpoints a request may resume
  yatesdr
  committed
  15d401d
- Bound GPU snapshot rows by memory, not a fixed count
  yatesdr
  committed
  ebebf1c