feat(branch): composed snapshotting, stage-level branching, and bench eval ablate - #1046

Open

JeremyJC67 wants to merge 47 commits into

benchflow-ai:mainfrom

JeremyJC67:feat/ablate-cli

Commits on Sep 2, 2026

docs(branch): add composed snapshotting + rollout branching RFC

JeremyJC67
and
claude
committed
1868ade
feat(branch): compose sandbox + environment checkpoints in the branch engine

JeremyJC67
and
claude
committed
32f0d02
fix(branch): review fixes — legacy restore rejects StageSnapshot cleanly

JeremyJC67
and
claude
committed
1a9575f
feat(branch): per-child deltas + branch lineage artifacts

JeremyJC67
and
claude
committed
8171df5
fix(branch): review fixes — branch-first result semantics, per-node delta provenance, derived unsupported-field set

JeremyJC67
and
claude
committed
2360fca
feat(continue): replay cut-point — replay first K exchanges, then go live

JeremyJC67
and
claude
committed
652623e
test(branch): docker-backed zero-delta round-trip proofs for composed checkpoints

JeremyJC67
and
claude
committed
30bc4ff
fix(continue): review fixes — parsed-prefix stitching, served-cut reconciliation, stage-tag semantics, shared digest helper

JeremyJC67
and
claude
committed
1f8335d
feat(branch): stage-boundary snapshot policy for rollout branching

JeremyJC67
and
claude
committed
39416af
feat(branch): execute skill_mode deltas as fresh rollouts from the env-ready snapshot

JeremyJC67
and
claude
committed
a207d4a
feat(cli): bench eval ablate — stage-level ablation over branch children

JeremyJC67
and
claude
committed
5a622d6
fix(ablate): deploy a branch child's skills by upload, not Dockerfile

JeremyJC67
and
claude
committed
741056a
fix(branch): unscored branch children must not report a fabricated reward

JeremyJC67
and
claude
committed
b68e363
fix(sandbox): restore replays the original container bind mounts

JeremyJC67
and
claude
committed
feed07d
fix(ablate): run every env-ready branch child as a fresh rollout

JeremyJC67
and
claude
committed
6aeb846
fix(branch): branch children no longer clobber the parent's artifacts

JeremyJC67
and
claude
committed
fe9a2bf
fix(branch): gate skill deltas on the parent's own skill mode

JeremyJC67
and
claude
committed
40d8341
fix(branch): clear a stale branch value when V is undefined

JeremyJC67
and
claude
committed
3c7b2e0
fix(sandbox): restore fails closed when the container cannot be inspected

JeremyJC67
and
claude
committed
dc419ba
fix(branch): stage branches enforce the non-empty layer check

JeremyJC67
and
claude
committed
db6d6df
feat(ablate): per-test attribution so a scalar tie cannot hide a behavioral difference

JeremyJC67
and
claude
committed
1c65f68
style: apply ruff format to the branch-and-ablation files

JeremyJC67
and
claude
committed
ec26b56
fix(ablate): read per-test outcomes from preserved in-place child artifacts

JeremyJC67
and
claude
committed
4c4936c
fix(branch): restore result-bearing rollout state after in-place children

JeremyJC67
and
claude
committed
8fb94fc
fix(branch): persist partial lineage when a branch child raises

JeremyJC67
and
claude
committed
c348fac
fix(ablate): resolve a task-declared environment manifest for parent and arms

JeremyJC67
and
claude
committed
8d69976
fix(continue): stitch and account for the exchanges actually served

JeremyJC67
and
claude
committed
d17d01c
feat(branch): execute config_override deltas as fresh rollouts from env-ready

JeremyJC67
and
claude
committed
3245e2d
feat(branch): execute service-level environment_ref deltas from env-ready

JeremyJC67
and
claude
committed
5a17e93
feat(branch): synthesize a full result.json for in-place branch children

JeremyJC67
and
claude
committed
5b0584c
feat(ablate): bind an explicit environment manifest and stamp the bound environment

JeremyJC67
and
claude
committed
9729fe5
fix(acp): skip doomed set_model when codex launch config owns an off-catalog model

JeremyJC67
and
claude
committed
bccd797
fix(ablate): track JSON string state in the arm splitter

JeremyJC67
and
claude
committed
beac03e
fix(branch): artifact custody fails closed and preserves the hold directory

JeremyJC67
and
claude
committed
fe57a12
fix(continue): replay divergence detection compares actual content and records workspace digests

JeremyJC67
and
claude
committed
5edcb86
feat(ablate): --keep-snapshots export; ephemeral handles recorded truthfully

JeremyJC67
and
claude
committed
4bde66a
fix(ablate): resolve the canonical eval plan and overlay only the ablation axis

JeremyJC67
and
claude
committed
6761a60
refactor(branch): split policy, transaction, delta execution, and reporting into focused modules

JeremyJC67
and
claude
committed
d7ff4a1
feat(branch): record stage markers with trajectory exchange indices

JeremyJC67
and
claude
committed
4ef704d
feat(continue): stage-named cut points

JeremyJC67
and
claude
committed
99502ff
feat(ablate): post-research capture via a research-end marker file

JeremyJC67
and
claude
committed
4850761
feat(task): accept branch_execution forked-snapshot now the engine supports it

JeremyJC67
and
claude
committed
92ad5ab
fix(sandbox): workspace digests are null-safe and fail closed

JeremyJC67
and
claude
committed
b73afe1
fix(ablate): validate request-global settings before provisioning; never retry them in children

JeremyJC67
and
claude
committed
af67ff4
feat(rollout): stage snapshots record their lifetime; --keep-snapshots on bench eval run with a tested import path

JeremyJC67
and
claude
committed
a61e6d1
refactor(ablate): arm parsing and report assembly move out; run_ablation decomposed under the structural gate

JeremyJC67
and
claude
committed
cfb699f
docs(branch): architecture and RFC text match the implemented composition and snapshot lifetimes

JeremyJC67
and
claude
committed
72cb8cd