Skip to content

test(roster): RT-19 CLI and terminal-interface acceptance parity #433

Closed

Description

@R4yHarris

RT-19: CLI and terminal-interface acceptance parity

Campaign: eve-post-development-20261011

EASY SUBSET AUTHORIZED: Ray authorized easy live tasks on 2026-10-11. Remaining cases and higher difficulty stay deferred.

Field Declaration
Work item Acceptance scenario RT-19; not a runnable implementation issue
Board Roster Test; Backlog
Priority / mode P0 / TTY
Candidate SHA / manifest Pending post-development freeze; old fingerprints do not identify this round
Attempts / result / evidence 0 / Not run / Not run for this campaign
Owner / estimate Operator approval required; not staffed; estimate pending corpus and environment

Matrix: #414
Project: https://github.com/users/R4yHarris/projects/3
Spec: FEATURE_SPEC section 5.7: Human interface; honor sections 3 and 7.
Baseline: pending final reviewed/integrated candidate SHA and frozen configuration; never reuse an old uncommitted fingerprint.
Mode: TTY | Priority: P0 | Initial result: Not run | Evidence stage: Not run

Outcome

Demonstrate the named operational behavior with attributable evidence, or record a failure, blocker or unresolved spec decision without claiming success.

Prerequisites

Operator procedure

  1. Use installed roster --help, non-TTY empty invocation and an interactive TTY session; record process exit behavior.
  2. Run equivalent bounded tasks through CLI issue run and shell /run, and separately through shell plain text and /ask local intake.
  3. Compare artifacts, scope, verification, review and attribution while recording entry interface explicitly.

Acceptance checks

  • Help exits zero; empty non-TTY usage exits two; installed roster opens the documented shell in a TTY.
  • Equivalent delivery operations preserve shared lifecycle gates, model provenance and worktree isolation.
  • CLI ask issue/draft behavior remains distinct from local shell asks, which do not silently create GitHub issues.
  • Each interface run has explicit evidence and outcome; a stored command line or unit-test fixture is not a completed interface acceptance run.

Evidence and result

Use the matrix observation template. Append one redacted observation per actual attempt/case. Do not replace failed attempts with a later pass. Include run/seat IDs, exact interface, actual verification/review and human rating only when observed. Fixture results must be labeled fixture, not live operational evidence.

Fresh campaign starts at Not run. Previous comments, observations and evaluations are retained as historical evidence; they are not new-round results. Only observations tied to this candidate and campaign count. All required cases need new evidence and human review before Result becomes Pass. Unavailable prerequisites are recorded as fresh Blocked observations, not inherited old outcomes.

Safety and non-goals

This is TEST work, not a build task. No product/source/policy/workflow/vendor edits are requested; do not execute this issue as an implementation slice. Use disposable approved fixtures and separately approved bounded model tasks. No actual credentials, prompt/source bodies or transcripts may be posted.

No model calls, spend, publication, process termination or destructive cleanup are authorized by issue creation. Obtain explicit operator approval before those operations. Keep this issue only in Roster Test. Cross-link a separate Roster Build issue for any discovered defect; keep test failure evidence here and rerun after the fix.

Workflow and release gate

Backlog -> Ready only after dependencies, candidate freeze, disposable scope and budgets are approved. In progress means actual authorized execution; In review means evidence is awaiting independent/human review. Done/Pass requires all original required cases and genuine human acceptance, not a subset of green fixtures. A defect creates a separately scoped Roster Build issue; retain its failing observation here.

Plain-text Ask example

Write a short Markdown guide explaining the difference between a Git branch and a worktree, with one safe PowerShell example for listing each. Do not execute the examples or change existing files. Output it in a new "easy-git-guide" directory

Use: Easy-level live delivery sample approved by Ray on 2026-10-11; only this bounded subset is authorized now.
A prompt alone does not verify this scenario. Operator-controlled fixtures, actual evidence and genuine human review remain mandatory. Never execute a TEST issue as a product implementation issue.

Activity

  1. added
    roster:testOperational acceptance testing in Roster Test; not build implementation work.
    on Oct 9, 2026
  2. r4yharris-agent-coder commented on Oct 10, 2026

    @r4yharris-agent-coder
    Contributor

    Fresh RT-19 observation

    Fresh campaign eve-matrix-9f80afa-20261010; candidate 9f80afa, contracts 61b97b3e93e670a675c0301cce5412c73404d179. Windows, Node v20.20.2. Original matrix protocol #414; previous 28044dd observations are not carried forward.

    Full existing suite: ROSTER_TEST_JOBS=2; npm exec --yes --package=node@20 -- node scripts\run-tests.mjs. Exit 0; 171 files, 1593 tests, 1586 passed, 0 failed, 7 skipped; 784.0s wall. Nine 60-second file-budget warnings retained. This is fresh fixture/regression evidence, NOT whole-scenario operational acceptance, idle benchmark or human AI-Eval. Missing platforms, actual TTY, multi-model corpus and publication variants are not replaced with fixtures.

    Evidence stage denotes the highest evidenced subcase only; it does not certify every required gate. Human evaluation/reviewer: absent. No TEST issue was sent wholesale to roster run; no policy/workflow/vendor edits, saved-default changes, deployments or disposable-product publication. Board: https://github.com/users/R4yHarris/projects/3

    Spec: FEATURE_SPEC 5.7, honoring sections 3 and 7.

    Whole-scenario disposition: Blocked.

    CLI/shell fixtures and actual source help smoke pass; installed real-TTY and equivalent CLI/shell delivery variants missing.

    Fresh known lock failure is cross-linked to existing Build defect #441; Node20 code-planning failure is cross-linked to #454. Corrected live observations: one docs delivery/reviewer pass after automatic continuation, one code failure before coder; 1/2 reviewed yield, 0/2 first-pass yield, no human acceptance. Initial four experiment runtime/input mistakes and unavailable usage/exception evidence are retained, not relabeled as successful deliveries. See the new campaign summary on #414 for exact live outcomes and the complete 24-row disposition.

  3. changed the title [-]TEST RT-19: CLI and terminal-interface acceptance parity[/-] [+]test(roster): RT-19 CLI and terminal-interface acceptance parity[/+] on Oct 11, 2026
  4. added
    roster:evePost-Eve development or evaluation; not an authority grant.
    priority:P0Current safety or core delivery blocker.
    spec:5.7Trace to FEATURE_SPEC section 5.7; sections 3 and 7 remain binding.
    on Oct 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    priority:P0Current safety or core delivery blocker.roster:evePost-Eve development or evaluation; not an authority grant.roster:testOperational acceptance testing in Roster Test; not build implementation work.spec:5.7Trace to FEATURE_SPEC section 5.7; sections 3 and 7 remain binding.

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions