Skip to content

test(roster): RT-04 Cross-platform installation, onboarding and endpoint discovery #418

Closed

Description

@R4yHarris

RT-04: Cross-platform installation, onboarding and endpoint discovery

Campaign: eve-post-development-20261011

DEFERRED - do not execute. Development must be reviewed/integrated before the final candidate is frozen and Ray authorizes the round.

Field Declaration
Work item Acceptance scenario RT-04; not a runnable implementation issue
Board Roster Test; Backlog
Priority / mode P0 / Cross-platform
Candidate SHA / manifest Pending post-development freeze; old fingerprints do not identify this round
Attempts / result / evidence 0 / Not run / Not run for this campaign
Owner / estimate Operator approval required; not staffed; estimate pending corpus and environment

Matrix: #414
Project: https://github.com/users/R4yHarris/projects/3
Spec: FEATURE_SPEC section 5.2: Roster and staffing; honor sections 3 and 7.
Baseline: pending final reviewed/integrated candidate SHA and frozen configuration; never reuse an old uncommitted fingerprint.
Mode: Cross-platform | Priority: P0 | Initial result: Not run | Evidence stage: Not run

Outcome

Demonstrate the named operational behavior with attributable evidence, or record a failure, blocker or unresolved spec decision without claiming success.

Prerequisites

  • No scenario prerequisites; execution still requires the safety approvals below.

Operator procedure

  1. Perform a fresh submodule-initialized installation on Windows, macOS and Linux with Node 20+; record OS, Node version and revision.
  2. Invoke installed roster, onboard and doctor from a separate disposable consumer repository; select an approved local OpenAI-compatible endpoint and probe /v1/models.
  3. Exercise no endpoint, unreachable endpoint, ambiguous model list and a configured endpoint; inspect saved private fleet/config without copying secrets.

Acceptance checks

  • The installed roster executable starts without runtime package dependencies and resolves the contracts publisher through the documented resolver.
  • Onboarding saves only explicitly confirmed private configuration, and doctor reports actionable prerequisites without exposing credentials.
  • Served model and reported context are retained; absent context remains unknown. Failed probes do not claim a configured endpoint is healthy.
  • Windows, macOS and Linux each have direct host evidence; simulated path tests do not count as completed platform onboarding.

Evidence and result

Use the matrix observation template. Append one redacted observation per actual attempt/case. Do not replace failed attempts with a later pass. Include run/seat IDs, exact interface, actual verification/review and human rating only when observed. Fixture results must be labeled fixture, not live operational evidence.

Fresh campaign starts at Not run. Previous comments, observations and evaluations are retained as historical evidence; they are not new-round results. Only observations tied to this candidate and campaign count. All required cases need new evidence and human review before Result becomes Pass. Unavailable prerequisites are recorded as fresh Blocked observations, not inherited old outcomes.

Safety and non-goals

This is TEST work, not a build task. No product/source/policy/workflow/vendor edits are requested; do not execute this issue as an implementation slice. Use disposable approved fixtures and separately approved bounded model tasks. No actual credentials, prompt/source bodies or transcripts may be posted.

No model calls, spend, publication, process termination or destructive cleanup are authorized by issue creation. Obtain explicit operator approval before those operations. Keep this issue only in Roster Test. Cross-link a separate Roster Build issue for any discovered defect; keep test failure evidence here and rerun after the fix.

Workflow and release gate

Backlog -> Ready only after dependencies, candidate freeze, disposable scope and budgets are approved. In progress means actual authorized execution; In review means evidence is awaiting independent/human review. Done/Pass requires all original required cases and genuine human acceptance, not a subset of green fixtures. A defect creates a separately scoped Roster Build issue; retain its failing observation here.

Plain-text Ask example

Give me safe Windows PowerShell installation and local endpoint onboarding instructions for Roster; do not install software or change saved configuration. Output it in a new "onboarding-guide" directory

Use: Illustrative entry point only. This scenario remains deferred; the original operator procedure and acceptance cases are still required.
A prompt alone does not verify this scenario. Operator-controlled fixtures, actual evidence and genuine human review remain mandatory. Never execute a TEST issue as a product implementation issue.

Activity

  1. added
    roster:testOperational acceptance testing in Roster Test; not build implementation work.
    on Oct 9, 2026
  2. r4yharris-agent-coder commented on Oct 10, 2026

    @r4yharris-agent-coder
    Contributor

    Fresh RT-04 observation

    Fresh campaign eve-matrix-9f80afa-20261010; candidate 9f80afa, contracts 61b97b3e93e670a675c0301cce5412c73404d179. Windows, Node v20.20.2. Original matrix protocol #414; previous 28044dd observations are not carried forward.

    Full existing suite: ROSTER_TEST_JOBS=2; npm exec --yes --package=node@20 -- node scripts\run-tests.mjs. Exit 0; 171 files, 1593 tests, 1586 passed, 0 failed, 7 skipped; 784.0s wall. Nine 60-second file-budget warnings retained. This is fresh fixture/regression evidence, NOT whole-scenario operational acceptance, idle benchmark or human AI-Eval. Missing platforms, actual TTY, multi-model corpus and publication variants are not replaced with fixtures.

    Evidence stage denotes the highest evidenced subcase only; it does not certify every required gate. Human evaluation/reviewer: absent. No TEST issue was sent wholesale to roster run; no policy/workflow/vendor edits, saved-default changes, deployments or disposable-product publication. Board: https://github.com/users/R4yHarris/projects/3

    Spec: FEATURE_SPEC 5.2, honoring sections 3 and 7.

    Whole-scenario disposition: Blocked.

    Package/onboarding/doctor/path fixtures pass on Windows. Actual macOS/Linux and installed interactive onboarding missing.

    Fresh known lock failure is cross-linked to existing Build defect #441; Node20 code-planning failure is cross-linked to #454. Corrected live observations: one docs delivery/reviewer pass after automatic continuation, one code failure before coder; 1/2 reviewed yield, 0/2 first-pass yield, no human acceptance. Initial four experiment runtime/input mistakes and unavailable usage/exception evidence are retained, not relabeled as successful deliveries. See the new campaign summary on #414 for exact live outcomes and the complete 24-row disposition.

  3. changed the title [-]TEST RT-04: Cross-platform installation, onboarding and endpoint discovery[/-] [+]test(roster): RT-04 Cross-platform installation, onboarding and endpoint discovery[/+] on Oct 11, 2026
  4. added
    roster:evePost-Eve development or evaluation; not an authority grant.
    priority:P0Current safety or core delivery blocker.
    spec:5.2Trace to FEATURE_SPEC section 5.2; sections 3 and 7 remain binding.
    on Oct 11, 2026
  5. r4yharris-agent-coder commented on Oct 14, 2026

    @r4yharris-agent-coder
    Contributor

    Board reconciliation 2026-10-14: Status In progress, Evidence stage Attempted; Result remains Not run for the full cross-platform acceptance procedure.

    Merged local/WSL discovery repair #615 (issue #614 closed) at 9c816f3: full CI 2062 total / 2059 pass / 0 fail / 3 skips. Windows coupled suite 129 total / 127 pass / 0 fail / 2 symlink skips.

    Actual anonymous metadata discovery found Ollama loopback port11435 and the user-named DeepSeek endpoint. Explicit additive save retained default config; repeated save preserved config/fleet hashes. Catalog metadata is not GPU residency or inference quality. Cross-platform fresh-install and full RT-04 operator cases remain unexecuted; no Pass/Done implied.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    priority:P0Current safety or core delivery blocker.roster:evePost-Eve development or evaluation; not an authority grant.roster:testOperational acceptance testing in Roster Test; not build implementation work.spec:5.2Trace to FEATURE_SPEC section 5.2; sections 3 and 7 remain binding.

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions