Skip to content

feat: add codex executor config support#233

Open
davidhonig wants to merge 1 commit into
microsoft:mainfrom
davidhonig:dh/add-codex-cli-engine
Open

feat: add codex executor config support#233
davidhonig wants to merge 1 commit into
microsoft:mainfrom
davidhonig:dh/add-codex-cli-engine

Conversation

@davidhonig
Copy link
Copy Markdown

Summary

Adds a codex executor for Waza eval runs, backed by the local Codex CLI and the user’s existing ~/.codex/config.toml / auth setup.

Changes

  • Add internal/execution/CodexEngine using codex exec.
  • Support defaults.engine: codex in .waza.yaml.
  • Allow Codex model defaults from ~/.codex/config.toml when no Waza model is configured.
  • Support .waza.yaml / eval YAML model_reasoning_effort, passed to Codex as -c model_reasoning_effort=....
  • Show Model: default (Codex config) when Codex model is intentionally defaulted.
  • Add Codex option to waza init.
  • Update eval/project schemas and docs for Codex configuration.
  • Preserve follow-up prompt context using codex exec resume.
  • Parse Codex JSON events into Waza transcript, tool-call telemetry, and token usage.
  • Explicitly reject Codex skill_invocation grader / trigger telemetry paths that the Codex CLI does not expose.

Validation

  • go test ./...
  • cd site && npm run build
  • Manual MCL eval smoke test with Codex config confirmed:
    • configured model is displayed
    • model_reasoning_effort reaches Codex
    • Codex starts successfully through Waza

@davidhonig davidhonig requested a review from spboyer as a code owner May 12, 2026 09:23
@github-actions github-actions Bot enabled auto-merge (squash) May 12, 2026 09:24
@davidhonig
Copy link
Copy Markdown
Author

@microsoft-github-policy-service agree

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant