Skip to content

ci(ai-gateway): run GitHub Copilot in the weekly Kimi benchmark - #520

Merged
dtice25 merged 1 commit into
masterfrom
devin/1792163486-kimi-copilot-weekly
Oct 16, 2026
Merged

dtice25 merged 1 commit into
masterfrom
devin/1792163486-kimi-copilot-weekly

Conversation

@dtice25

@dtice25 dtice25 commented Oct 16, 2026

Copy link
Copy Markdown
Collaborator

Summary

Scheduled AI Gateway runs currently unset GITHUB_COPILOT_API_KEY for every matrix family, keeping Copilot out of the weekly Friday run — it only appears on workflow_dispatch runs (which is how it got into last week's Kimi results). This changes the exclusion to skip the kimi leg only, so Copilot joins the weekly scheduled Kimi roster while anthropic/openai/gemini stay Copilot-free.

One-line diff in the Run AI gateway benchmark step:

-if [ "${{ github.event_name }}" = "schedule" ]; then
+if [ "${{ github.event_name }}" = "schedule" ] && [ "${{ matrix.family.slug }}" != "kimi" ]; then
   unset GITHUB_COPILOT_API_KEY
 fi

Manual (workflow_dispatch) and push runs are unchanged — Copilot already runs there when its key is present.

Link to Devin session: https://app.devin.ai/sessions/d878fd7a28c44aaba2a5a98aa6f6150f
Open in Devin Desktop: https://app.devin.ai/desktop/session/d878fd7a28c44aaba2a5a98aa6f6150f?variant=devin
Requested by: @dtice25

Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
@devin-ai-integration

Copy link
Copy Markdown
Contributor

I'll fix CI failures and address comments from users with write access. I'll skip comments containing "(aside)".

  • Disable automatic comment, CI, and merge conflict monitoring

@dtice25
dtice25 marked this pull request as ready for review October 16, 2026 15:12
@open-cla

open-cla Bot commented Oct 16, 2026

Copy link
Copy Markdown

Contributor License Agreement

All contributors are covered by a CLA.

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no bugs or issues to report.

Devin Review

@dtice25
dtice25 merged commit 55e0a53 into master Oct 16, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant