[release-0.3] NO-JIRA: feat: add remaining netedge evaluations (backport #195)#252
Conversation
This adds mcpchecker (gevals) evaluations for the four remaining netedge tools that were not covered in PR openshift#138: - inspect_route - get_service_endpoints - probe_dns_local - probe_http Also updates the NETEDGE-validation-how-to.md doc with the new test commands.
…ent configuration - Pin DNS record type to 'A' in probe_dns_local task as requested in PR review. - Refine task prompts to be more explicit about using specialized tools. - Simplify gemini-agent configuration to use ACP (Agent Communication Protocol). - Update judge configuration to use builtin.llm-agent. Signed-off-by: bentito <btofel@redhat.com>
openshift-ci-robot
added
the
jira/valid-reference
|
@bentito: This pull request explicitly references no jira issue. DetailsIn response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository. |
|
Important Review skippedAuto reviews are disabled on base/target branches other than the default branch. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Pro Plus Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
@bentito: all tests passed! Full PR test history. Your PR dashboard. DetailsInstructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here. |
|
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: bentito, matzew The full list of commands accepted by this bot can be found here. The pull request process is described here DetailsNeeds approval from an approver in each of these files:
Approvers can indicate their approval by writing |
openshift-ci
Bot
added
the
approved
|
/override "Red Hat Konflux / openshift-mcp-server-release-03-on-pull-request" |
|
@matzew: Overrode contexts on behalf of matzew: Red Hat Konflux / openshift-mcp-server-release-03-on-pull-request DetailsIn response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
openshift-merge-bot
Bot
merged commit e7ceae4
into
openshift:release-0.3
3 participants
Backport of #195 to release-0.3 branch.
Original PR description:
This PR introduces evaluation tasks for the four remaining netedge tools that were not covered in PR #138.
Changes:
inspect-route,get-service-endpoints,probe-dns-local, andprobe-httptasks toevals/tasks/netedge/to complete the core NIDS diagnostic capabilities test suite.docs/openshift/NETEDGE-validation-how-to.mdto include step-by-step instructions for running these 4 new validations.