Repository navigation
docs: auto-update for merged PRs (2026-10-17) - #4623
Merged
Merged
Conversation
Contributor
There was a problem hiding this comment.
🟡 Changes recommended
The added guidance misstates the default API selection, which depends on the model.
1 open issue
What changed in this PR
Documents how MCP tool results are represented when using OpenAI Chat Completions.
Changes:
- Explains image serialization as text in tool messages.
- Describes document attachments in follow-up user messages.
| File | Description |
|---|---|
docs/tools/mcp/index.md |
Adds Chat Completions guidance for embedded resources. |
Review effort: Balanced
|
|
||
| - **Anthropic** — images become `image` blocks in the `tool_result`; PDFs and other documents become `document` blocks. | ||
| - **OpenAI** — images are forwarded as `input_image` data URIs; PDFs as `input_file` data URIs in the tool result content. | ||
| - **OpenAI Chat Completions** (`api_type: openai_chatcompletions`, the default, and OpenAI-compatible providers) — tool messages only accept text, so images (including image documents) are sent as text in the tool message as their data URI or URL. PDFs and other documents are attached in a follow-up user message labeled "Attached content from tool result:". |
dgageot
approved these changes
Oct 17, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Documentation changes
docs/tools/mcp/index.md(Embedded Resources): document how tool-result images and documents are sent to models over the OpenAI Chat Completions API. Images are sent as text (data URI/URL) inside the tool message, while PDFs and other documents go in a follow-up user message.Reviewed, no changes needed
Docs for #4611, #4614, #4599, #4603, #4606 and #4618 already shipped with their source PRs.
Source PRs