Skip to content

[Feat] Add OrcaRouter as an LLM gateway option for PP-ChatOCRv4 and PP-DocTranslation - #18322

Open
kuswardhanietidims-svg wants to merge 2 commits into
PaddlePaddle:mainfrom
kuswardhanietidims-svg:feat/orcarouter-provider
Open

kuswardhanietidims-svg wants to merge 2 commits into
PaddlePaddle:mainfrom
kuswardhanietidims-svg:feat/orcarouter-provider

Conversation

@kuswardhanietidims-svg

Copy link
Copy Markdown

Adds OrcaRouter, an OpenAI-compatible AI gateway, as a first-class LLM backend for the pp_chatocrv4_doc and pp_doctranslation pipelines. Mirroring the existing --qianfan_api_key wiring, passing --orcarouter_api_key routes both the chat and vectorization requests through https://api.orcarouter.ai/v1 (via PaddleX's OpenAI-compatible chat_bot / retriever modules). It also runs gateway-level, zero-trust security for AI agents on the same endpoint — screening every prompt/response and governing every tool call on a default-deny basis, with no application code changes.

Verification

  • --orcarouter_api_key registered in both CLI executors and generates the OrcaRouter chat_bot_config/retriever_config (wiring test)
  • black / flake8 clean on modified files
  • Live-tested against https://api.orcarouter.ai/v1: chat/completions (200) and /embeddings (200)

I'm an engineer on the OrcaRouter team.

@CLAassistant

CLAassistant commented Aug 21, 2026 •

Copy link
Copy Markdown

CLA assistant check
All committers have signed the CLA.

…anslation

Co-Authored-By: Claude <noreply@anthropic.com>
Signed-off-by: jinhao.song <jinhao.song@myflashcloud.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants