Make `InferenceGateway` an AI gateway - #425

Draft

negz wants to merge 13 commits into

modelplaneai:mainfrom

negz:special-envoy

Commits on Sep 2, 2026

Update the serving stack's gateway components to current releases
negz
committed
28b32ba
Reshape the gateway APIs around an AI gateway front door
negz
committed
f2230db
Run the fleet gateway on an InferenceCluster as an AI gateway
negz
committed
12a0f26
Make a ModelEndpoint report whether it can carry traffic
negz
committed
241e291
Compose a ModelService's route and backends on every gateway serving it
negz
committed
02c575e
Address a replica's cluster gateway by name, and name the model it serves
negz
committed
020c6aa
Exercise the AI gateway path end to end in the local e2e
negz
committed
6794289
Authenticate the hop between a fleet gateway and a cluster gateway
negz
committed
3f329f8
Distribute the gateway CAs with trust-manager, not by reading Secrets
negz
committed
676e7c7
Update the prose to the gateway the code now composes
negz
committed
2613e48

Commits on Sep 3, 2026