Vercel AI Gateway Adds Private Inference: Self-Hosted, Fine-Tuned and Prerelease Models via private/ IDs with the Same APIs, Auth and Logs as Catalog Models
Vercel announced on X and its changelog that AI Gateway now supports Private Inference: enterprises can register their own model endpoints as private providers and call them with private/<slug> model IDs through Chat Completions, Responses or Messages, with the gateway translating each request to the endpoint format. Private models are visible only to the team, credentials are stored encrypted, Zero Data Retention can be enabled per provider, the models work in coding agents such as Claude Code, Codex and Cursor, and requests can fall back to a catalog model if the endpoint fails.

- •Register fine-tuned, self-hosted or prerelease model endpoints as private providers and call them with private/<slug> IDs, so switching models only changes the model ID
- •Supports the Chat Completions, Responses and Messages APIs, with the gateway translating each request to the endpoint format
- •Private models are visible only to your Vercel team and not listed in the public catalog; credentials are encrypted and Zero Data Retention can be enabled per provider
- •Works in coding agents connected to AI Gateway such as Claude Code, Codex and Cursor; logs, trace drains and reporting show private and catalog traffic together
- •Optional fallback to a catalog model if the private endpoint fails; Vercel CLI 65.16.0 or later adds private-inference providers and models create commands









