Model Management
When STOREMODELIN_DB is on, your models live in the database rather than in a static config.yaml. That means day-2 changes happen right in the Admin UI: adding a model, editing pricing, rotating a provider key, or retiring a deployment, all with no config edits and no proxy restart.
How Model Access Works
Concept
Restrict Model Access
Restrict models by Virtual Key
Model Access Groups
Overview
Access Groups
Access Groups simplify how you define and manage resource access across your organization. Instead of configuring models, MCP servers, and agents separately on each key or team, you create one group that bundles the resources you want to grant, then attach that group to your keys or teams.
Allow Teams to Add Models
Allow team to add a their own models/key for that project - so any OpenAI call they make uses their OpenAI key.
Per-Team/Project Credential Routing
Route the same model to different LLM provider endpoints (e.g. different Azure instances) based on which team or project makes the request.