Keep the gateway you already run, and decide the model, prompt, and parameters per request instead of per config file. Give enterprise customers your strongest model and free users a cheaper one. Roll a new model out to five percent of traffic, watch quality and cost, and revert in seconds if it degrades. None of it requires editing YAML, restarting the proxy, or shipping code, and every change is attributed and approval-gated like any feature flag change.

To get started, read Use LaunchDarkly AgentControl to control model administration with LiteLLM.

Our team is happy to help you set this up. To get help or share feedback, contact your LaunchDarkly account team or email product@launchdarkly.com.