We introduced Guarded Rollouts for AI Configs, making it easier and safer to rollout changes to your AI-powered features in production.

LLMs are powerful, but unpredictable. A small prompt tweak or model swap can work great in staging but degrade user experience in production. That’s where Guarded Rollouts come in. You can now set up guardrails to monitor important metrics - like increases in completion errors - and automatically rollback to a previous variation if that error count spikes in production.

Bonus: No manual instrumentation needed! When you integrate with the LaunchDarkly AI SDK, we automatically generate metrics, including:

• Positive/negative feedback
• Tokens in/out
• Latency
• Completion error/success rates

Learn more in our AI Configs docs and Autogenerated Metrics guide

Catching AI Feature Issues with Guarded Rollouts - Watch Video