Vega AI providers

This topic explains how to choose the AI provider that Vega uses in each project, and how to add and manage your own provider keys. Vega is the LaunchDarkly AI-powered agent. To learn more about Vega, including eligibility and permissions, read Vega.

​

Prerequisites

To complete the procedures in this topic, your role requires the following:

• The Vega actions, to use Vega.
• Permission to create and update integrations, to add or edit a custom AI provider.
• An Admin or Owner base role, or a custom role that allows the updateFactoryRepoSettings action for the project, to choose its AI provider.

​

AI providers

Vega runs on one of two AI providers. You choose the provider for each project in the Inference section of that project’s Automations settings:

• Managed AI provider: LaunchDarkly provides model access and chooses the models. This is the default for new projects. Your organization must have accepted the AI features terms before Vega can use it. To learn more, read Eligibility.
• Custom AI provider (bring your own key): Vega uses an Anthropic or OpenAI API key that you add to LaunchDarkly. You choose the models, and your provider bills you directly. A custom AI provider does not require the AI features terms. It is only available on Enterprise plans.

Here is how the two providers compare:

	Managed AI provider	Custom AI provider
Model access	Provided by LaunchDarkly	Your Anthropic or OpenAI account
Models	Chosen by LaunchDarkly	You choose from the models your key can use
Usage limits and billing	Your plan’s Vega allowance applies	Billed by your provider. Not counted against your plan
AI features terms	Required	Not required

​

Supported providers

A custom AI provider can use a key from one of the following providers:

• Anthropic
• OpenAI

​

Add a custom AI provider

Custom AI providers belong to your LaunchDarkly account. After you add one, any project in the account can select it, but a key only takes effect in a project once that project selects it. Adding a key doesn’t change the provider of any project. Anyone who can manage integrations can add a custom AI provider, but only accounts on an Enterprise plan can select one for a project. To add a custom AI provider:

1. Click the gear icon in the left sidebar to view Organization settings.
2. Click Integrations and search for “Vega Custom AI Provider.”
3. Click Add new. The “Create Vega Custom AI Provider configuration” panel appears.
4. Enter a Name for the key. Vega shows this name in the Provider menu, for example “Custom AI provider: Team (OpenAI).”
5. Select a Model Provider.
6. Select a Model. The menu lists the models available from the provider you selected.
7. Enter the API Key from your provider. LaunchDarkly masks the key after you save it.
8. Read the Integration Terms and Conditions and select the checkbox.
9. Click Save configuration.

You can also start from a project’s Automations settings: in the Inference section, open the Provider menu and choose Add custom AI provider. After you add a custom AI provider, select it for each project that should use it. To learn how, read Choose the AI provider for a project.

​

Choose the AI provider for a project

Each project uses either the managed AI provider or one of the account’s custom AI providers. A conversation keeps the AI provider it started with. After you change a project’s AI provider, start a new conversation to use it. If your organization hasn’t accepted the AI features terms, conversations that started on the managed AI provider can’t continue. To choose the AI provider for a project:

1. Click the project dropdown. The project menu appears.
2. Click Project settings.
3. Click Automations. The “Automations” page appears.
4. Open the Provider menu in the Inference section and choose Managed AI provider or one of your custom AI providers.
5. Select a Primary model and a Fast model, if you chose a custom AI provider. Vega lists the models its key can use and marks its suggestions. The primary model runs Vega conversations and investigations. The fast model answers quick requests, such as Ask Vega search queries.
6. Click Save in the Inference section.

Custom AI providers are only available on Enterprise plans. On other plans, each custom AI provider and Add custom AI provider show a lock icon in the Provider menu and can’t be chosen. A project that already uses a custom AI provider shows a “Custom AI providers require an Enterprise plan” notice, and must switch to Managed AI provider to keep using Vega.

​

Data and billing

When a project uses a custom AI provider:

• Vega sends prompts, and the data it uses to answer them, such as flag configuration, telemetry, and repository content, to your provider using your key.
• LaunchDarkly stores Vega conversation inputs and outputs, as it does for the managed AI provider.
• Your provider bills you for usage. Custom AI provider usage doesn’t count against your plan’s Vega allowance and doesn’t appear in LaunchDarkly usage or billing diagnostics.