This category contains documentation topics explaining LaunchDarkly’s AI SDKs.
LaunchDarkly’s AI SDKs are designed for use with AgentControl. They are currently in a pre-1.0 release and under active development.
While LaunchDarkly server-side, client-side, and edge SDKs focus on interacting with feature flags, the LaunchDarkly AI SDKs interact with AgentControl configs. Configs are resources that you create in LaunchDarkly and use to customize, test, and roll out new large language models (LLMs) within your generative AI applications.
You can use the AI SDKs to customize each config based on the context that you provide. This means both the message and the model evaluation are specific to each end user, at runtime. You can also use the AI SDKs to record metrics from your AI model generation, including duration and tokens.
AI metrics and traces are recorded differently. AI metrics are captured through the AI SDK tracker methods. If you use the LaunchDarkly observability plugin to capture traces, run your model calls inside an active span so LaunchDarkly can associate traces with the evaluated config.
You can follow development or contribute on GitHub with the following links.
