arrowCustomer Stories

Gamma generates viral conversion growth with warehouse-native experiments for AI features

Before

Integrating  promising but unproven AI models created risk

Bold ideas stalled due to risk and data delays

Data teams created a bottleneck for experiment analysis

Couldn’t connect features to conversion or retention

After

Small rollouts and fallbacks reduce launch risk

Teams test, ship, and learn independently

AI experiments linked to conversion and retention metrics

Test 20+ models in production, safely and continuously

Increased user satisfaction 30% for complex prompts

About Gamma

Gamma is an AI-powered platform that helps users quickly turn ideas into polished presentations, websites, and other digital content. Co-founded by Jon Noronha, James Fox, and Grant Lee, Gamma helps users bring their ideas to life in presentations through intuitive, AI-native tools. The company operates with a lean team of around 30 employees and competes in a space dominated by industry giants. Gamma differentiates itself by turning prompts and ideas into impressive visual outputs, without the manual effort required by traditional tools.

Scenario

Gamma is an AI-native startup that continuously tests new generative models as they’re released and rapidly integrates the best ones into the product. However, these models are unpredictable, variable in cost, and not always production-ready. Gamma needed to safely experiment with new ideas and technologies without compromising product quality or user trust.

/ /

We A/B test every new AI model release and measure things like user conversion rates, user ratings and feedback, latency, and cost. We're a totally product-led company, and the way our business succeeds and thrives is by people hearing about Gamma virally, signing up, trying it out, and seeing something magical in the first five minutes. If we make our AI better, then that whole first five-minute experience goes better, and everything after that downstream is better for our business.

Jon Noronha

Co-founder and Chief Product Officer, Gamma

The team also wanted to involve more roles and departments in experimentation. Instead of limiting tests to a few data scientists or engineers, they envisioned a culture where everyone, from product managers to designers, could validate ideas with real users.

Solution

By integrating LaunchDarkly Experimentation with their Snowflake AI Data Cloud, Gamma built an experimentation engine capable of evaluating model performance across multiple dimensions: latency, cost, user retention, satisfaction, and downstream business metrics. LaunchDarkly became the control center, enabling small-scale rollouts, real-time model comparisons, and confident fallbacks if something went wrong. With this foundation, Gamma could architect and reinforce its budding experimentation culture.

One early example was the use of AI-generated images. Initially, the team hesitated to introduce image generation due to quality concerns that are common with AI-generated images, such as distorted hands or illegible text. However, by testing it on a small cohort of users, they discovered that the feature outperformed traditional stock photos in both user satisfaction and retention.

/ /

The real a-ha moment was when we realized we could test models against each other and measure the real user impact. Users are generating better stuff even with the same instructions. As a business, better output directly translates to higher conversion rates, higher retention, and happier customers.

Jon Noronha

Co-founder and Chief Product Officer, Gamma

Beyond model performance, Gamma uses LaunchDarkly to test various prompts, feature configurations, and UI variations. Because experiments are embedded in the product and tied directly to Snowflake data, the team can analyze outcomes like activation, upgrade rate, and feature engagement.

/ /

We can run experiments that measure real things instead of fake things. A lot of experimentation ends at clicks or page views—those aren’t the real metrics we care about. Now we can measure actual user and business outcomes.

Jon Noronha

Co-founder and Chief Product Officer, Gamma

Results

Gamma now runs experiments on an average of 20–25 AI models at any given time, testing competing models for cost, quality, and user impact.

For example, the team tested a new model (Claude 3 Haiku) against their existing setup to improve user satisfaction on longer, more complex prompts that generated 50% negative and 50% positive feedback. The test revealed a 30% increase in user satisfaction, which translated into a 20% lift in free-to-paid conversions after the feature was fully launched.

And the results go beyond technical wins. LaunchDarkly has helped Gamma scale its AI capabilities across the organization. Engineers and designers who are not AI specialists can build and test new features without waiting on a centralized team:

/ /

We want every engineer in our team to be able to integrate AI into the features that they're working on. So we've built a process where any engineer can create a new feature with AI and then roll it out using LaunchDarkly to a small set of users, test different models, and turn it off if something goes wrong. And that's what's giving us the confidence to scale to our whole team.

Jon Noronha

Co-founder and Chief Product Officer, Gamma

Safely testing and learning through experiments is naturally aligned with Gamma’s scrappy startup mentality. Instead of discussing what might work, the team now builds, ships, and tests. The result is a faster feedback loop, stronger user engagement, and a product team that keeps finding new ways to engage customers.

/ /

The biggest thing is to create a culture of just try it. There are so many ways to say no, and you have to build the structure to say yes. What are the ideas in your pipeline that you could take a chance on? It’s okay to start small. Don't be afraid to run things on 1% of your traffic, 10% of your traffic.

Jon Noronha

Co-founder and Chief Product Officer, Gamma

Today, Gamma continues to punch above its weight in a highly competitive category—not by having more resources, but by making every idea testable and every decision data-driven.

/ /

Now that we can join our LaunchDarkly experiments to our Snowflake data, we can measure real user and business outcomes. That's helped us increase the overall volume of experimentation and run more high-stakes experiments. We can take bigger risks in the kinds of AI features we build, and we can validate that they're worth it because we can see downstream impacts all the way through.

Jon Noronha

Co-founder and Chief Product Officer, Gamma

More case studies