ExperimentationManaging experiments

Editing and archiving experiments

Overview

This topic explains how to edit, clone, and archive experiments.

Edit experiments

Some, but not all, changes to an existing experiment require you to stop the experiment iteration and start a new one after your edits are complete.

Here are the changes you can make to an existing experiment:

  • You can make changes to the name of an experiment or add new metrics to an existing experiment at any time. These changes do not require starting a new experiment iteration.
  • You can make changes to the hypothesis, randomization unit, existing metrics, and audience of an running experiment, but must start a new iteration of the experiment after your changes are complete.
  • You cannot make changes to the flag or the flag variations used in an existing experiment. If you want to use a different flag or a different flag variation, you must create a new experiment.

Change an experiment name

To change an experiment’s name:

  1. Navigate to the Design tab of your experiment.
  2. Click Edit design.
  3. Edit the Name as needed.
  4. Click the checkmark icon.

Your changes are saved, and you can navigate away from the edit screen.

Change an experiment’s hypothesis, randomization unit or existing metrics

To change an experiment’s hypothesis or randomization unit, or to remove and replace existing metrics:

  1. Navigate to the Design tab of your experiment.
  2. Click Edit design.
  3. (Optional) Edit the Hypothesis as needed.
  4. (Optional) Choose a different randomization unit from the Randomize by menu as needed.
  5. (Optional) Choose different Metrics as needed.
  6. Scroll to the top of the page and click Save.
    • If the experiment was running when you made edits, a “Save experiment design?” dialog appears. Enter a reason for the change and click Save & start new iteration.

Add additional metrics

To add additional metrics to an experiment, without removing any existing metrics:

  1. Navigate to the Results tab of your experiment.
  2. Scroll to the results table and click Add.
  3. Select Metrics:

The add metric option on a running experiment.

The add metric option on a running experiment.
  1. Select additional metrics or metric groups.
  2. Click Add metrics.

If the experiment is running, the new metric will retroactively display results from the start of the experiment’s current iteration. If the experiment is not currently running, the metric will begin measuring results when you start a new iteration.

Change an experiment audience

To edit the audience of an experiment, you must stop the experiment iteration, make the audience update, and start a new iteration. This lets you select a flag variation to serve to any contexts that will no longer be included in the experiment.

To edit the audience of an experiment:

  1. Navigate to the Design tab of your experiment.
  2. Click Stop experiment. The “Stop experiment” dialog appears.
  3. Select a winning variation to serve while the experiment is stopped.
  4. Enter a Reason for stopping.
  5. Click Stop experiment.
  6. Click Edit design.
  7. Navigate to the “Audience targeting” section and update the Experiment audience as needed.
    • You can also update the Sample size if you need to change the percentage of contexts to serve the experiment to.

The "Audience targeting" section of an experiment.

The "Audience" section of an experiment.
  1. Scroll to the top of the page and click Save.
  2. Click Start to start a new iteration of the experiment.

Clone experiments

You can clone an existing experiment into a new environment and make edits to the new experiment’s configuration.

To clone an experiment:

  1. Navigate to the Experiments list.
  2. Click on the three-dot overflow menu for the experiment you want to clone.
  3. Select Clone experiment. The “Clone experiment” dialog opens.
  4. Select a destination environment for the new experiment.
  5. Click Clone experiment.

After cloning, the Design tab of the new experiment appears. Review the configuration and make any necessary edits before starting the experiment.

When you clone an experiment, the new experiment is not automatically included in any holdouts or layers. You cannot make a clone of an experiment within the same environment.

Archive experiments

You can archive experiments that have concluded, as well as the flags and metrics attached to them, but you cannot permanently delete experiments. Archiving experiments preserves the results so you can refer to them in the future.

Before you can archive an experiment:

LaunchDarkly hides archived experiments from the Experiments list. You cannot start new iterations for archived experiments.

To archive an experiment:

  1. Navigate to the Experiments list in the environment you want to archive an experiment in.
  2. Click on the name of the experiment you want to archive. The experiment detail page appears.
  3. Click Archive experiment.

To view archived experiments on the Experiments list, click View and select Archived experiments. To switch back to viewing active experiments, click View and select Active experiments.

The "View archived experiments" option on the Experiments list.

The "View archived experiments" option on the Experiments list.

To restore an experiment, click Restore experiment from the experiment details page.

When you archive or restore an experiment, LaunchDarkly sends the maintainer and anyone following the experiment an email, an in-app notification, and, if you have the Slack app integration configured, a Slack notification.

Experiment settings are environment-specific

Experiments and experiment settings are specific to single environments. If you want to run the same experiment in different environments, you must create and run the experiment in each environment individually.

You can also use the REST API: Patch experiment