Shipping the winning variation
Overview
This topic explains how to choose and ship a winning variation for a completed Bayesian experiment.
To learn about winning variations in frequentist experiments, read Frequentist experiment results.
For experiments using Bayesian statistics, the winning variation is typically the treatment with the highest probability of being the best among those that show a significant high probability of beating the control. If a Bayesian experiment has collected enough data to determine a winning variation, and the winning variation is not the control, then the winning variation is highlighted in green on the Results tab.
If all treatment variations have a significantly low probability of beating the control, then the control is considered the winning variation. To learn more, read Decision making with Bayesian statistics.
Ship the winning variation
To stop an experiment and ship the winning variation:
- Navigate to the experiment’s Results tab.
- Click Stop.
- Select the winning variation.
- Enter a Reason for stopping.
- Click Stop experiment.
Certain Bayesian experiments will display a Ship it button when the experiment has enough data to determine a winning variation. You can also use this option to stop the experiment and ship the winning variation.