BigQuery Data Export

Overview

This topic explains how to create and test a BigQuery destination for Data Export. BigQuery is a cloud-based data processing and analysis platform that lets you work with large sets of data. By exporting your LaunchDarkly experiment data to the same BigQuery warehouse as your other data, you can build custom reports in BigQuery to answer product behavior questions.

Create a Google Cloud service account

To begin, we recommend that you use a Google Cloud service account to provide LaunchDarkly’s export service account access to your BigQuery warehouse.

To create the service account:

1. Follow the Google Cloud instructions to create a service account.
2. When you create the account, grant it the BigQuery User role.

Then, find your LaunchDarkly export service account email address and grant it access to your newly created Google Cloud service account.

1. In LaunchDarkly, navigate to the Integrations page and find “BigQuery Data Export.”
2. Click Add integration. The “Create a destination” panel appears.
3. Copy the Export service account email address and save it for use in the next step.
4. In Google Cloud, follow the instructions to grant LaunchDarkly’s export service account access to your newly created Google Cloud service account.
5. When you grant access, assign the Service Account User and Service Account Token Creator roles.

Create staging bucket

Next, create a Google Cloud storage bucket for staging data, and grant your service account access to it.

To do this:

1. Create a Google Cloud storage bucket.
2. When you create the bucket, choose a region that matches the location of your destination dataset in BigQuery.
3. Return to the service account you created above, and grant it access to the bucket.
4. When you grant access, assign the Storage Admin role.

Configure the BigQuery Data Export integration

Finally, in LaunchDarkly, configure the BigQuery Data Export integration.

To do this:

1. In LaunchDarkly, navigate to the Integrations page and find “BigQuery Data Export.”
2. Click Add integration. The “Create a destination” panel appears.
3. Give the integration a human-readable Name.
4. Select a Project and environment to export data from.
5. Enter the BigQuery Project ID.
6. Enter the GCS bucket name.
7. Enter the GCS bucket region.
8. Enter the Destination service account email.
9. Enter the name of the BigQuery Schema the service account created.
10. Click Test connection to ensure your configuration is correct.
11. After reading the Integration Terms and Conditions, check the I have read and agree to the Integration Terms and Conditions checkbox.
12. Click Save destination. The new destination appears in the list of destinations.

Your BigQuery Data Export integration is now complete.

To view the different event kinds for BigQuery Data Export destinations, read Warehouse Data Export schema reference.