Who is the Confidence Bootcamp for?

The bootcamp is designed for anyone who wants to improve their experimentation skills. Courses are tailored for data scientists, analysts, engineers, product managers, and leaders — whether you are running your first A/B test or scaling an experimentation program across your organization.

Is the bootcamp free?

Yes, the Confidence Bootcamp is completely free. All 11 courses, 90+ lessons, and resources are available at no cost. You can start learning immediately without creating an account, though signing in lets you track your progress across devices.

The bootcamp covers the full experimentation lifecycle: A/B testing fundamentals, hypothesis formulation, interpreting experiment results, metrics design, sample size calculation, feature flags, and building an experimentation culture. It includes 11 courses with over 90 lessons built by the Confidence team at Spotify.

How long does the bootcamp take to complete?

The full bootcamp takes approximately 20 hours to complete across all 11 courses. Individual courses range from 30 minutes to 3 hours. You can learn at your own pace and pick the courses most relevant to your role.

Do I need prior experience with A/B testing or statistics?

No prior experience is required. The bootcamp starts with foundational courses like Intro to Experimentation and progressively covers more advanced topics like sequential testing and variance reduction. Each course clearly indicates which roles it is designed for.

Who created the Confidence Bootcamp?

The Confidence Bootcamp was created by the Confidence team at Spotify, the same team that builds the experimentation and feature flagging platform used across Spotify. The content reflects real-world experimentation practices used at one of the world's largest digital products.

Videos

A/B Tests and Rollouts in Product Development

Learn about how experimentation tools like A/B tests and rollouts are used in product development with concrete examples in 3 minutes and 28 seconds.

Alpha and Power

Learn about the statistical settings alpha and power and how to set them in your experiment in 4 minutes and 30 seconds.

Evaluation Frequency

Learn about the analysis methods used for different evaluation frequencies and their pros and cons in 2 minutes and 15 seconds.

Minimum Detectable Effect

Learn about the Minimum Detectable Effect (MDE) and how to set it in your experiment in 3 minutes and 43 seconds.

Non-Inferiority Margin

Learn about the Non-Inferiority Margin (NIM) and how to set it in your experiment in 3 minutes and 44 seconds.

Control your Product with Feature Flags

This video gives a quick overview of how you can allow Confidence to control parts of your application using feature flags in 2 minutes and 10 seconds.

From Events to Metric Results

This video gives a quick overview of how you go from tracking events in your application to seeing results on the Confidence results page in 3 minutes and 17 seconds.

How to Think About Time in Metrics

This video explains how to reason about time when defining metrics in Confidence and helps you choose whether to use a time window in your metrics and whether to include users in your metrics cumulatively in 4 minutes and 34 seconds.

Targeting and Evaluation Context

This video gives a quick overview of how to increase the flexibility of who you can include and exclude in your experiments by providing more information when you resolve feature flags in 2 minutes and 10 seconds.

Surfaces in Confidence

This video introduces surfaces and how you can use them to streamline experimentation in Confidence. You learn how to organize, coordinate, and configure experiments with surfaces in 3 minutes and 26 seconds.

Access Control in Confidence

This video gives a quick overview of how to control who can see and change what in Confidence with fine-grained permissions in 3 minutes and 21 seconds.

Introduction to Experiment Coordination with Exclusivity Groups and Holdbacks

This video introduces the concepts of exclusive groups and holdbacks, and how you can use them to control which experiments overlap and which do not in 3 minutes and 57 seconds.

Advanced Experiment Coordination

This video gives examples and builds intuition for advanced experiment coordination using exclusivity groups and holdbacks across multiple surfaces in 4 minutes and 47 seconds.