Who is the Confidence Bootcamp for?

The bootcamp is designed for anyone who wants to improve their experimentation skills. Courses are tailored for data scientists, analysts, engineers, product managers, and leaders — whether you are running your first A/B test or scaling an experimentation program across your organization.

Is the bootcamp free?

Yes, the Confidence Bootcamp is completely free. All 11 courses, 90+ lessons, and resources are available at no cost. You can start learning immediately without creating an account, though signing in lets you track your progress across devices.

The bootcamp covers the full experimentation lifecycle: A/B testing fundamentals, hypothesis formulation, interpreting experiment results, metrics design, sample size calculation, feature flags, and building an experimentation culture. It includes 11 courses with over 90 lessons built by the Confidence team at Spotify.

How long does the bootcamp take to complete?

The full bootcamp takes approximately 20 hours to complete across all 11 courses. Individual courses range from 30 minutes to 3 hours. You can learn at your own pace and pick the courses most relevant to your role.

Do I need prior experience with A/B testing or statistics?

No prior experience is required. The bootcamp starts with foundational courses like Intro to Experimentation and progressively covers more advanced topics like sequential testing and variance reduction. Each course clearly indicates which roles it is designed for.

Who created the Confidence Bootcamp?

The Confidence Bootcamp was created by the Confidence team at Spotify, the same team that builds the experimentation and feature flagging platform used across Spotify. The content reflects real-world experimentation practices used at one of the world's largest digital products.

Lesson 1: Onboard new colleagues to experimentation

Summary

Onboarding new colleagues to experimentation as part of their general onboarding is a powerful way to gradually build a strong foundation of experimentation expertise across the organization.

In this lesson, you will learn how to incorporate experimentation onboarding into the onboarding programs of new colleagues. This ensures that all roles—engineers, product managers, and data scientists—are equipped with relevant experimentation knowledge and skills from day one.

At Spotify, we include experimentation onboarding by providing role-specific quickstart guides and courses. Here are some examples:

Engineers and developers

Engineers need to understand how to connect their code to the experimentation platform using feature flags, and how to ship safely with rollouts.

In Confidence

Feature flag quickstart: Hook up and control code with a feature flag.
Rollout quickstart: Ship new features safely with monitoring.
A/B test quickstart: End-to-end guide to running and interpreting A/B tests.

Product managers

Product managers benefit from understanding the A/B testing process end-to-end and the key concepts behind experimentation.

In Confidence

A/B test quickstart: Run and interpret A/B tests end-to-end.
Introduction to experimentation course
Scientific product development course

Data scientists

Data scientists need to understand how to create and configure metrics, and how the statistical analysis works.

In Confidence

Metrics quickstart: Create metrics from scratch.
A/B test quickstart: End-to-end A/B testing experience.
Introduction to experimentation course

By tailoring onboarding material for each role, we can ensure that every new joiner is equipped to contribute to our experimentation culture.

Reader exercise

Why is it important to include experimentation onboarding in the general onboarding of new colleagues?

It replaces the need for technical training.

It ensures that everyone learns experimentation practices gradually and sustainably.

It allows teams to avoid experimentation altogether.

Lesson 1: Onboard new colleagues to experimentation

Summary

Onboarding new colleagues to experimentation as part of their general onboarding is a powerful way to gradually build a strong foundation of experimentation expertise across the organization.

At Spotify, we include experimentation onboarding by providing role-specific quickstart guides and courses. Here are some examples:

Engineers and developers

Engineers need to understand how to connect their code to the experimentation platform using feature flags, and how to ship safely with rollouts.

In Confidence

Feature flag quickstart: Hook up and control code with a feature flag.
Rollout quickstart: Ship new features safely with monitoring.
A/B test quickstart: End-to-end guide to running and interpreting A/B tests.

Product managers

Product managers benefit from understanding the A/B testing process end-to-end and the key concepts behind experimentation.

In Confidence

A/B test quickstart: Run and interpret A/B tests end-to-end.
Introduction to experimentation course
Scientific product development course

Data scientists

Data scientists need to understand how to create and configure metrics, and how the statistical analysis works.

In Confidence

Metrics quickstart: Create metrics from scratch.
A/B test quickstart: End-to-end A/B testing experience.
Introduction to experimentation course

By tailoring onboarding material for each role, we can ensure that every new joiner is equipped to contribute to our experimentation culture.

Reader exercise

Why is it important to include experimentation onboarding in the general onboarding of new colleagues?

It replaces the need for technical training.

It ensures that everyone learns experimentation practices gradually and sustainably.

It allows teams to avoid experimentation altogether.