Who is the Confidence Bootcamp for?

The bootcamp is designed for anyone who wants to improve their experimentation skills. Courses are tailored for data scientists, analysts, engineers, product managers, and leaders — whether you are running your first A/B test or scaling an experimentation program across your organization.

Is the bootcamp free?

Yes, the Confidence Bootcamp is completely free. All 11 courses, 90+ lessons, and resources are available at no cost. You can start learning immediately without creating an account, though signing in lets you track your progress across devices.

The bootcamp covers the full experimentation lifecycle: A/B testing fundamentals, hypothesis formulation, interpreting experiment results, metrics design, sample size calculation, feature flags, and building an experimentation culture. It includes 11 courses with over 90 lessons built by the Confidence team at Spotify.

How long does the bootcamp take to complete?

The full bootcamp takes approximately 20 hours to complete across all 11 courses. Individual courses range from 30 minutes to 3 hours. You can learn at your own pace and pick the courses most relevant to your role.

Do I need prior experience with A/B testing or statistics?

No prior experience is required. The bootcamp starts with foundational courses like Intro to Experimentation and progressively covers more advanced topics like sequential testing and variance reduction. Each course clearly indicates which roles it is designed for.

Who created the Confidence Bootcamp?

The Confidence Bootcamp was created by the Confidence team at Spotify, the same team that builds the experimentation and feature flagging platform used across Spotify. The content reflects real-world experimentation practices used at one of the world's largest digital products.

Lesson 2: Empower experimentation champions

Summary

Champions are key individuals who amplify and spread experimentation knowledge across teams. Empowering them can help scale experimentation practices efficiently.

In this lesson, you will learn how to identify and empower champions to drive experimentation culture in your organization. Champions are individuals who are either knowledgeable or enthusiastic about experimentation. Tapping into this interest can help you scale onboarding and practices across teams.

Steps to empower champions

Identify potential champions who show interest or expertise in experimentation.
Educate and mentor them with relevant resources:
- Quickstart guides for your experimentation platform
- Foundational experimentation courses
- Videos on advanced experimentation topics
Support champions with tailored material based on their role. For instance:
- Engineers: Focus on feature flagging and rollouts.
- Data scientists: Emphasize metrics and analysis.
Facilitate recurring meetings where champions share their experiences, challenges, and learnings.
Recognize and reward champions by ensuring their efforts are acknowledged, such as using the role to support promotions.

In Confidence

Recommended resources for champions in Confidence:

A/B test quickstart: Learn how to run and interpret A/B tests.
Rollout quickstart: Use feature flags to ship features safely.
Introduction to experimentation course: Gain foundational knowledge.
Videos: Explore short videos on advanced experimentation topics.

Empowered champions become super-experimenters who inspire others and drive cultural change.

Reader exercise

What is one key benefit of empowering experimentation champions?

It reduces the workload of experimentation teams by scaling onboarding from within.

It eliminates the need for onboarding programs.

It discourages teams from running experiments.