Who is the Confidence Bootcamp for?

The bootcamp is designed for anyone who wants to improve their experimentation skills. Courses are tailored for data scientists, analysts, engineers, product managers, and leaders — whether you are running your first A/B test or scaling an experimentation program across your organization.

Is the bootcamp free?

Yes, the Confidence Bootcamp is completely free. All 11 courses, 90+ lessons, and resources are available at no cost. You can start learning immediately without creating an account, though signing in lets you track your progress across devices.

The bootcamp covers the full experimentation lifecycle: A/B testing fundamentals, hypothesis formulation, interpreting experiment results, metrics design, sample size calculation, feature flags, and building an experimentation culture. It includes 11 courses with over 90 lessons built by the Confidence team at Spotify.

How long does the bootcamp take to complete?

The full bootcamp takes approximately 20 hours to complete across all 11 courses. Individual courses range from 30 minutes to 3 hours. You can learn at your own pace and pick the courses most relevant to your role.

Do I need prior experience with A/B testing or statistics?

No prior experience is required. The bootcamp starts with foundational courses like Intro to Experimentation and progressively covers more advanced topics like sequential testing and variance reduction. Each course clearly indicates which roles it is designed for.

Who created the Confidence Bootcamp?

The Confidence Bootcamp was created by the Confidence team at Spotify, the same team that builds the experimentation and feature flagging platform used across Spotify. The content reflects real-world experimentation practices used at one of the world's largest digital products.

Lesson 3: Sustain an experimentation culture

Summary

Forums and experimentation drives are effective ways to sustain long-term engagement and energy for experimentation across an organization.

In this lesson, you will learn how to use forums and experimentation drives to keep the experimentation culture thriving. These practices provide a platform for sharing ideas, solving challenges, and driving collaboration.

Experimentation forums

Regular forums are a great way to inject energy into the experimentation culture. Forums can include:

Discussions on current or planned experiments.
Sharing metrics and results interpretation strategies.
Addressing challenges like sample size and hypothesis testing.

Experimentation drives

Dedicated time slots, such as hack weeks, help teams focus on experimentation. Example activities include:

Creating feature flags and metrics.
Running A/A tests to validate your setup end-to-end.

In Confidence

For Confidence users, running A/A tests using the A/B test quickstart is a great hands-on exercise during experimentation drives.

By combining forums for inspiration with hands-on experimentation drives, you can create a self-sustaining culture of experimentation.

Reader exercise

What is the purpose of experimentation drives?

To distract teams from their regular work.

To provide focused time for teams to get started with experimentation.

To increase the number of experiments without any planning.