Skip to content
  • Pricing
  • Success stories
  • Blog
  • Bootcamp
  • Contact us
  • Login
Start free trial
February 28, 2022· Updated May 12, 2026/Claire Detilleux, Senior Data Scientist

Search Journey Towards Better Experimentation Practices

Building experimentation practices takes sustained effort. How the Spotify Search team went from ad hoc testing to data-informed product development.

Timeline of icons representing experimentation stages from discovery through analysis to testing on an orange background

Want to experiment like Spotify? Sign up for a 30 day free trial.

Start your free trial

TL;DR

Building experimentation practices is like starting a fire with wet wood. It won't catch just because you provide a spark. You need to continuously inject energy, for a long time.

At Spotify, we aim to build products in a data-informed way. But adopting practices that conflict with existing habits takes time and effort. At the beginning, a lot of things have to be boosted and done for engineering teams rather than by them. The key to success is endurance and continuity—the smallest lighter can make any wet wood burn with sufficient time.

Even after practices are established, organizational changes and new people joining make it hard to keep things aligned. You need dedicated people to keep injecting energy and boosting the fire continuously.

Read the full post on Spotify Engineering: Search Journey Towards Better Experimentation Practices

PreviousChoosing a Sequential Testing Framework — Comparisons and Discussions
Spotify

Learn more

  • Read our blog
  • Take the bootcamp
  • See comparisons
  • Glossary
  • RFP guides
  • Listen to us
  • Read our docs
  • Status page

Need help

  • Contact us

Legal

  • Terms of Service
  • Data Protection Agreement
  • Privacy Policy

© 2026 Spotify

The Confidence name and logo are registered trademarks of Spotify.