TL;DR
Building experimentation practices is like starting a fire with wet wood. It won't catch just because you provide a spark. You need to continuously inject energy, for a long time.
At Spotify, we aim to build products in a data-informed way. But adopting practices that conflict with existing habits takes time and effort. At the beginning, a lot of things have to be boosted and done for engineering teams rather than by them. The key to success is endurance and continuity—the smallest lighter can make any wet wood burn with sufficient time.
Even after practices are established, organizational changes and new people joining make it hard to keep things aligned. You need dedicated people to keep injecting energy and boosting the fire continuously.
Read the full post on Spotify Engineering: Search Journey Towards Better Experimentation Practices