Advance your experimentation
In this course, you learn about ways to advance your experimentation practices and take your learnings from experiments to the next level. This includes building intuition for and learning how to use the settings in Confidence to achieve more efficient experiments, better learnings, and more sophisticated risk management.
There are reader exercises at the end of each lesson that helps you check your understanding. Answer all questions correctly to finish the lesson and track your progress.
This course consists of the following lessons:
Lesson 1: Guardrail metrics with non-inferiority margins
Learn how to improve the quality of your decisions and the risk management of your experiments by using guardrail metrics with non-inferiority margins.
Lesson 2: Choose evaluation frequency
Learn about the trade-offs between these settings and optimize your experimentation by choosing the configuration that fits your needs.
Lesson 3: Metrics' roles in experiments
Learn about how to use the different kinds of metrics in Confidence to optimize your experimentation efficiency.
Lesson 4: Cumulative holdback evaluations
Learn how to measure the combined impact of all changes shipped during a quarter using holdback groups.