Module 05
Experimentation and A/B testing
Turn a vague product question into a testable hypothesis, run an A/B test properly, and analyse it with the right t-test.
Outcome
What you will be able to do
You can design an A/B test, sanity-check it with an A/A test, and report a defensible result.
Lessons
Work through these in order
- 01The Research QuestionA hypothesis can be defined as "a specific, clear, and testable predictive statement about the possible outcome of a scientific study based on a particular property of a population". A research… 8 min
- 02A/B TestingThe three key concepts in A/B testing are: 8 min
- 03T-test AnalysisThe one sample t test is used to compare a sample mean to a hypothesized mean to check if the difference between the two means is statistically significant. For example the weight of a new born baby… 8 min
- 04Paired Sample t TestThe paired samples t test also known as repeated measures test is appropriate for comparing means from the same individual or objects. The two means are ussually measurements taken at different time… 8 min
Assessment
Module quiz — 70% to pass
6 questions mixing concept checks and short code-output problems. Graded on the server with per-question explanations afterwards, unlimited retakes, and a badge with a verification code the moment you pass.