A B Testing

This course requires introductory knowledge of descriptive and inferential statistics If you haven't learned these topics, or need a refresher, they are covered in the Udacity courses Inferential Statistics and Descriptive StatisticsPrior experience with

Overview of A/B TestingThis

will cover what A/B testing is and what it can be used forHow to construct a binomial confidence interval for the resultsHow to decide whether the change is worth the launch cost

Policy and Ethics for ExperimentsHow to make sure the participants of your experiments are adequately protectedWhat questions you should be asking regarding the ethicality of experimentsThe four main ethics principles to consider when designing experimen

Choosing and Characterizing MetricsLearn techniques for brainstorming metricsWhat to do when you can't measure directlyCharacteristics to consider when validating metrics

Designing an ExperimentHow to choose which users will be in your experiment and control groupWhen to limit your experiment to a subset of your entire user baseDesign decisions affect the size of your experiment

Analyzing ResultsHow to analyze the results of your experimentsRun sanity checks to catch problems with the experiment set-upCheck conclusions with multiple methods, including a binomial sign test