8.1. Overview of Content Experiments

This section provides an introduction to using content experiments.

8.1.1. Overview

You use content experiments to show different course content to different groups of learners. Also known as “A/B tests” or “split tests”, content experiments enable you to research and compare the performance of learners in different groups to gain insight into the relative effectiveness of your course content.

Information on analyzing events from content experiments is included in the edX Researcher Guide.

8.1.2. Courses with Multiple Content Experiments

You can run multiple content experiments in your course. You can set up each experiment to use the same groups of learners, or you can set up each experiment to be independent and use a different grouping.

Important

If your course has multiple experiments, it is critical that you decide in advance if the experiments share the same groups of learners or if each experiment has its own unique grouping. If two experiments share the same grouping, then any learner that is in Group A for the first experiment will also be in Group A for the second one. If you want the experiments to be independent, then the experiments must use different groupings so that learners are randomly assigned for each experiment.

To determine the available groupings of learners, you set up group configurations using Studio or using XML.

You then select which group configuration to use when you add a content experiment using Studio or using XML.