This chapter provides detailed information about how values presented by edX Insights are computed.
The number of enrolled learners is computed every day, and the values reported on the Enrollment Activity page in edX Insights are updated every day.
For information about viewing enrollment activity data in edX Insights, see Enrollment Activity.
Enrollment metric
When the Auto Enroll option is cleared, each learner must manually complete the enrollment process for the course. Users are included as of the date and time they enroll.
When Auto Enroll is selected, each learner who already has a user account is enrolled in the course and included in the count as of the date and time the initiating team member clicks Enroll.
Learners who are automatically enrolled in a course but have not yet registered a user account are included as of the date and time that they do register their user accounts.
Enrollment Over Time chart
Enrollment Over Time report
This report includes a column for each enrollment option or certification track offered by the course. The columns that can appear for edx.org courses follow.
During edX user account registration, learners can provide demographic data about themselves. Demographic distributions are computed every day to reflect changes in course enrollment.
Currently, learners make selections from drop-down lists on the edx.org and edge.edx.org registration pages to provide demographic data.
For information about viewing learner demographic data in edX Insights, see Enrollment Demographics.
Age chart
Age band metrics
Educational Background chart
Learners can select a highest level of education completed.
Each bar in the histogram represents the percentage of enrolled users (y-axis) who selected a completion level (x-axis).
Percentages are calculated based on the number of currently enrolled learners who reported an educational level, not on the total number of enrolled learners.
The table that follows shows each edX Insights label, the option that learners can select at registration, and a brief description.
edX Insights Label | Learner Response | Description |
---|---|---|
None | None | No formal education. |
Primary | Elementary/primary school | Initial schooling lasting approximately six years. |
Middle | Junior secondary/junior high/middle school | Continuing basic education lasting two to three years. |
Secondary | Secondary/high school | More specialized preparation for continuing education or employment lasting three to four years. |
Associate | Associate degree | Completion of two years of post-secondary education. |
Bachelor’s | Bachelor’s degree | Completion of four years of post-secondary education. |
Master’s | Master’s or professional degree | Certification for advanced academic or occupationally specific education. |
Doctorate | Doctorate | Advanced qualification for original research. |
Educational Background band metrics
Learner educational backgrounds are grouped into three bands, as follows.
Band | Learner Response |
---|---|
High school diploma or less | No Formal Education, Elementary/primary school, Junior secondary/junior high/middle school, Secondary/high school |
College Degree | Associate degree, Bachelor’s degree |
Advanced Degree | Master’s or professional degree, Doctorate |
The percentage of learners in each band is computed from the number of enrolled learners who provided an educational level completed. Learners who did not provide this information at registration are not included.
Gender chart and report
For information about viewing geographic data in edX Insights, see Enrollment Geography.
Geographic Distribution map
Total Countries or Regions Represented metric
Top Country or Region by Enrollment metric
The country or region in which the largest number of users is located. The countries or regions in which the second and third largest numbers of users are located are identified as well.
For information about viewing engagement metrics in edX Insights, see Engagement with Course Content.
Active Learners Last Week metric
The number of unique users who visited any page in the course (a URL) at least once during the last update period.
Some examples of the activities that a learner can complete on a page, and that are included in this count, include contributing to a discussion topic, reading a textbook, submitting an answer to any type of problem, playing a video, and reviewing course updates on the Home page.
This metric includes all course activities, excluding enrollment and unenrollment.
This value is also expressed as a percentage of currently enrolled learners.
Watched a Video Last Week metric
Tried a Problem Last Week metric
Participated in Discussions Last Week metric
Weekly Learner Engagement graph
Video engagement data is updated every day to include video activity through the end of the previous day (23:59 UTC).
EdX Insights makes the following computations for video engagement.
For information about reviewing data for videos in edX Insights, see Engagement with Course Videos.
Video Views stacked bar chart
- The x-axis shows the sections, subsections, or units in the course.
- The y-axis shows the average number of times videos in this section or subsection were viewed, or the total number for individual videos in a unit. The lower part of each bar, shaded green, shows the number of learners who started playing the video and were also playing the video at the point in the video near the end (complete views of the video). The upper area of the bar, shaded gray, shows the number of learners who started playing the video minus the number who were playing the video near its end (incomplete views of the video).
Total Video Views stacked area chart
- The area shaded in lighter blue represents the number of unique users who played that segment of the video.
- The area shaded in darker blue represents the number of additional views, or replays, of that segment of the video.
Video metrics
Learner answer data is available only for problems of these types.
<choiceresponse>
)<optionresponse>
)<multiplechoiceresponse>
)<numericalresponse>
)<stringresponse>
)<formularesponse>
)For information about the problem types that can be included in courses and their settings, see Creating Exercises and Tools.
Checkbox, multiple choice, and numerical input problems can be set up to award partial credit. When a learner receives either full or partial credit for a problem, Insights includes that answer as completely correct.
For data to be available for a problem, at least one learner must have submitted an answer for that problem after 6 Mar 2014.
Computations are updated daily.
Only a learner’s last submission, or attempt to answer, is included in the computation. Any attempts prior to the last submission are not included.
Computations for graded content include only problems for which learners can click Submit to submit their responses. If learners can only save their responses without submitting them (that is, if the Maximum Attempts for the problem is set to 0), data is not available for learner submission computations.
Only problem activity that occurred after 23 Oct 2013 is included.
Graded Content Submissions .csv file
The .csv file contains a superset of the data that is included in the Submission Counts chart and report. The .csv file contains the following columns.
Column | Description |
---|---|
answer_value |
The text label of the answer choice for checkboxes, dropdown, and multiple choice problems. The value entered by the learner for text input, numerical input, and math expression input problems. Answer choices selected by at least one learner after 23 Oct 2013, but
not selected after 6 Mar 2014, do not include an |
consolidated_variant |
TRUE if the Studio Randomization setting for this problem component is set to Always, On Reset, or Per Learner, but there is no variation in the possible answers. Often, this indicates that the Python script that randomizes values for the problem is not present, or that the multiple choice problem is not currently set up to shuffle the answer options. FALSE if the Studio Randomization setting for this problem component is set to Never (the default) or if the Python script or multiple choice question is randomizing values. |
correct |
TRUE if this answer value is correct. FALSE if this answer value is incorrect. |
count |
The number of learners who entered or selected this answer. Only the most recent attempt submitted for the problem or problem variant by each learner is included in the count. The count reflects the entire problem history. If you change a problem after it is released, it might not be possible for you to determine which answers were given before and after you made the change. |
course_id |
The identifier for the course run. |
created |
The date and time of the computation. |
module_id |
The internal identifier for the problem component. |
part_id |
For a problem component that contains multiple questions, the internal identifier for each question. For a problem component that contains a single question, the internal identifier of that problem. |
problem_display_name |
The display name defined for the problem. |
question_text |
The accessible label that appears above the answer choices or the value entry field for the problem. In the Studio simple editor, this text is surrounded by two pairs of angle brackets (>>Question<<). Blank for questions that do not have an accessible label. For problems that use the Randomization setting in Studio, if a
particular answer has not been selected since 6 Mar 2014, the
|
value_id |
The internal identifier for the answer choice provided for checkboxes and multiple choice problems. Blank for dropdown, numerical input, text input, and math expression input problems. |
variant |
For problems that use the Randomization setting in Studio, the unique identifier for a variant of the problem. Blank for problems that have this setting defined as Never (the default). |
After you download the .csv file, be aware that different spreadsheet applications can display the same data in different ways.
If you notice characters that do not display as expected, or multiple lines
that have the same answer_value
but different counts, try opening the file
in a different spreadsheet application or a text editor.
For information about the report and charts that are available in Insights for individual learner activities, see Learner Activity.
<choiceresponse>
)<optionresponse>
)<multiplechoiceresponse>
)<numericalresponse>
)<stringresponse>
)<formularesponse>
)The data that edX collects from learner interactions has expanded over time to capture increasingly specific information, and continues to expand as we add new features to the platform. As a result, more data is available for courses that are running now, or that ran recently, than for courses that ran in the past. Not all data for every value reported by edX Insights is available for every course run.
In the following situations, data might not be available in edX Insights.