All Collections
Tracking the progress of your students
Monitor
Where can I see how my practice exercises are being answered by my students?
Where can I see how my practice exercises are being answered by my students?
Thijs Gillebaart avatar
Written by Thijs Gillebaart
Updated over a week ago

There are detailed analytics available for each exercise in the subjects of your course. To see the analytics of a exercise follow these steps:

  1. Go to "Monitor" via the main navigation menu

  2. Go to the "Subjects" tab.

  3. Click the subject name from the list for which you want to investigate the exercises.

  4. Click the exercise ID from the list for which you want to see detailed analytics.

In this article we will help you understand how to get to your dashboard and what you see in your dashboard. Below you can read about:

  • Data origin and availability of the data

  • Navigation

  • Aggregated analytics

  • Individual answers

Data origin and availability of the data

Which student answers are used to calculate the data?

Students can do multiple practice sessions on the same subject, receive the same exercise multiple times (in adaptive mode) and do multiple attempts per exercise. To give you the best insight on how well subjects are being mastered in your class, we use the following data to compile the aggregated analytics:

  • The latest completed practice session per student

  • The first answer given by the student on the first encounter in that practice session.

This ensures only one practice session and one answer per student is used to calculate the analytics to prevent skewing of the results by a small group of active students.

NOTE: if you would like to have more or different analytics, let us know via the chat icon in right bottom of the screen.

Availability of open answer statistics

Currently the open answer statistics are only available if the first answer given by a student to that exercise in your course happened after 25 December 2020. If one of the answers given is before that data, we cannot calculate reliable open answer or answer rule statistics at the moment.

You will be notified when this is the case in the dashboard itself, and the frequency will show "-" as value. See an example below.

You can still use the overall analytics and look at the individual answers of the students.

Navigation

Below you see an example of the subjects tab where you can click on the name of the subject to see details on the exercises.

This will show the list of exercises in the subject and a summary of their analytics. See the example below and where to click to get more detailed analytics for that exercise.

NOTE: the correctness percentage is a weighted average of the correctness score of all sub-questions.

Once you have selected a specific exercise you will get the aggregated analytics of all sub-questions in that specific exercise. Below you see an example of an open math exercise using answer rules.

For multiple choice questions the layout of the dashboard will look like the example below.

Navigating back

To get back to the overall subject dashboard, you can either click on back in the browser or use the link at the top of the page showing you where you are in your subjects dashboard. See below the highlighted link for going back to your subject overview.

Aggregated analytics

For each sub-question (independent of question type) the top row shows you aggregated analytics:

  • #received: number of students who received the question during practicing.

  • #answered: number of student who gave an answer to the exercise. The difference between #received and #answered is the number of students who skipped the exercise. The percentage shown is relative to #received.

  • #correct: number of students who answered correct and received the full points. The percentage shown is relative to #answered.

  • average points: the average number of points the students scored. This is taking into account the students who skipped the question and received 0 points.

Answer specific analytics

Below the aggregated analytics, you can see the description, question and a list of one of the following depending on the type of exercise:

  • Multiple choice answers

  • Predefined answer rules

  • Predefined open answers

Predefined answer rules and open answers

For open exercise you can specify open answers or answer rules (learn more about answer rules here). In the dashboard you can see these answers and the following information: the answer (rule) id, open answer (rule) definition, correct and frequency.

See the example below. Note that the length of the blue bar in each item is showing the frequency visually.

NOTE: The frequencies shown are relative to #answered.

If an answer rule is more complex a preview can't be shown, but you can see the details of each answer rule in the exercise edit overview by looking up the rule id listed at the left of each item.

Multiple choice answers

For multiple choice exercises you will see all predefined answers, whether they are correct or incorrect and the frequency.

Below you see an example of the analytics per multiple choice answer.

NOTE: The frequencies shown are relative to #answered.

Individual answers

In addition to seeing aggregate exercise and answer analytics, you can also view the individual answers given by students. To view the answers, click on the "Show Individual Answers" toggle button. This will load all answers given by students, so this might take some time (a couple of seconds).

Answer rules and predefined open answers

For open questions you will see the both the triggered rule id ("-" if none was triggered), their answer and whether it was marked correct or incorrect by color (green vs red). If the answer field shows a question mark icon, the student skipped the question.

See an example below.

Multiple choice questions

For multiple questions you will see their answer and whether it was marked correct or incorrect by color (green vs red). If the answer field shows a question mark icon, the student skipped the question.

See an example below.

Showing student names and ids

Optionally you can also view the name and optionally the student id of the student who gave the answer.

More analytics

Are you missing analytics or do you have ideas on how to get more information out of the current analytics? Let us know by chatting with us by clicking the chat icon in the bottom right corner of this page.

Did this answer your question?