Why are some students missing from the Kaltura video quiz analytics in Canvas?

Quick Links: | Environment | Solution | Root Cause |

When reviewing video analytics in Kaltura, faculty members might notice that some students who have taken a Kaltura video quiz appear in the Quiz Users tab but are missing from the Analytics tab. This discrepancy can occur even though students are able to watch the video and complete the quiz without any apparent issues. This situation primarily affects those using specific web browsers and browser plugins, such as ad blockers, that can interfere with Kaltura's ability to record analytics.

Environment

  • The issue is observed among students taking Kaltura video quizzes.
  • Relevant for courses using the Canvas LMS.
  • Affects students using web browsers or plugins that block certain network requests.

Solution

To ensure all student quiz attempts are correctly recorded in both the Quiz Users and Analytics tabs, follow these steps:

  1. Inform students about the potential issue and advise them to temporarily disable ad blockers, tracking prevention, or use a different web browser when taking Kaltura video quizzes.
  2. Provide students with a list of the following endpoints that must be allowed by their browser or ad blocker:
    • kaf.canvas.csuchico.edu: Where the video content is hosted.
    • cdnapisec.kaltura.com: Handles the submission of quiz responses.
    • analytics.kaltura.com: Where analytics data is sent.
  3. Suggest that students check their ad blocker's settings to ensure the above domains are not being blocked. This can usually be done by adding the endpoints to a allowlist or disabling the ad blocker for the Canvas site.
  4. Recommend that students test their browser setup by accessing a non-graded practice Kaltura video quiz (if available) to confirm that their setup does not block analytics collection.

Root Cause

When students take a Kaltura video quiz, their browsers communicate with three primary web servers. While kaf.canvas.csuchico.edu and cdnapisec.kaltura.com are typically allowed by most browser configurations and ad blockers (enabling the video to load and quiz responses to be submitted), analytics.kaltura.com may be blocked. For example, the block list EasyPrivacy, enabled by default with most ad blockers, includes analytics.kaltura.com. This blocking prevents the analytics from being recorded, causing students to appear in the Quiz Users tab without corresponding entries in the Analytics tab. The issue arises from the use of specific web browsers and plugins designed to block tracking and analytics for privacy reasons, inadvertently affecting the functionality of educational tools.