IT Services - Integrate a Kaltura In-Video Quiz with the Canvas Gradebook

A Note About Reliability

More than a few users have reported problems regarding the reliability of grades being passed from a Kaltura In-Video Quiz to the Canvas gradebook. Things like ad blockers can interfere with grades being effectively recorded, and unknown factors have interfered with grades being passed to the gradebook.

With this in mind, we strongly recommend that you use in-video quizzes integrated with the Canvas gradebook for low-stakes formative assessments, not high-stakes summative assessments.

Overview

Adding in-video quiz questions to a Kaltura video won't add the quiz to the gradebook by itself. Instead, you need to create an assignment with specific settings after you've created the in-video quiz questions.

Though any Kaltura user can add in-video quiz questions to a video, you must be an instructor in a Canvas course in order to integrate an in-video quiz with the grade book.

Critical Concepts

Prerequisites

You are a Canvas instructor. To do this you must be able to create an assignment in Canvas, which requires the "instructor" role.
You already have an in-video quiz created. This article assumes that you have created an in-video quiz already. If you need to learn how to do this, see our article on creating an in-video quiz.

Caveats

Do NOT also publish the quizzes to the Media Gallery. If you are offering a video quiz that automatically reports grades to the gradebook, you should not also publish that quiz video to the Media Gallery. Students' responses will not be sent to the gradebook if they accidentally answer the questions there, but because they will have answered questions, it will count as an "attempt," at least to Kaltura (not to Canvas).
Be sure to uncheck the box that says you want the assignment to launch in its own window. Frustratingly, the default setting when creating an integrated in-video quiz assignment is that it will launch in a separate window. You will need to uncheck this box to ensure that students' answers are recorded properly.

Things to Keep in Mind

The points you assign to the assignment will be split evenly among all of the quiz questions that can be auto-graded. So if you ask 5 multiple choice and true/false questions and tell Canvas that the quiz is worth 20 points, each question will be worth 4 points.
Only multiple choice questions and true/false questions can be auto-graded. It may go without saying, but Kaltura can only automatically score multiple choice and true/false questions. Short answer and reflective questions will be excluded from the calculation. Let's say you ask 5 questions in the video: 2 true/false, 2 multiple choice, and 1 short answer question. You set the quiz to be worth 20 points. Each question will be worth 5 points (20 points ÷ 4 multiple choice and true false questions).
We recommend against including short answer questions as part of your scoring. As mentioned above, only multiple choice and true/false questions can be auto-graded. If you include short answer questions as part of the students' grades, you'll have to manually re-score every student's assignment, and you'll need to cross-reference what you see in the gradebook with each student's responses in the video analytics.
Student responses aren't visible in SpeedGrader. You have to go into the video's analytics in order to see what students actually submitted as their answer.

Steps to Take

If you're not already, log into Canvas.
1. Go to https://canvas.ucsd.edu.
2. Enter your active directory credentials.
Enter the course in question and locate the module in which you want to insert the assignment.
Click the plus icon on the row with the module's title to add a new course element to the module.
Create a new assignment.
1. Next to "Add," select Assignment from the pull-down menu.
2. Select [ Create Assignment ] within the box below the pull-down menu.
3. Type in a name for your assignment in the "Assignment Name" field.
4. Click Add Item.
After doing so, you should be brought back to the main page listing your modules.
Click on the new assignment.
Click Edit in the upper right corner of the screen.
In the assignment settings, scroll down to the pull-down menu next to "Submission Type" and select External Tool from the list.
In the box that appears below, click Find.
Scroll down and select Kaltura Video Quiz from the list of tools.
You'll be brought to a list of all the video quizzes that you've created. Select the video quiz you want to use and click </> Embed in its row.

Alternate Players

Note that the default quiz player will hide the transcript widget. If you want to select a player that includes the transcript widget below the player, click the gear icon instead of "</> Embed" and select a different player in the "choose player" pull-down menu.

After a moment, click Select back in the "Configure External Tool" window. Note that at this point you may not see your video in the rich text editor, but you will once you preview the quiz.
Once back on the page where you configure your assignment settings, uncheck the box for Load This Tool In A New Tab. It's essential that you do this to ensure that scores are properly reported from Kaltura to Canvas.
Set the rest of your assignment parameters, such as point value, due dates, and description. Ensure that the number of attempts you allow matches with the setting you've set within the in-video quiz configuration.
When you're done, click Save or Save and Publish, depending on your preference.

If you still have questions or need additional assistance, feel free to contact us at kaltura@ucsd.edu.