Quizzing Engine

Overview

This feature allows Learndot Administrators to build quizzes natively within the Learndot ecosystem. Add questions and/or quizzes to your respective pools. Assign the quiz to your learners via the assessment component and gain granular analytics from your learners performances. 

The Quizzing feature was built with flexibility in mind, using a lego like approach. Quizzing feature allows Administrators to create questions without creating a quiz first, and also create a quiz without associating it to an Assessment component. An administrator can create any question and come back on a later note to complete it. 

Create a Question

This is the first step in building your quiz. Administrators or contacts with the right permissions can create Questions in the native Quizzing engine in Learndot. Questions can be created in the Questions Pool. This is where all your questions are located for easy management. The questions pool is found by clicking:

  • Catalog > Questions Pool

  • This is your questions pool. All your created questions appear here. You can create new questions by pressing Create

Easily filter through your questions pool using Find by Title, Content, Question Type, Publish Status, or Tags. 

  • After pressing Create to add a new Question to your pool
    • Add a title to your question
    • Click the "+" sign to select a question type

  • Learndot offers a wide range of self-grading question types
  • For illustration purposes, let's create a simple Multiple Choice question. 

Self grading question types include Mutliple Choice, Fill in the Blanks, Classify, Match & Order, Highlight, Written (not graded), Rating (not graded). 

  • Proceed to write the question on the WYSIWYG editor
  • Enter the answers you want the learners to select from

  • Set the amount of points/score you want to give for the correct answer
  • Select which is the correct answer

You can reposition the answers by using the simple drag option. And you can also Add or Delete answers based out of your need. 

Shuffle items check-box allow the answers to be shuffled each time for the learners. 

Multiple responses allow learners to select more than one answer. 

  • More options contain additional settings that can be used if desired

  • Remember to press Save to ensure you have saved all recent changes made your questions

  • You will be redirected back to the Questions screen 
  • To create a new question; navigate back to the Questions Pool by pressing Back then Create another question of your choice

Adding Hints to your Questions

Hints are used to give learners a slight reminder on what the possible answer could be. Adding hints to your questions is very simple. Hints appear (if configured) in the Learner UI when learners are answering questions. To configure hints:

  • Navigate to any existing questions or create a new question to add a hint. For illustration purposes, we'll reuse the above question
  • From your Questions pool, locate and open the question
  • Click on the Pencil icon to edit the question

  • Scroll down to More Options
  • Under Hints > type the hint that you want to display for your learners when clicked
  • One question can only have one hint configured

  • That's it, always remember to save any changes you do to existing or new questions

Learners view of Hints

As a learner, when you are answering a quiz, the questions that contain hints will automatically show a hint button placed in the question itself like below:

When the learner presses the hint button, a hint will be displayed to them. This is the hint that the Administrator configured. 

Once the learner has chosen an answer, the hint will disappear. However, the learner can click the hint button as many times as they would like


Adding Feedback to your Questions

Feedbacks give administrators a chance to allow learners to check their answers before proceed to the next question. Feedback allows administrators to let the learners know what they are choosing as an answer is a correct answer or not. Adding feedback to your questions' answers is very simple. Feedbacks appear (if configured) in the Learner UI when learners are answering questions. To configure feedback:

  • Navigate to any existing questions or create a new question to add a hint. For illustration purposes, we'll reuse the above question
  • From your Questions pool, locate and open the question
  • Click on the Pencil icon to edit the question

  • Scroll down to More Options
  • Under Extras > Click Add to provide a response feedback which will be displayed to your learners when they choose to check their answers

  • Each response feedback is tied to the answer itself (example, response feedback 1 is tied to the first answer, response feedback 2 is tied to the second answer and so forth. Even though you may choose to Shuffle the answers, the correct feedback will always be shown)
  • Tick the Check answer button check-box

You can also configure to allow learners to check their answers for only a certain amount of attempts, after which the learner will not be able to check their answers.

  • That's it, always remember to save any changes you do to existing or new questions.
  • The Feedback answers can not be tested under the "Preview" tab. In order to test it, please go to the Learner UI.

Learners view of Feedback

As a learner, when you are answering the quiz, questions that allow feedback will show them when check my answer button is pressed, like below:

  • Depending on the answer selected, the respective feedback will be shown. For instance, if the answer that the learner gave was incorrect, then the corresponding feedback is shown

  • Or, if the given answer is correct then the respective feedback will be shown

 

Modifying an existing Question

When you want to modify an existing question, when you open the question from your pool, if the question is used in existing quizzes, there will be a message displayed indicating that the question is used elsewhere (and in how many other quizzes).

It is important to note that modifying the question would modify any existing quizzes that use the question.

  • Click the Pencil icon to edit an existing question

 


Archive an existing question

To archive a question, navigate to your questions pool and select a question. 

Our quizzing engine currently does not support deleting questions, it only supports archiving individual questions.

 

  • Proceed to click the setting button

  • Select the details tab 
    • Change the Status to Archived from Published

  • Press Apply to save changes

  • Press Save to commit the changes such that it reflects in your questions pool

 

  • Press back to go to your questions pool
  • The question will no longer be there, as it has been archived

Finding back archived questions

To find back an archived question, simply:

  • Click the "Find by title" dropdown and change the criteria to Status: Archived
  • Press the magnifying icon to search and list all previously archived questions

  • All archived questions will be displayed

If you would like to recall a previously archived question, simply go through the same steps but this time around, change the status to Published instead of Archived. 


Create a Quiz

After you have successfully created all your questions, you can create a Quiz and add your questions to it. To create a Quiz:

  • Select the Quiz Pool tab if you already in the Questions Pool or navigate to the quiz pool from your Catalog > Quizzes Pool 

Easily filter through your quizzes pool using Find by Content or Tags. 

  • Press Create to add a new Quiz to the pool
    • Give your Quiz a title
    • Next, add the questions to the Quiz

Add Questions to the Quiz 

Click "Find Items" to select and add already built questions to your Quiz

  • Select the checkbox for each question you wanted to add to the Quiz

Easily filter through your questions using Find by Title, Content, Question Type, or Tags. 

  • Click on Add Items button to add the questions to the quiz you are creating

  • A success message will be displayed once the questions (items) have been associated to the Quiz. Press back to return to the Quiz.

If you want to reposition the questions, simply drag them in the order you would like. 

If you want to delete any questions, simply mark the checkbox next to the question number and the Remove button will be available (by default it is greyed out). 

Always remember to press Save after you create the quiz or edit the quiz to reflect the latest. 

  • Press Back after you have saved to return to the quiz pool

Create a new question from within the Quiz

You can now create a question from directly within the quiz. To do so, simply navigate to the quiz of your choice or create a new one. For illustration purposes, we will reuse an existing quiz. 

  • Click the "+Create Item" button to add a new question

  • Proceed to add the question and press back to navigate back to your quiz

  • Repeat the steps to add more questions, always remember to save to commit the changes

Edit a question from within the Quiz

You can now also edit existing questions from within the quiz.

  • Notice how the question highlights once you have hovered over it. Proceed to click the question to make changes to it

  • After making changes to the question, remember to press save to commit the changes and press back to navigate back to your quiz

Any new questions added or edits made to questions that are part of the quiz which is already live will only take effect for new enrollments. 

Archive an existing quiz

To archive a quiz, navigate to your quiz pool and select a quiz

Our quizzing engine currently only supports archiving individual questions as of now. 

  • Select the quiz and navigate to the Details tab

  • Change the Status to Archived from Published
  • Press Save to commit the changes such that it reflects in your quizzes pool.
  • Upon refreshing the quizzes pool, the quiz will no longer be located in your quiz pool. 

As an administrator, archiving a quiz that is actively being used by an assessment component will cause the learners to see an error on their learner dashboard when trying to take the quiz. 

It is suggested that a new quiz should be re-associated with the assessment component if the quiz is archived from the quiz pool. 

Additional Quiz configuration

When configuring the quiz, there are three additional tabs (Player, Details, Tags) along with the Items tab where the Administrator can configure additional settings for the quiz, if desired. 

Player tab

Here you can configure things like:

  • Title: Enter a Title for your player, which will appear in the learners view
  • Subtitle: Enter a subtitle for your player, which will appear in the learners view
  • Shuffle items: Tick the box to shuffle the questions in random order each time the learner loads the quiz
  • Reading Time: Configure the amount of Hours and/or Minutes to provide your learners with to only read through the quiz without actually being able to answer anything
  • Activity Time: When you add information to this area, you'll be limiting the number of hours or minutes users can take to complete the whole quiz. With this enabled, the user sees the completion time and the actual time running:

     

    • Warn on 60 seconds remaining: using this option, the clock turns red when there are only 60 minutes to complete the quiz:


    • Force submit after time expires: using this option, the system submits the answers completed so far when the time they should use to complete the quiz is done:





You can use the Preview function to check how the assessment looks like before publishing. 

By using the Preview function, the admin can check what the questions would look like on the Learner UI. On the Preview function, when using the "Check Answers" button, it will show only the right/wrong answer. It will not display the Response Feedback when you have that option enabled. To check those, please test it directly into the Learner UI.

Preview View:

Learner UI view:



Details tab

Here you can configure things like:

  • Title: The title of the quiz
  • Description: Provide a description for the quiz

Customize text labels

Within each quiz, you are able to customize the text that appears to the learners when they are consuming the quiz. To change the label text, simply:

  • Navigate to any quiz and open the Player tab
  • Select the Customize text labels

  • A list of accordion options allow you to change the text that appear in Buttons, Messaging, Title, Tooltips, and Others

  • If you make a change, make sure that you hit save to commit the changes, and you can preview to see the changes in action. 

Tag tab

When creatinga question, at the bottom of the page, you can add a tag to it and, if it's a new one, it will be created automatically:

Once the tag is created, when you navigate on the Tag tab on the Setting area, you can oversee the tags related to that question. You can also delete them, and search for news one to be added. On this area you can not create new tags. To do that, you need to go back to the question and click on Edit, and create a new one on the bottom of the page, on the Tag area:


Customize text labels

Within each quiz, you are able to customize the text that appears to the learners when they are consuming the quiz. To change the label text, simply:

  • Navigate to any quiz and open the Pla

Link Quiz to Assessment Component

Quizzes can be linked to the Assessment component such that certificates can be issued, if that is the desired behavior. Linking a quiz to the assessment component is similar to linking a SCORM package to an elearning component. To do this:

  • Navigate to the assessment component

  • Create a new assessment component or use an existing assessment component

If an existing assessment component is already associated with a SCORM package, it cannot be re-associated with a quiz created in Learndot. A quiz can only be replaced by another quiz; similar to SCORM

  • Ensure that the Mark complete by is set to "Learner cannot mark complete; needs to complete the exam*". This will ensure that the automated grading happens immediately after the learner completes the quiz.

  • Navigate back to the assessment page
  • Click Add Quiz

  • Press Select quiz to add an existing quiz to the assessment component
  • Enter a passing score to automatically grade the learner as completed or failed depending on their achieved total score. By default the passing score is set to 100%

If you wanted to make any last minute changes before associating the quiz with the assessment component, both the Questions & Quizzes Pools are available in tabbed views for easy access.

  • Press Save to associate the quiz to the assessment component

  • A success message is displayed along with the Quiz Title, Passing Score and Quiz ID (UUID)

Configuring Reviews and Retakes

The assessment component supports reviews and retakes as well. To configure:

  • Create or edit an existing assessment component
  • Under the Constraints section
    • Maximum number of attempts: The maximum amount of attempts the learner is allowed whether they passed or failed the quiz
    • Allow Review: Allow your learners to review their previous attempt

Note that Review and retake configured on Assessments only work for new enrollments. Any existing enrollments will follow the review and retake configured before. 

Learner View (Taking a Quiz)

When learners login and go to their dashboard, they will find an assessment card in their dashboard (if they are enrolled into it). 

  • To start the assessment, click on the card

  • The assessment will load and the learner will see a Start button

Notice how (if configured) the Player Title and Player Subtitle appear. These are configured under the Player tab in the Quiz itself. 

  • Click Start to begin
  • After you have completed all questions, press Finish

  • A submit activity dialog will appear > click Yes if you want to submit your assessment

  • Once your assessment is successfully submitted, press Close

 

  • The page will refresh and your Score and the Time spent will be available

If Retakes and Reviews are configured, the options will be available for the learner. This is useful for the learner in case they failed in the first attempt and the assessment allowed retakes. 

The Retake button will be available and usable until the Maximum number of attempts configured by the administrator on the Assessment component level has reached.

The Review button will be available infinitely if Allow Review was set to yes on the Assessment component level.

If the learner failed the assessment they would see the enrollment status as Failed instead of completed

Reviewing your Quiz

As a learner you can review the quiz by clicking on the Review button.

  • A prompt will be displayed to confirm that you want to review the quiz

  • In review mode, only the answers that the learner gave will be visible, whether they were correct or incorrect will also be shown

  • A learner can review their quiz as many times as they would like

Retaking a Quiz

As a learner you can retake the quiz by clicking on the Retake button.

  • A prompt will be displayed to confirm that you want to retake the quiz

  • When the learner clicks "Yes, I want to retake", Learndot will create a brand new enrollment for the learner so that it is counted as a separate session

  • A success message is shown indicating to the learner that a new enrollment has been created. At the same time, the enrollment is marked as "Confirmed" and the learner can begin retaking the quiz

Under the Assessment page; there will now be 2 separate enrollments of the same learner since they chose to retake.

Viewing Learner Metrics as an Administrator

Each enrollment will contain information that is helpful to understand what result did the learner achieve. 

  • As an administrator, navigate to the Enrollment section and open an existing learner enrollment (or, go the assessment component and view the enrollment from within the component)
  • The status is visible from here. This is whether the learner "Completed" or "Failed"
  • To get more insights into their scoring, click on the sessions link

  • Here you can see:
    • Score: What was the total score achieved by the learner
    • Passing Score: The passing score set by the administrator
    • Raw Score: This is total points achieved by the learner (of all correct answers)
    • Max Score: This is the total points of all questions in the quiz
    • Time Spent: The time spent by the learner during the quiz

Frequently Asked Questions (FAQs)

  1. How do unscored questions work? 

When setting the question to be unscored, it will grey out the Points field used to dictate how many points should a learner get if answered correctly. This means, no score(s) will be sent back to Learndot to determine whether the learner completed or failed the assessment. 

When using only unscored questions in a quiz, make sure that the assessment passing score is set to zero. This will allow the learners to complete the practise assessment without failing.