The CLE uses the term “Quiz,” for the activity, but do not be mistaken – the Quiz activity is a robust online assessment tool that can be used for self-evaluations, tests, exams, mid-terms, and finals.
A quiz is made up of a combination of question types, including multiple-choice, true-false, short answer, essay, and more. The Quiz activity pulls questions from a question bank, which faculty and course staff can use to create, preview, edit, and organize questions in any number of categories.
After students have completed a quiz, faculty and course staff have access to a number of reports, including a statistical analysis of the quiz. The majority of question-types are automatically graded in the CLE, except for essay questions that require manual grading.
Audience: Managers, Instructors, Course Assistants, Content Assistants, and Grading Assistants.
Create a quiz
Creating a quiz in the CLE is a two-part process. The instructions below cover the first part – adding a quiz to a CLE course and configuring the quiz settings. The second part of the quiz-making process is adding questions to the quiz, which is covered in the Add Questions tab above. Visit Moodle Docs to view an abbreviated quick guide for managing the Quiz activity.
Let’s create a final exam in our CLE course using the Quiz activity. Here is the criterion for the final exam:
- Students can start the final exam on October 12 at 8am and must finish by October 12 at 5pm
- Students have a 120-minute time limit to complete the final exam and are allowed only one attempt
- Students will be able to see their final exam score after the exam closes on October 12 at 5pm and can review their attempt for 24 hours after the close time
To add a quiz to a CLE course:
- Log in to the CLE (cle.ucsf.edu)
- Go to the CLE course where you would like to add the quiz
- From the gear icon at the top-right, select Turn editing on
- In the section where the quiz should be located, click the Add an activity or resource link (you can always move the quiz to another location later)
- From the list of Activities and Resources, select Quiz, then scroll to the bottom of the window and click Add
Continue creating the quiz up on the Adding a new Quiz page as documented below. Click a link below to skip to a specific section on the Edit Settings page:
Configure general information for the quiz, such as a name and quiz description.
- Click the Expand all link to expand all sections on the Edit Settings page
- The Name will appear on the home page of the course, navigation menu, logs, and other areas that link to the quiz
- In the Description field type instructions, background information, an honor code, etc., for the quiz. Select to Display description on course page checkbox to display the text directly on the CLE course page, below the quiz name
Configure when students can attempt the quiz, set a time limit, and configure other time-related settings.
- Choose to specify a window of time when students can attempt the quiz. Prior to the open time, students will not see a Start Attempt button and will not be able to attempt the quiz Students must also complete the quiz by the time entered in the close time. To configure an Open and Close time, first select the enable checkbox and then enter the times and dates
- By default quizzes do not have a time limit, which provides students with as much time as they need to complete the quiz, or within the Open and Close times if enabled. Select the enable checkbox to enter a time limit (in minutes) for the quiz. Note that the quiz will close when the time limit expires or when the student reaches the close time, whichever comes first
- Choose what happens when time expires during a quiz. The default Open attempts are submitted automatically is recommended as this is how a student typically expect a quiz to behave when the time limit or close time approaches
- If you have selected There is a grace period when open attempts can be submitted, but no more questions answered from the When Time Expires drop-down, enter a grace period in the Submission grade period field
Configure grade settings for the quiz as well as where the activity displays in the gradebook.
- If you use gradebook categories in the course, assign the quiz to a Grade category using the drop-down
- Faculty typically leave the Attempts allowed set to the default one attempt for graded quizzes. You can provide students with as many attempts as you like, even unlimited
- If the quiz allows multiple attempts, choose a Grading method, or how the attempts will be scored and reported in the gradebook (e.g. highest grade, average grade, first, last attempt)
Choose how questions display in the quiz and other navigation options. Click the Show more… link to expand the section as shown below.
- Choose how questions display in the quiz from the Question Order drop-down. Choose the default setting Shuffled randomly or As shown on screen
- Configure pagination for the quiz, or how many questions are displayed on each page from the New Page drop-down. You can manually override this later in the quiz-making process while adding questions to the quiz. For quizzes that contain essay questions, we recommend re-paginating at Every question so responses are saved as students move from question to question
- When Sequential navigation is used as the Navigation method, a student must progress through the quiz question-by-question and may not return to a previous pages nor skip ahead. The default setting is Free, which allows students to move back and forth in a quiz
Question behavior section
Configure whether responses are shuffled within questions, how questions behave, and whether multiple attempts build upon the last. Click the Show more… link to expand the section as shown below.
- If Shuffle within questions is set to Yes, the question responses will be randomly shuffled for students, provided the option is also enabled in the question settings. This setting only applies to questions that have multiple parts, such as multiple choice or matching questions.
- How questions behave: Most quizzes use the default setting Deferred feedback, which means students must complete the quiz before they receive any feedback or grades. There are other Question Behaviors that can be applied to CLE quizzes and you can read more about each below and on the Moodle Docs Question behaviors document
- Deferred feedback: Students must enter an answer to each question and then submit the entire quiz before anything is graded or they get any feedback.
- Adaptive mode and Adaptive mode (no penalties): Students have multiple attempts at the question before moving on to the next question. This behavior requires that the Whether correct box is ticked under During the attempt in the Review options section, at a minimum
- Interactive mode: Students see a Try again button next to each question during the attempt that they can click to receive hints to help answer the question. Once the student has answered the question correctly, they can no longer change their response. Once the student has answered the question incorrectly too many times, they can no longer change their answer. The number of tries the student gets is equal to the number of hints configured for the question, plus one
- Immediate feedback: Similar to interactive mode in that the student can submit their response immediately during the quiz attempt, and get it graded. However, they can only submit one response, and they cannot change it later
- Deferred feedback or Immediate feedback with Certainty-based marking (CBM): Students not only answer the question, but also indicate how confident they are they answered the question right. The grading is adjusted by the choice of certainty, so that students must reflect honestly on their own level of knowledge in order to get the best mark
- If multiple attempts are allowed and Each attempt builds on the last is set to Yes, each new quiz attempt will contain the results of the previous attempt. This allows a quiz to be completed over several attempts and is helpful if students experience technical problems during an online exam
Review options section
Select the information you want students to see at different times during and after the quiz attempt.
Each of the four columns highlighted in the picture above represent a different time during the quiz and are explained below (remember to reference the Open and Close times we configured in the Timing section above):
During the attempt
What students can see and review during an attempt – this column is only relevant for certain Question Behavior modes.
Immediately after the attempt
What students can see and review during a two-minute window of time immediately after submitting an attempt.
Later, while the quiz is still open
What students can see and review following the two-minute window following submitting an attempt, until the quiz close time of October 12 at 5pm.
After the quiz is closed
What students can see and review after the close time has passed on October 12 at 5pm.
Each checkbox controls what a student can see during these times and are explained below:
The Points checkboxes are not selected by default and quiz grades are not available to students in the gradebook or during a quiz review. To make quiz scores available to students in the gradebook, select the Points checkbox in the appropriate columns depending on when you want students to see their grades and any feedback.
For the final exam, we want students to be able to review all feedback after submitting the quiz, but we do not want to provide Points (question and quiz grades) or the Correct answers until the quiz has closed on October 12 at 5pm. The Review Options shown above reflect this set up.
Configure display settings for the quiz. Click the Show more… link to expand the section as shown below.
- Select to Show the user’s picture during the quiz attempt – this is helpful when proctoring a CLE quiz
- Choose the number of Decimal places in grades that are displayed in the gradebook for the overall quiz. This only affects the display of grades, not the grades stored in the database, nor the internal calculations, which are carried out to full accuracy
- Choose the number of Decimal places in question grades that is displayed for individual questions
- Select whether to Show block during quiz attempts. We recommend using the default setting No, which will prevent blocks such as the Navigation and Administration blocks from displaying during the quiz attempt
Extra Restrictions on Attempts Section
Configure security restrictions for the quiz. Click the Show more… link to expand the section as shown below.
- Enter a password that students must enter to start the quiz. This is a good practice for high-stakes, proctored exams. We will protect the final exam with the password UCSF
- Choose to restrict access to an IP range using the Require network address setting. We discourage using this setting due to the number of ways students can access the CLE and a quiz. Restricting access to an IP range on the UCSF WPA network would prevent students using the UCSF Guest network or cellular data from attempting the quiz. We recommend using a password to restrict access to a CLE quiz
- If you allow multiple attempts for the quiz, choose to Enforce timed delays between attempts
Overall Feedback Section
Enter Overall feedback for grade boundaries that is provided to students after they have completed the quiz.
- In the example above, we have entered Overall Feedback for the grade range from 100%-70%
- We can continue to enter Overall Feedback for grade range from 69%-0%. Keep in mind we can also include multimedia such as videos, images, or links to outside resources in addition to text feedback
Commons Module Settings Section
Configure whether the quiz is visible on the CLE course page, use a Group Mode, and restrict access to a Grouping.
- Choose whether the quiz displays on the main course page (we can always change this from the CLE course page)
- Enter an ID number to provide a way of identifying the activity for grade calculation purposes. We will leave this field blank for the final exam
- Apply a Group mode to the quiz to organize students into Groups for grading purposes. For example, there are 150 students and 5 graders in the course. We can create 5 Groups of students based on the course graders, and apply either the Separate or Visible Groups mode (choose either) to split up grading responsibilities. Graders will see the Group names in a drop-down menu when grading the quiz, and can choose to view and grade only the students who have been assigned to their Group. Click to read more about Groups
- We can restrict the ability to access a quiz to a Grouping that has been created in a course. Groupings are often used when students are taking the same course for a different number of units, and activities such as quizzes may be worth more or less, depending on their Grouping. Selecting the Available for group members only checkbox will prevent students not assigned to the Grouping from seeing or accessing the quiz link on the main course page
Restrict Access Section
Restrict student access to a quiz, or when students can see the final exam link on the CLE course page, based on a number of different criterion (this is sometimes referred to as “conditional release”).
- Click the Add a restriction button to configure when students can see the quiz link on the CLE course page, based on any combination of activity completion, date, grade, user profile, and more
- For the final exam, we will restrict access by date only. Why would we want to restrict access to the final exam in addition to having open and close times? Open and close times refer to the window of time when students can start and end the quiz, while restrict access refers to when the quiz link displays on the course page. Remember we allow students to review the final exam for 24 hours after the quiz has closed. By restricting access to the final exam after October 17 at 5pm (24 hours after the close time), we can control the length of the review time
- For the final exam, we will configure Restrict Access settings so the quiz link will be hidden on the CLE course page until October 16 at 7:40am (20 minutes before the open time). After October 16 at 7:40am, students will then be able to access the final exam until their access to the quiz is again restricted on October 17 at 5pm
- Further restrictions may be added by clicking the Add restriction button again, and it is possible to specify that ALL the conditions or ANY of the conditions are required before the activity is made available. Thus, it is possible to use Or as well as Any conditions. Click to read more about the improved and simplified Restrict Access setting
Review and save your changes.
Click the Save and return to course button to return to the front page of the CLE course, the Save and display button to return to the quiz, or the Cancel button to cancel any changes made on the page and return to the course.