Retake Incorrect Questions Only (RIO) is a quiz configuration option available to Instructors when creating Quizzes with more than one attempt. The Retake Incorrect Questions Only option allows students to only retake their incorrectly answered questions from previous quiz attempts. When the student re-attempts their quiz, the quiz questions answered incorrectly on previous attempts are indicated by an alert symbol. Each quiz attempt displays questions in the same order as the initial attempt (including quizzes with random sections and random questions). Questions that were correct on previous attempts still show the “question stem” but will omit the answers.
You can use Preview Quiz to take the quiz and submit a Preview Attempt. You must select the Allow this preview attempt to be graded in the Grade Quiz area on the submission page of the preview attempt.
How it Works
When RIO is on, a student’s first attempt is no different than an ordinary attempt. It’s when they start their second and subsequent attempts that things start to change.
When the student re-attempts the quiz, the quiz questions answered incorrectly on previous attempts are highlighted by an alert symbol and are available to answer.
In the Attempt Log, instructors and administrators can identify retaken attempts:
Retaken attempts are noted after the user’s name in the Attempt log.
In addition, on the Users tab, retaken attempts are listed to differentiate from first attempts.
Questions that were correct on previous attempts still show the “question stem”, but will omit the answers. This ensures the security of quiz materials from sharing and copying, while also ensuring that if a Quiz question requires information or context from a previous question, that information is still available to the student.
Turnitin recently introduced an AI tool designed to assist instructors in detecting AI-generated content in student submissions. This tool potentially analyzes writing styles and may detect anomalies that could possibly indicate the use of generative AI. However, while this technology represents a significant step forward, caution is advised in its application. It’s important to recognize that the tool is not infallible and may not catch every instance of AI-generated content. Instructors should not rely on the AI tool to detect AI generated content, but rather, use it as one of several strategies in a comprehensive approach to uphold academic standards and encourage genuine student learning and creativity.
Grading Considerations
- A student’s score for a Retake Incorrect Questions Only attempt remains at minimum, the score they had on the previous attempt. Correctly answered questions on the Retake Incorrect Questions Only attempt add to the student’s attempts score.
- When grading a Retake Incorrect Questions Only quiz attempt, the instructor can only provide a score for the questions answered on this attempt. The Quiz Overall Score is calculated using the existing Highest/Lowest/First/Last/Average aggregation functions. The Average aggregation function can be used to give the student partial marks for questions that were not answered correctly on the first attempt.
- Using Automatically set as graded option for quizzes with written response questions is not recommended. If you use Automatic grading, Written Response questions will be marked as 0 and included in future attempts until they are graded manually.
How do I set up a Quiz with this option?
Instructors can configure subsequent attempts of a Quiz to be “Retake Incorrect Questions Only” from the Quiz Settings page.
Instructor view of the Retake Incorrect Questions Only quiz configuration option, available under Edit Quiz > Assessment > Attempts
When a student starts an attempt with the option enabled on, their newly started attempt is based on a copy of their previous attempt. Questions remain the same as the previous attempt, regardless of shuffling or randomization options.
NOTE: This feature cannot be used in Special Access to offer “incorrect questions only” additional attempts to only some students. It can only be made available to all students, and only on quizzes that already have 2 or more attempts enabled.
Turnitin recently introduced an AI tool designed to assist instructors in detecting AI-generated content in student submissions. This tool potentially analyzes writing styles and may detect anomalies that could possibly indicate the use of generative AI. However, while this technology represents a significant step forward, caution is advised in its application. It’s important to recognize that the tool is not infallible and may not catch every instance of AI-generated content. Instructors should not rely on the AI tool to detect AI generated content, but rather, use it as one of several strategies in a comprehensive approach to uphold academic standards and encourage genuine student learning and creativity.
Frequently Asked Questions
- Q: When does a student get access to a Retake Incorrect Questions Only attempt?
- A: The attempt is released as soon as the previous attempt is marked as graded – the previous Quiz attempt needs to be completely graded to generate an appropriate Retake Incorrect Questions Only attempt
- Q: As an instructor, how can I preview a Retake Incorrect Questions Only attempt?
- A: As an instructor, you can use Preview Quiz to take the quiz and submit a Preview Attempt. When on the submission page of the attempt, the “Allow this preview attempt to be graded in the Grade Quiz area” must be selected, as the questions of RIO attempts are based on the incorrect questions of a user’s last graded quiz attempt.
- Q: How does “Automatically set as graded” work with Written Response questions?
- A: RIO attempts are released immediately when the previous attempt is marked graded, so if a quiz contains written response questions, the RIO attempt will always re-ask questions that need to be manually graded, like written response questions, even if the student answer was correct. Therefore, we recommend not using “Automatically set as graded” if your quiz contains written response questions.
- Q: Is a student able to continue working on a partially incorrect answer to a written response question on a Retake Incorrect Questions Only attempt?
- A: When a quiz contains Written response questions, the RIO attempt does not copy over the student’s previous incorrect response to the current attempt. Our design research indicated that if students previously didn’t get 100% on the question, instructors would rather that students start fresh for their new attempt.
- Q: Does Retake Incorrect Questions Only work with Release Conditions & Advanced Score Thresholds?
- A: Retake Incorrect Questions Only is deeply integrated into the Brightspace Quiz tool experience and supports all customizable delivery options already available in Quizzes.
- Q: Does Retake Incorrect Questions Only work with Special Access
- A: Yes and no. While Retake Incorrect Questions Only will work with extra attempts granted via Special Access (unless you specifically set Special Access condition to revoke it), it is not possible to enable RIO only for specific students via Special Access; the setting is applied to all students in the course.
- Q: What happens when the RIO setting is turned on partway through a Quiz in progress?
- A: RIO is a setting that is only applied when a student starts a quiz attempt. If the setting is on when 2nd+ attempt is started, the new attempt will be based on the incorrect questions in the previous attempt.
Turnitin recently introduced an AI tool designed to assist instructors in detecting AI-generated content in student submissions. This tool potentially analyzes writing styles and may detect anomalies that could possibly indicate the use of generative AI. However, while this technology represents a significant step forward, caution is advised in its application. It’s important to recognize that the tool is not infallible and may not catch every instance of AI-generated content. Instructors should not rely on the AI tool to detect AI generated content, but rather, use it as one of several strategies in a comprehensive approach to uphold academic standards and encourage genuine student learning and creativity.
