Conditional feedback for quizzes
Open, NormalPublic

Description

Currently feedback is shown for every possible answer in a multiple choice question. This is unintuitive, however, this seems to be by design:

"Unlike some other quiz systems, all feedback items are displayed on correction. With other quiz systems, the norm is to display the feedback only for those items which were selected by the user" (https://en.wikiversity.org/wiki/Help:Quiz#Inserting_feedback)

We need to develop a consensus on what, if anything, to do about this.

Options are:

  1. Leave as is
  2. Change feedback so that it behaves like other Quiz systems, i.e. GIFT: https://docs.moodle.org/20/en/GIFT_format#Feedback and only show feedback from selected answers.
  3. Extend the Quiz format such that conditional feedback is possible, i.e. keep the current type where feedback is always shown, but add other types of feedback that are conditional. If so, this also needs further discussion. There are several options, i.e.

|| always show
||? only show if selected
||- only show if incorrect (false positive or false negative)
||+ only show if correct

Input is also needed on the notation.

Mvolz added a comment.Mon, Jun 5, 9:10 AM

Would this change the structure of the Quiz format then?

We should consider carefully how to design this before implementing it, i.e. discuss an example format of how to accomplish this.

Yes It would change feedback markup.

I was thinking about something like the following :

{Question
|type="()"}
+ The correct answer.
|+| Feedback for correct answer if question answered is right.
|-|  Feedback for correct answer if question answered is wrong.
- Distractor.
|+| Feedback for distractor if question answered is right.
|-| Feedback for distractor if question answered is wrong.
- Distractor.
|+| Feedback for distractor if question answered is right.
|-| Feedback for distractor if question answered is wrong.

The quiz should also work even if only |+| or |-| are given .
The following will only have feedback for correct option displaying Congratulations if the answer is right otherwise it would give feedback as negative.

{Question
|type="()"}
+ The correct answer.
|+| Congratulations you answered correctly !
|-| You have answered wrong
- Distractor.
- Distractor.
Mvolz added a comment.EditedMon, Jun 5, 10:17 AM

It would need to be backwards compatible with current quizzes.

What about

|| For wrong, and that would be consistent with the first change we make, to only provide feedback if it is wrong?
and then add |+| for if it is right?

Mvolz added a comment.Tue, Jun 6, 6:50 AM

Actually, on second thought I think the best thing to do is to keep the current behaviour, that

|| causes feedback to be displayed no matter what, so the current behaviour remains the same (and decline T159952)

|+| causes feedback to be displayed for any correct answer.

|-| causes feedback to be displayed for any incorrect answer, whether false positive or false negative.

All three could be used in any given question, so feedback that is displayed no matter what, plus feedback displayed whether right or wrong.

Also useful: seeing how feedback is done in GIFT: https://docs.moodle.org/20/en/GIFT_format#Feedback which we had a prior project to convert quiz format to.

Mvolz renamed this task from Conditional feedback for correctness for each question in Quiz extension to Conditional feedback for quizzes .Tue, Jun 6, 9:04 AM
Mvolz updated the task description. (Show Details)
Mvolz updated the task description. (Show Details)

@jayvdb and @Miriya52 might be able to provide some more input as they have experience with the quiz format as well.

But also I think we should do a RFC from the various Wikiversities @Elitre or is that overkill? I know where to ask on en wikiversity (the colloquium) but not in other languages.

Changing the feedback to behave like GIFT Quiz system seems appropriate.
Only feedback for selected proposal/answer will be shown in this format.

The markup will remain the same i.e || for feedback, but it will only be shown if the proposal/answer has been selected.
Also if no answer is selected i.e the question is unanswered then no feedback will be shown ( this will also tackle bug T159952 ).

Behavior in multiple choice single response is shown in following pic -

It would work the same way in multiple choice multiple response but will show multiple feedback based on the answers/proposals selected.