Page MenuHomePhabricator

Conditional feedback for quizzes
Closed, DeclinedPublic

Description

Currently feedback is shown for every possible answer in a multiple choice question. This is unintuitive, however, this seems to be by design:

"Unlike some other quiz systems, all feedback items are displayed on correction. With other quiz systems, the norm is to display the feedback only for those items which were selected by the user" (https://en.wikiversity.org/wiki/Help:Quiz#Inserting_feedback)

We need to develop a consensus on what, if anything, to do about this.

Options are:

  1. Leave as is
  2. Change feedback so that it behaves like other Quiz systems, i.e. GIFT: https://docs.moodle.org/20/en/GIFT_format#Feedback and only show feedback from selected answers.
  3. Extend the Quiz format such that conditional feedback is possible, i.e. keep the current type where feedback is always shown, but add other types of feedback that are conditional. If so, this also needs further discussion. There are several options, i.e.

|| always show
||? only show if selected
||- only show if incorrect (false positive or false negative)
||+ only show if correct

Input is also needed on the notation.

Event Timeline

Would this change the structure of the Quiz format then?

We should consider carefully how to design this before implementing it, i.e. discuss an example format of how to accomplish this.

Yes It would change feedback markup.

I was thinking about something like the following :

{Question
|type="()"}
+ The correct answer.
|+| Feedback for correct answer if question answered is right.
|-|  Feedback for correct answer if question answered is wrong.
- Distractor.
|+| Feedback for distractor if question answered is right.
|-| Feedback for distractor if question answered is wrong.
- Distractor.
|+| Feedback for distractor if question answered is right.
|-| Feedback for distractor if question answered is wrong.

The quiz should also work even if only |+| or |-| are given .
The following will only have feedback for correct option displaying Congratulations if the answer is right otherwise it would give feedback as negative.

{Question
|type="()"}
+ The correct answer.
|+| Congratulations you answered correctly !
|-| You have answered wrong
- Distractor.
- Distractor.

It would need to be backwards compatible with current quizzes.

What about

|| For wrong, and that would be consistent with the first change we make, to only provide feedback if it is wrong?
and then add |+| for if it is right?

Actually, on second thought I think the best thing to do is to keep the current behaviour, that

|| causes feedback to be displayed no matter what, so the current behaviour remains the same (and decline T159952)

|+| causes feedback to be displayed for any correct answer.

|-| causes feedback to be displayed for any incorrect answer, whether false positive or false negative.

All three could be used in any given question, so feedback that is displayed no matter what, plus feedback displayed whether right or wrong.

Also useful: seeing how feedback is done in GIFT: https://docs.moodle.org/20/en/GIFT_format#Feedback which we had a prior project to convert quiz format to.

Mvolz renamed this task from Conditional feedback for correctness for each question in Quiz extension to Conditional feedback for quizzes .Jun 6 2017, 9:04 AM
Mvolz updated the task description. (Show Details)
Mvolz updated the task description. (Show Details)

@jayvdb and @Miriya52 might be able to provide some more input as they have experience with the quiz format as well.

But also I think we should do a RFC from the various Wikiversities @Elitre or is that overkill? I know where to ask on en wikiversity (the colloquium) but not in other languages.

Changing the feedback to behave like GIFT Quiz system seems appropriate.
Only feedback for selected proposal/answer will be shown in this format.

The markup will remain the same i.e || for feedback, but it will only be shown if the proposal/answer has been selected.
Also if no answer is selected i.e the question is unanswered then no feedback will be shown ( this will also tackle bug T159952 ).

Behavior in multiple choice single response is shown in following pic -

feedback.jpg (1×1 px, 231 KB)

It would work the same way in multiple choice multiple response but will show multiple feedback based on the answers/proposals selected.

@Mvolz See https://www.wikidata.org/wiki/Q16503 for all Wikiversity's village pumps. Does this help?

Yes, very helpful; this is declined in favour of https://phabricator.wikimedia.org/T159952 but that is good to notify the wikis if they would like to change their common.css to change it back to the old way if needed :).