Page MenuHomePhabricator

Evaluate Suggested edits usability tests from Wikimania 2019
Closed, ResolvedPublic

Description

Recommendations:

  • Disclaimer: Participants were attendees of Wikimania 2019 (see tests) and therefore rather experienced Wikipedians. As we’re targeting new types of editors, the following recommendations should be interpreted with caution.
  • We need to give people more background on how Suggested edit tasks help to improve Wikipedia, as participants were asking for context for the actions they’re taking.
  • Participants weren’t able to tell the difference between image captions (structured) and image descriptions (unstructured) in the test, so we’ve got to work on improving to communicate this. I recommend to focus on future tasks.
  • We need to improve the publication process when adding image captions on article pages, as people are unsure if they’re caption has been added or not.
  • As the format in the feed for image captions is cropped, participants weren’t able to view the full image. We’ll need to think about making the image more accessible, e.g. letting users zoom/scroll images
  • Almost all participants were trying to copy/paste information (not always successfully), we’ll need to work on making copy pasting more intuitive/obvious. Obviously, we can’t allow too much copy pasting of unstructured descriptions to structured captions due to legal reasons, but it’s still good to keep it in mind for future releases.
  • ORES and reviewing depict statements are demanded most out of the list of suggestions. There’s also an interest in tasks that make it possible to thank editors.
  • About the Suggested edits home page: participants would like to know where the impact numbers are coming from exactly (citation). This will influence wireframes/designs for the home screen, e.g. with a prominent learn more link.
  • Also related, participants are interested in seeing the amount pageviews they’ve gained with their edits. The least interest they have is in the amount of characters. I suggest to include pageviews instead of the amount of characters on the home page.
  • Participants are interested in a contribution history feature.
  • Check out the “Question by question” in the Gdoc for a more detailed evaluation, I added comments in blue.

More details in this GDoc:

https://docs.google.com/document/d/1_i4eUpyVXjfwkA3EJkSZlmRFiMMqVy_WxOk3heKf5qQ/edit?usp=sharing

Event Timeline

We need to give people more background on how Suggested edit tasks help to improve Wikipedia, as participants were asking for context for the actions they’re taking.

Participants are interested in a contribution history feature.

Participants were attendees of Wikimania 2019 and therefore rather experienced Wikipedians. As we’re targeting new types of editors, this will be further evaluated in T233341 (upcoming design research).

Participants weren’t able to tell the difference between image captions (structured) and image descriptions (unstructured) in the test, so we’ve got to work on improving to communicate this. It’s related to the first point (more background).

We need to improve the publication process when adding image captions on article pages, as people are unsure if their caption has been added or not.

As the format in the feed for image captions is cropped, participants weren’t able to view the full image. We’ll need to think about making the image more accessible, e.g. letting users zoom/scroll images

Due to a pleasing low revert rate for image captions of ~ 3.2% (T232765#5500047), @Charlotte and I decided to put improvements other than the ones in T231451 on hold for now. We’re focusing on making an outstanding “Suggested edits” V4 experience. Disclaimer: Experience improvements for V4 might include improvements to V3 as well.

Almost all participants were trying to copy/paste information (not always successfully), we’ll need to work on making copy pasting more intuitive/obvious. Obviously, we can’t allow too much copy pasting of unstructured descriptions to structured captions due to legal reasons, but it’s still good to keep it in mind for future releases.

Mostly for legal reasons, we’re currently not making changes to the flow. Earlier egal discussions have been mainly taken place here: https://docs.google.com/document/d/187CQ9-oyXM3QLeDozPJEbvrZnvIaJjVO51bqjJkTMTY/edit?usp=sharing.

ORES and reviewing depict statements are demanded most out of the list of suggestions. There’s also an interest in tasks that make it possible to thank editors.

Depicts/Computer aided tagging of images is going to be Suggested edits V4. ORES is not going to happen due to reduced staff capacity.

About the Suggested edits home page: participants would like to know where the impact numbers are coming from exactly (citation). This will influence wireframes/designs for the home screen, e.g. with a prominent learn more link.

Profile stats in V3 will include additional helper tooltips because of this finding (T231449).

Also related, participants are interested in seeing the amount of pageviews they’ve gained with their edits. The least interest they have is in the amount of characters. I suggest to include pageviews instead of the amount of characters on the home page.

Pageviews are going to be included in V3 (T231449) because of this finding.


Moving this task to the Done column.