Page MenuHomePhabricator

Process usability test findings
Closed, ResolvedPublic

Description

In this task, findings from @dchen’s usability tests for image tags / depicts are being processed from a design perspective.


TL;DR: Summary

  • Continue with tag approach; “Yes/No” designs appeared to create more confusion than expected.
  • Review/confirmation: Back functionality (to check if tags have been published, and a well thought out publish confirmation (T239698) will counteract the need of a separate review screen. Back functionality is essential in order to give users additional certainty that tags for previous images have been published. We should definitely investigate on how to make it happen (T240475).
  • The general interaction model of navigating back and forth has been understood, additional labels for previous/next aren’t needed.
  • Include onboarding screen, as it didn’t hinder participants to complete the tasks. It might have helped users in grasping the concept of adding tags more quickly.
  • Incorporate “pinch to zoom“ into workflow, ideally as demonstrated in this example. Alternative if it’s a technical nightmare: support “pinch“ and “tap” gesture on image and lead them to a separate gallery like view, where images can be zoomed further.
  • Highly demanded by participants: enhance current tagging system with the ability to add custom tags.
  • As observed in previous usability tests: contribution history is one of the features that should be on top of our list in a future release. It has been explicitly mentioned in the tests, plus the need for it can be read between lines.
  • Design for all themes (which has been planned), some participants perceived the interface as too dark or requested a light view.
  • To consider in regards to strategy: Continuing with Suggested edits as a home for small tasks or could it be the “cockpit” for all edit related activities on Wikipedia in the future?

Comments on Findings

Language/onboarding

A few participants experienced initial uncertainty based on the initial description and onboarding screen, but upon seeing the task screen itself, quickly grasped both the task and the related task outcomes.

Does the onboarding screen really help users in getting started? Especially when reading “(...) but upon seeing the task screen itself, quickly grasped both the task (...)”, I’m not entirely sure. Regardless of this doubt, I think we should include it for the new task. We might learn things in terms of engagement and retention. This would a great case for a future A/B tests as well.

Publish process

All 10 participants understood that they could select more than one tag and the tag published confirmation was clear.

Great to see that this was understood by participants as this was an initial concern. Onboarding and addition label might have helped to convey it.

Confirmation screen 6 of 10 expected to see the photo with the selected tags or an ‘are you sure’ screen in addition to a confirmation message. However, none were deeply offended and a couple mentioned the status quo offered a minimalist interface and may mean quicker processing.

This is interesting. The goal with the proposed interaction model was to reduce steps to publish and make editing more direct (from *edit → review → publish* to *edit → publish*).

We’re currently investigating (T240475) if we can provide a feature that lets users go back to a previous published set of tags. IMO, an action item to create review screen depends on the outcome of it, as it adds an additional layer of “security” to check tags have been submitted.

An advantage of an additional review screen would be to show a legal disclaimer after tags have been added.

In summary, I think back functionality and a future contribution history page could solve the uncertaintities that participants have after publishing.

Left/Right arrows

6 of 10 participants described the correct expectations for the left and right arrows next to the Publish button. The remaining 4 more ore less had the same expectations, but some distortions in understanding include answers like ‘I’m not sure’ or thinking that the arrows would lead to more ‘options for tags’ in addition to navigating amongst image options.

Looks like the general model navigating through suggestions is understood by users. Including explicit labels for the left/and right indicators are not needed at this point.

Information provided

8 of 10 participants indicated they felt the information provided on the tagging screen is satisfactory/sufficient.

Great to see, no action items needed to improve the tagging interface at this point.

Participant concerns:

  • Why are there so few tags (1)
  • Layout not good to look at (1)

Valid personal opinions, but no action items needed at this point as it’s feedback of a minority.

Images provided

7 of 10 were positive on the images they saw using this prototype.

Great to see that the image size and format worked.

Negative commentary includes:

  • Poor layout/overlay look
  • dark/dull’ image
  • ‘a bit blurry’

Re: “dark/dull image”: could be related to the prototype beeing designed in black mode. There are going to be designs for light, sepia and dark as well based on user preference.

Re “a bit blurry”: might have been related to the prototype not beeing as responsive/fluid as the final implementation.

Image Zoom

All 10 participants defaulted to the ‘pinch’ to zoom/interact with the images.

Most (6) mentioned they didn’t feel a need to zoom was necessary.

Interesting that participants choose “pinch to zoom“ over tapping the image. I would be great to incorporate the gesture in the final version. Also, we can roll it out to image caption editing.

Prototype Multi-tag select view or Static Single-tag rate view (Yes/No)

Prototype (5)

Static (3 - researcher note: would discount these votes. participants had real issues of understanding with the static view, like missing the ‘bridge’ tag altogether, and not understanding the ‘vote’ action. Additionally, 2 votes were for vague aesthetic reason; my hunch is because the overlay did not slightly cover the bridge image on the static page.)

Tech difficulties, no answer (2)

Suprised by the confusion around the “vote“ action in the Yes/No approach. Overall quite confirming to continue to go with the tag approach.

What did participants do/want to do next?

Publish another set of tags (6)

Indicator for retention? ;) To be processed with caution though, real usage stats (numbers) won’t lie at the end of the day.

Search for image to confirm publish (1)

See all images to which participant contributed tags (1)

Yes, we need a contribution history feature.

Explore other tasks on SE screen (1)

Alright, at least one participant is interested in exploring other tasks.

Suggested Edits main

3 of 10 participants described the SE main screen as if it were the ‘administrative’ center for all app editing/management of editing capabilities.

This is exciting as we’re thinking about making Suggested edits a home for all edit activities in the app.


Comments on Recommendations

Participant suggestions

Evaluate and address the following as is needed/valuable/worthwhile:

Add own tags (7 participants)

Search other existing tags to add (1)

Definitely planned as an enhancement for a future release.

Add own photos (1)

I guess this belongs more into the domain of Commons, as they’re already offering it.

Add photo credits (1)

We could think about including credits in the zoomed view.

Add button to bookmark image link (1)

Similar to randomizer? Even better to include a contribution history page.

Add day/night view (1 - researcher note: uncertain how this look will work with the light/dark views on Android. Will this override user settings or vice versa?)

Image tagging in light, sepia and dark mode will be part of the release. It will adapt to the user’s theme settings.

Publish process

Consider the utility of including a link to the image or a visual confirmation for users to see their added tags against the quick/clean current.

See comment in Publish process earlier in the doc.

Image zoom

Allow for users to zoom (if it's not much trouble, so they can do so if they'd like) on the image with the pinching gesture (most intuitive)

Yes, let’s support the pinch gesture.

Prototype Multi-tag select view or Static Single-tag rate view (Yes/No)

Stick to the former for clarity and efficiency’s sakes. The static version in practice will not necessarily always look ‘cleaner’ and it appears to create more confusion than expected.

Interesting, I expected that the “Yes/No" approach is going to be perceived as the simpler version but it obviously lead to confusion.

Suggested Edits main

Consider the macro-level goals around user participation and type/extent of editing on Android app with regard to the evolution of the SE main screen. Some participants’ impressions of it as an app editing administrative hub could be a positive, a diversion, or a combination of both.

This is a great remark. We will have consider it for the app edit strategy in the future. Do we want to continue with Suggested edits as a home for small tasks or could it be the “cockpit” for all edit related activities on Wikipedia? IMO, we should try to tie in Suggested edits with “regular“ Wikipedia editing more and more with every release, until artificial categorization/boundaries of editing via app disappear.

Event Timeline

Sent via email, but posting here for visibility:

Re: publishing, do users expect to see them "published" in a page they can look at, or is it enough to give them a little message their tags were published and to take them directly on to the next image?

As a follow-up after the usability portion is done, I am interested to find out:

  • What do users think this feature is for?
  • Can they articulate why we would want them to tag images - i.e., how we are using their contributions?
  • Can they articulate the benefits to them in tagging images? Why would they want to do this?
  • Do they find the task interesting? Engaging? Fulfilling?
scblr renamed this task from Usability testing to Process usability test findings.Dec 20 2019, 1:39 PM
scblr claimed this task.
scblr updated the task description. (Show Details)

Questions/comments @schoenbaechler:

You say that "Back functionality is essential in order to give users additional certainity that tags for previous images have been published", but I am not at all sure how going back to the previous editing screen is going to inform people that their tags were published already. Can you explain the logic here?

We will need to investigate the "pinch to zoom" thing - though my guess is that is going to be possibly more difficult than is worth it. If that doesn't work, falling back on the current "tap to expand" modality seems most logical.

Custom tags and contribution history are definitely not for v4, but since we are already thinking of them for future versions it is nice to have validation that users want them.

Thanks @Charlotte, answers below:

You say that "Back functionality is essential in order to give users additional certainty that tags for previous images have been published", but I am not at all sure how going back to the previous editing screen is going to inform people that their tags were published already. Can you explain the logic here?

It addresses the following point from Daisy’s report:

“6 of 10 expected to see the photo with the selected tags or an ‘are you sure’ screen in addition to a confirmation message.”

There is going to be a confirmation message (T239698#5770993). If users are still unsure if tags have been published, back functionality should provide an additional layer of security. In a sense that users could check if tags are published or not (will design a screen for this today).

We will need to investigate the "pinch to zoom" thing - though my guess is that is going to be possibly more difficult than is worth it. If that doesn't work, falling back on the current "tap to expand" modality seems most logical.

Makes sense if it’s really a technical overkill. I wouldn’t want to rule it out from the beginning though and am interested in hearing what our engineers think about the fancy way of zooming. Not only image tagging would profit from it, but also caption editing.

Side note: in addition to the tap gesture, we could incorporate “pinch to zoom” as an additional trigger to navigate to the expanded view. Not as fancy, but this might cover the fact that all 10 test participants defaulted to “pinch to zoom”.

Custom tags and contribution history are definitely not for v4, but since we are already thinking of them for future versions it is nice to have validation that users want them.

Agreed!

In T239691#5773602, @schoenbaechler wrote:

Thanks @Charlotte, answers below:

You say that "Back functionality is essential in order to give users additional certainty that tags for previous images have been published", but I am not at all sure how going back to the previous editing screen is going to inform people that their tags were published already. Can you explain the logic here?

It addresses the following point from Daisy’s report:

“6 of 10 expected to see the photo with the selected tags or an ‘are you sure’ screen in addition to a confirmation message.”

There is going to be a confirmation message (T239698#5770993). If users are still unsure if tags have been published, back functionality should provide an additional layer of security. In a sense that users could check if tags are published or not (will design a screen for this today).

In that case, it makes a lot more sense to just have an "are you sure" screen, rather than making users press "back" all the time - especially because we believe that "back" function may not be available with the APIs as they are. I can understand the aesthetic desire to have as few interstitial screens as possible, but honestly I think it's a much better idea to say "are you sure" and give the user a chance to change things *before* they publish, rather than having to undo things after they have already been published!

Adding notes from the conversation with @Charlotte’s from last Friday, re:

“6 of 10 expected to see the photo with the selected tags or an ‘are you sure’ screen in addition to a confirmation message.”

If “back“ functionality is technically feasible (investigated in T240475), we’ll try out publishing in one step and observe contribution quality. If “back“ functionality is not supported, we think that an additional step (review screen) might help to increase contribution quality (Details: T239691#5773829).