Page MenuHomePhabricator

[WE.1.2.6] Moderated usability testing support for Growth (surfacing structured tasks for readers)
Open, MediumPublic

Description

Context
The Growth team requests support from the Design Research team in support of WE1.2.6 Surfacing Structured Tasks for readers. Specifically, the Growth team aims to build on work that exploring the "add a link" structured task for logged-in readers on mobile who haven't yet edited, and is preparing for an experiment in Q3 that aims to increase the percentage of new account holders who constructively activate on mobile by 10% compared to the baseline. Specifically, this research will explore designs for surfacing an "add an image" structured task for logged-in readers who haven't yet edited, in support of a possible follow-on hypothesis to WE1.2.6.

Relevant documents:

Related tasks:

Description.

The Growth team has attempted to explore these designs through a series of unmoderated user tests on the Userlytics platform, however the results were not fully satisfactory, and moderated interviews may be necessary to satisfactorily explore the underlying concepts with potential users of the feature. Specifically, the Growth team is interested to address the following questions/issues:

  • The designs under consideration are quite different and each offers its own pros and cons.
  • Which design(s) seems to appeal most to users? Which makes the most sense?
  • What reaction do users have to encountering the "robot" icon? Do they conceptually link it to AI?
  • How do they interpret the instructions?
  • Which placeholder image is the strongest choice?

Expected Deliverable.

A short research report (slide deck) and short presentation to the team, and/or to the team's PM and designer.

Estimated Effort.

  • ~5 moderated interviews with Wikipedia readers or new editors, lasting approximately 45-minutes each.
  • readers are relatively easy to recruit, and can be found both in the WMF Design Research participant database and through the Userlytics platform
  • Priority

It would be ideal to have interviews completed and findings prepared by mid January, 2025, in order to support the planned Q3 experiment.

I need this task resolved in:

	[X ] 1 month.
  • Other. Do you have any other questions or comments ?

For use by WMF Research team; please leave everything below as it is:

  1. Does the request serve one of the existing Research team's audiences? If yes, choose the primary audience. (1 of 4)
  2. What is the type of work requested?
  3. What is the impact of responding to this request?
    • Support a technology or policy need of one or more WM projects
    • Advance the understanding of the WM projects.
    • Something else. If you choose this option, please explain briefly the impact below.

Details

Due Date
Sat, Jan 11, 12:00 AM

Event Timeline

leila renamed this task from [Request] Moderated usability testing support for Growth (surfacing structured tasks for readers) to [WE.1.2.6] Moderated usability testing support for Growth (surfacing structured tasks for readers).Nov 26 2024, 9:25 PM
leila assigned this task to MRaishWMF.
leila triaged this task as Medium priority.
leila added projects: OKR-Work, Design-Research.
leila set Due Date to Thu, Dec 19, 12:00 AM.
leila moved this task from Backlog to Staged on the Research board.
leila edited subscribers, added: Bethany, MGerlach; removed: Miriam.

@MRaishWMF Thanks for capturing this task. I reviewed and prioritized it given the information in the description and the additional context from our conversation yesterday. A few notes:

  • The task is now in the Staged lane. When you start working on it, please move it to "In progress" in the Research board so we know the work has started.
  • My understanding is that you want to finish this work during this quarter. I set the deadline to December 19th with that information in mind and assuming that the 20th is the last day of work in 2024 for a few of us. If you want to move it to a few days later, by all means.

@MGerlach I subscribed you to this task given that the work is about further experimentation with add-a-link and I thought you may want to be aware of it (I got quite excited seeing how the work is evolving:). Feel free to adjust your subscription as you see fit.

MRaishWMF changed Due Date from Thu, Dec 19, 12:00 AM to Sat, Jan 11, 12:00 AM.Dec 6 2024, 4:14 PM

updated task due date to allow time for interviews and analysis. We are still aiming for ~5 interviews with non-editing readers (English speaking). We are exploreing the possibility of using this opportunity to explore the moderated testing capabilities of the Userlytics platform (e.g., for 1-2 of the interviews), which we haven't yet tried. This effort is also expected to help us continue to gather information about how to improve our mobile testing capacity.