Page MenuHomePhabricator

Conduct user testing for adding newcomers tasks on the newcomers homepage (v1)
Closed, ResolvedPublic



The Growth team will be adding Task recommendations (a.k.a. "Suggested edits") for newcomers on their homepage this Q1/2019-20, with the hypothesis that newcomers are more likely to start and continue to edit (i.e., become "retained) under certain conditions. Namely, they are more likely to edit when:

  • offered recommendations related to their interests;
  • shown guidance at at the right time; and
  • when given sufficient context during editing.

Goals of this user test

Overall, the aim of this task at this stage is focused on usability testing to better inform design of the UI flow as users add and make selection of tasks.

  1. Gauge the discoverability of adding the newcomer tasks module.
  2. Identify improvements to the usability of the UI (more details TBD in the document)
    • Do users understand they can do X?
    • Are users able to successfully do Y?
    • Is there anything users that would like to be able to do?
  3. Gauge user reactions to the newcomer task module and expectations of how it relates to their user profile.

Testing format will be used to recruit users and run the test.
It will be a remote, unmoderated test where users will be asked go through the feature as a series of tasks, while "talking aloud" their expectations and experiences. It will be followed by a few written questions. Each session test should take no longer than 15 minutes to complete.


10 users will be recruited using The intention will be to screen for respondents who likely do not already have a Wikipedia account, and are less-to-not familiar with editing on Wikipedia.

  • 5 will test on the Desktop - ideally a mix of VE and Wikitext 2017 editing UI (so that users see a version that has the "?" icon in the top editing toolbar)
  • 5 will test on the Mobile Visual Editor UI

Test protocol




Event Timeline

RHo added a subscriber: MMiller_WMF.

Usertesting is complete, moving for PM sign-off in case @MMiller_WMF wants any tasks or documentation linked to these items

I will resolve this once I get the mobile results up on wiki.