Page MenuHomePhabricator

Homepage mobile: conduct user testing of initial homepage mobile design and discoverability
Closed, ResolvedPublic

Description

Background
The Growth team will be adding an Homepage in the user personal area. The page will feature activity data, informations and call to actions to enable the user get help and learn more about editing and creating articles, find relevant content, check their personal activity and wiki impact, and return for future work.

Goals of this user test

  1. Gauge the discoverability of the mobile homepage
  2. Gauge user reactions and understandability to the mobile homepage as a whole, in both unactivated (first-use) and activated (after some use) state of the modules
  3. Do users understand the purpose of the module overview and do they engage with it?
  4. Are users able to get to the full-screen version of the modules?
  5. Do users understand what the modules are for?
  6. Which modules are most attractive?
  7. Is there anything else users would expect to be there or would like to do in the homepage?
  8. Can users figure out how to return to their homepage after going elsewhere?

Testing format
UserTesting.com will be used to recruit users and run the test.
It will be a remote, moderated test where users will be asked to locate the homepage, while "talking aloud" their expectations and experiences. It will be followed by a few written questions. Each session test should take no longer than 15 minutes to complete.

Testers
5 users will be recruited using UserTesting.com, they will test on the Mobile version of the homepage.

Respondents were screened for those being new to Wikipedia.

Test protocol
https://docs.google.com/document/d/11JLFmow06M6_YFrAeFcUHS6bSwHP84PkdVYiy0jQ0vk/edit?usp=sharing

Prototype
https://wikimedia.invisionapp.com/share/ANRU8RTS7HR

Findings deck
https://docs.google.com/presentation/d/1IE0wc0WmGiky7wBHsQwBEpc_Yjtns9Dp-0_acSNWMkQ/edit?usp=sharing

Combined results
https://docs.google.com/spreadsheets/d/12MhAmrP46wVmG3ZPuy9bwJ_CUNFS-AHL_dE4_pKs9_c/edit?usp=sharing

Event Timeline

Cntlsn created this task.May 6 2019, 1:48 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 6 2019, 1:48 PM
Cntlsn updated the task description. (Show Details)May 15 2019, 6:02 PM

The user test has been done, and findings have been mapped into the Findings deck and Combined results spreadsheet.
All links to files in the task description are up-to-date.

Cntlsn reassigned this task from Cntlsn to MMiller_WMF.May 29 2019, 4:04 PM