Page MenuHomePhabricator

User testing of search, Explore feed updates and general navigation changes in the app
Closed, ResolvedPublic

Description

Why are we doing this?

The iOS team has been working on a redesign of the app, which includes updates to the Explore feed look and feel as well as changes to the search navigation stack.

The primary goals of this test are to gain insights on the following questions:

  • Can users differentiate the different cards on the Explore feed?
  • Is the organization of the Explore feed clear to users?
  • Can users successfully locate search throughout the app?
  • Is the navigation stack from search logical and natural for users?

Testing script

https://docs.google.com/document/d/1Oi8tCA_HqmyL1B4ZEEduMdkayY9e73Tnc4uzsdJmiLM/edit?usp=sharing

Test format

This test will utilize UserTesting.com to recruit users, record sessions and ‘facilitate’ the test.
The test is an unmoderated, task based test. Users will be given a set of tasks to complete in a 5-10 minute time frame, followed by a set of 4 written questions. Users will perform the test remotely.

Participants

5 users will be recruited using UserTesting.com. 5 additional users will be recruited from the mobile apps user testing list via email.

Findings

Testing with new users from UserTesting.com
Explore feed

  • All users were able to identify different card types in the feed with ease
  • All users were able to locate a specific card from a specific day (top read 2 days ago on English) easily
  • 3 users used the search tab for their first search, 2 users used the search box at the top of Explore for their first search and 1 of the users whose original search was from Explore used both search boxes
  • Announcement cards appearing further down in the feed now that there are date headers is confusing to some users
  • 1 user wanted the cards from their primary language to appear before the cards from their secondary language
  • 1 user seemed interested in turning off the feed in their secondary language but looked to the language section of Settings to do so

Search

  • The keyboard search button was really confusing and frustrating for 3 of 5 users. One user thought that the search results page was an article because they had tapped on Search from the keyboard so many times
  • One user who saw the tool tip for the W button was upset by the W taking them back to the Search tab when in a stack originated from the Search tab
  • No users seemed surprised by the back navigation on the search stack, although 1 user wanted search to appear multiple times in the stack
  • All users kept getting into a weird state where their search term would be preserved on the search screen but the keyboard wasn't active (I think this was a weird bug with using UserTesting.com's app at the same time though, as I can't repro)

Suggestions

Testing with new users from UserTesting.com

Event Timeline

cmadeo created this task.Jul 6 2018, 12:09 AM
Restricted Application added a project: Wikipedia-iOS-App-Backlog. · View Herald TranscriptJul 6 2018, 12:09 AM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
cmadeo updated the task description. (Show Details)Jul 17 2018, 5:57 PM
cmadeo removed cmadeo as the assignee of this task.Jul 17 2018, 9:44 PM
cmadeo updated the task description. (Show Details)
Restricted Application changed the subtype of this task from "Deadline" to "Task". · View Herald TranscriptAug 25 2018, 4:42 AM