Testing script
https://docs.google.com/document/d/1AXIICbPVbuUBuMuLUHmVS26RWX1vg755TXQwr4dreZ4/edit?usp=sharing
Testing goals
The Multimedia team has been working on adding Depicts statements to Commons as part of the Structured Data on Commons project. Initial testing on the Basic Search prototype for Depicts statements was conducted with the community in October 2018 and some visual improvements have been made since then.
As the Multimedia team gets closer to launching Depict statements, we will we would like to receive additional qualitative feedback from more casual users on the usability of the designs and implementation so far.
This unmoderated, task-based user test will use the Alpha/Labs testing environment using both internal testers and Usertesting.com users.
The primary goals of this test are to gain insights on the following aspects of the Basic Search feature:
Ease of search
- Can users who are new to Commons search successfully initiate a keyword search?
- Can users tell the difference between keywords and tags?
- Can users correctly identify what tag searching is?
- Does typing text and selecting tags work as users expect?
To dos
- Confirm search prototype is up and running
- Confirm search prototype acceptable for testing
- Write script
- Write set-up protocol for internal testers
- Create a doc & google form for internal testers to follow for unmoderated testing
- Write email for recruiting internal testers
- Send out recruitment email
- Upload test to UserTesting.com
- Set up profiles for recruitment
- Run UserTesting.com test
- Analyze UserTesting.com and internal test results
Findings
https://docs.google.com/presentation/d/1ggiWPguy1t0OyuEl9eMAqkAWtFwssF4XoRC5ol6cKl4/edit
Suggestions:
- Since it is difficult for casual users to grasp, reserve this specialized search as an opt-in feature for power users
- Stop automatically showing the Qualifier popover the first 2 times, and use a pulse point + informational tooltip instead to show users they can click on the tag and add qualifiers