Testing script

https://docs.google.com/document/d/1xNT5-GypP_5FXTFUyIshDXjGXzs4T8oGvXvmoowlk5E/edit?usp=sharing

Testing goals

The iOS team has been working on a redesign of the editing interface on iOS app and would like to be able to receive some qualitative feedback usability of the designs and implementation so far. Along with this unmoderated, task-based user test, the new design will also be deployed to the beta testing group and will be tested internally.

The new editing interface designs are based on feedback on the old editing interface designs as tested at Hackathon 2018. Syntax highlighting, wayfinding tools, a new toolbar for inserting Wikitext and updated preview / publish flows are all included in this update.

The primary goals of this test are to gain insights on the following aspects of the Editing feature:

Ease of editing

• Can users who are new to editing successfully make a small change to an article?
• Does selecting and modifying text work as users expect?

Toolbar and Navigation

• Can users correctly identify the editing toolbar icons?
• Are the toggle states and effects of toggling selections clear and easy for users to understand?
• Do the line numbers make sense to users?
• Is the highlight menu easy to navigate through and discoverable for users?

Syntax highlighting

• Can users tell the difference between ‘code’ and content?
• Do the syntax colors make sense to users?
• Can new editors tell what areas are affected by syntax in the article?

Preview and publishing flow

• Do users understand each part of the preview and publishing flow?
• Do users understand which parts of the publishing flow are optional?
• Do users feel more compelled to add a written edit summary?

---

To dos

• Write script

• Write set-up protocol for internal testers
• Create a slide deck for internal testers to follow for unmoderated testing
• Write email for recruiting internal testers
• Send out recruitment email
• Work with respondents to set them up with the test
• Run and analyze test

• Upload test to UserTesting.com
• Run and analyze UserTesting.com test results

---

Findings

https://docs.google.com/presentation/d/1v-6581UK8H5qWtJX55WIcglTJyvPcXSbekJnA3n6Vag/edit?usp=sharing

Suggestions:

• Update the Header styling icon to be more contextual (it’s confusing that it always says H2)
• Add find and replace to find in page
• Add wizards for entering citations and templates
• Create a way for users to explore what syntax means
• Auto suggest pages when a user has entered link syntax