This task involves the work of conducting usability tests with newcomers to learn how they experience the Suggestion Mode (MVP) and the initial set of suggestions that will be available within it.
NOTE: we may end up wanting to test the overall experience separately from the individual suggestions that will appear within it. For now, we'll assume this will all happen in one test we'll be using this task to scope.
=== Decision(s) to be made
//This test is an effort to make the following decision(s)...//
- What (if any) adjustments will we make to the Suggestion Mode UX (broadly defined) //before// evaluating the impact of the experience through a controlled experiment (T404600)?
=== Research questions
**I. Discoverability**
- Do newcomers realize there is a new feature where they can find suggestions?
**II. Usefulness & clarity**
- Which (if any) suggestions do newcomers consider compelling, clear, and ultimately, worth acting on?
- Which (if any) suggestions do newcomers consider confusing, opaque, and ultimately, unmotivated to pursue/act on?
**III. Helpfulness**
- How do newcomers feel after completing various suggestions?
- Which (if any) suggestions do newcomers find meaningful and inspire them to want to complete more of?
- Which (if any) suggestions do newcomers find boring, not impactful, and ultimately, unlikely to complete again?
**IV. Overall usability**
- Do newcomers **notice** edit suggestions?
- What do newcomers understand suggestions to mean? //Asked another way: what do newcomers intuitively understand the suggestion "cards" to mean? Do they recognize them as optional actions they can consider taking to improve the content of the article they're editing?//
- What – if any – facets of the overarching Suggestion Mode experience do newcomers find confusing? //E.g. see open questions "1." and 2." below.//
**V. Miscellaneous**
- What kinds of suggestions would newcomers be excited to receive?
=== Open questions
//This section contains the questions/uncertainties that surface through designing the MVP. Prior to beginning the test, we'll decide which of these questions we'll prioritize using the usability test to help us answer.//
- [ ] 1. To what extent – if any – do people become confused by the similarities between the blue text highlight which T404604#11233838 specified for suggestions and the blue text highlight which is used for existing text selections and hove effects?
-- //@Dlynch raised this point in T404604#11233971.//
- [ ] 2. What do people intuitively understand the icon proposed in T404604 to mean?
=== Usability testing findings
=== Acceptance criteria (or done)
[ ] Implement a prototype
[ ] Conduct usability test with newcomers and analyze results
[ ] Decide on what (if any) adjustments will we make to the Suggestion Mode UX