Page MenuHomePhabricator

Run Test C (Empty Article Talk) and synthesize findings
Closed, ResolvedPublic

Description

What are we testing?

Junior/Senior wants to talk about an article that no one else has started talking about yet⟶ seniors visits empty article talk

This script tests for:

  • Starting a new discussion using the new article empty state
  • Linking
  • Posting
  • Being able to identify their post in context after posting

Who is being tested?

Junior and Senior Contributors

What page are we testing

an Empty Article Talk Page

Findings

Average amount of time to correctly recognize that this page is some sort of message board:
8.4 seconds for desktop testers.
9.6 seconds for mobile testers.

Starting a new discussion using the new article empty state
✅ 5 of 5 desktop users were able to start a new discussion using the new article empty state layout
✅ 4 of 5 mobile users were able to start a new discussion using the new article empty state layout

Linking
✅ 5 of 5 desktop users were able to start a new discussion using the new article empty state layout
✅ 5 of 5 mobile users were able to start a new discussion using the new article empty state layout
⚠️ Almost all of the mobile testers struggled to add links (although ultimately were able to complete the task)
" I wasn't sure the links were posting properly. That was easy to do, but confusing to confirm at first" UT-3

Posting
✅ 5 of 5 desktop users were able to successfully post their new topic/create the page.
✅ 5 of 5 mobile users were able to successfully post their new topic/create the page.

One tester was a little thrown off by "add topic" vs. other posting language such as "Post" (UT-1)

Being able to identify their post in context after posting
✅ 5 of 5 desktop users were able to identify their post in context after posting
✅ 5 of 5 mobile users were able to identify their post in context after posting

Unexpected UI:
"Maybe have a box more around the [topic container] so it could look like a thread." UT 2

"It is very generic and plain looking. It would be nice if the time and date were indented on a line (i feel like it would be easier to read). From what I'm used to on Wikipedia, it looks exactly as I'd expect it to." UT-4

"I was kind of expecting to see more like a headline and a click to open, I wasn't expecting to see it automatically. UT-9

Source mode issues:

  • several testers ended up in source mode (one way or another) and struggled with formatting, linking and posting.

Event Timeline

The desktop and mobile tests are up on usertesting.com right now and in progress.

I've updated the task with findings. I don't see any new tickets as a result of this round of testing.