What are we testing?

Junior wants to ask someone why they did something⟶ junior visits senior's talk page
Senior wants to ask someone why they did something⟶ seniors visits another senior's user talk page

This script tests for:

• Starting a new discussion
• @- Mentioning
• Formatting
• Linking
• Posting
• Being able to identify their post in context after posting

Who is being tested?

Junior and Senior Contributors

What page are we testing

Senior User Talk Page

Findings

Senior Testers TestLog E
Junior Testers TestLogE re-run

Junior Findings

❌ Most test participants struggled to make sense of the page.
"I can't understand what I'm looking at it, this is very very confusing. This kind of looks like a forum post but I can't understand what I am looking at." UT-1
"The discussion isn't related to the posts that come after it (if you scroll down) leaving me very confused as to what I was looking at." UT -1

Adding a new topic
✅ 4 of 5 desktop testers were able to create a new topic
✅ 5 of 5 mobile testers were able to create a new topic
The majority of desktop testers struggled to find a button to add a new topic
Many testers were confused by the "add topic" language on the button
"as im scrolling im looking for something that would say "new discussion." UT- 10
"it say 'create new discussion' but all what I was able to find was 'add topic'. I am sure if this is the same or not..." UT-3
" The only times that I was confused were when similar icons were used for other features - i.e., two drop down menu icons; a pencil icon which indicated writing vs. "add topic" button, etc." ut- 7

Formatting
✅ 5 of 5 desktop testers successfully formatted a message
✅ 5 of 5 mobile testers successfully formatted a message

Linking
✅ 5 of 5 desktop testers successfully linked text in their post
✅ 5 of 5 mobile testeres successfully linked text in their post
Mobile testers struggled with the combination of highlighting text, tapping link icon and then tapping the link

Posting
✅ 5 of 5 desktop testers successfully posted a message
✅ 5 of 5 mobile testers successfully posted a message
The majority of testers expected to see new comments at the top of the timeline.
Several testers used the search field on the page to attempt to locate their post

Identifying their post on the page
✅ 5 of 5 desktop testers successfully found their post in context
❌ 2 of 5 mobile testeres successfully found their post in context
The mobile testers who found their post found it via the freshness feed.
"It wasn’t clear where my comment would appear" ut- 8

Miscellaneous Visual Design/ page complexity

One tester was confused by the placement of the threading of the reply discussion. (UT-1)
One tester explicitly stated that they expected to see the username before the comments (UT-1)
"all the information on the page is so cluttered and difficult to read. maybe an app would be a better experience." (UT-10)

Senior Findings

1 of 5 mobile testers did not use a mobile device so I withdrew their test
Desktop participants were able to tell the page was interactive within 15 seconds, mobile 22.5 seconds
❌ Most test participants struggled to make sense of the page.
"The exactly topic I have to read and explain. the first was about solve a doubt about a program, then an invitation for edit in Wikipedia about POI, and finally I had to write about NY crime. It was confusing" UT -10

Adding a new topic
✅ 4 of 5 desktop testers were able to create a new topic
❌ 2 of 4 mobile testers were able to create a new topic
The majority of desktop testers struggled to find a button to add a new topic
Many testers were confused by the "add topic" language on the button
Many testers looked in their user options on the page to see if they could find something around messaging a user
Only a few testers noticed and used the button in the sticky header
One tester managed to create a new topic but unknowingly created it on the wrong page

Formatting
✅ 5 of 5 desktop testers successfully formatted a message
✅ 4 of 4 mobile testers successfully formatted a message

Linking
✅ 5 of 5 desktop testers successfully linked text in their post
✅ 4 of 4 mobile testeres successfully linked text in their post
Several testers struggled to figure out how to add a link

Posting
✅ 5 of 5 desktop testers successfully posted a message
✅ 4 of 4 mobile testers successfully posted a message
The majority of testers expected to see new comments at the top of the timeline.
Several testers used the search field on the page to attempt to locate their post

Identifying their post on the page
✅ 5 of 5 desktop testers successfully found their post in context
❌ 3 of 4 mobile testeres successfully found their post in context
"I expected the new discussion to appear further up." UT- 2
"I just got confused at first with finding my comment since it didn’t appeared right away. I tried to follow my logic until I got to my comment with the last added comment in the discussion" UT-8

Miscellaneous Visual Design/ page complexity
One tester (UT-9) Had trouble understanding that a discussion would happen on a separate page from the "User Page"