Publish Usability Improvements Measurement Plan
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• ppelberg
	Jul 21 2021, 8:42 PM

Description

This task represents the work involved with drafting and publishing the measurement plan we will follow to evaluate the impact of the talk page usability improvements we have planned.[i]

Process

Step	Description	People Responsible	Status
1.	Draft hypotheses	@ppelberg	✅ done
2.	Review hypotheses	@MNeisler	✅ done
3.	Finalize hypotheses	@MNeisler + @ppelberg	✅ done
4.	Propose methods/metrics for evaluating hypotheses	@MNeisler + @iamjessklein	in progress
5.	Document baselines for qualitative metrics within the OWC - Baseline data	@iamjessklein	in progress
6.	Team reviews hypotheses	Editing-team
7.	Draft experiment plan	@MNeisler
8.	Team reviews evaluation methods/metrics and experiment plan	Editing-team

Measurement Plan

A work in progress version of the Talk Pages Project/Usability Improvements Measurement Plan.

Done

Each step in the ===Process outlined above is completed

i. T255560, T267444, T269950, T269963

Related Objects
Search...

Status	Assigned	Task
Open	None	T276497 Scale DiscussionTools to all projects
Open	None	T310959 Scale Usability Improvements to all projects
Open	None	T319146 [Release Ticket] Offer Usability Improvements as default-on feature at all projects (desktop)
Resolved	• ppelberg	T302547 [Usability Improvements] Deploy as Beta Feature at all wikis (desktop)
Resolved	• ppelberg	T282639 [Release ticket] Deploy Topic Containers as Beta Feature at Partner Wikis
Resolved	• ppelberg	T287120 Publish Usability Improvements Measurement Plan

Event Timeline

• ppelberg created this task.Jul 21 2021, 8:42 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 21 2021, 8:42 PM

• ppelberg moved this task from Untriaged to Upcoming on the Editing-team board.Jul 21 2021, 8:42 PM

• ppelberg moved this task from Backlog to Triaged on the DiscussionTools board.Aug 12 2021, 3:52 PM

• ppelberg claimed this task.Sep 3 2021, 4:49 PM

• ppelberg updated the task description. (Show Details)

• ppelberg edited projects, added Editing-team (Kanban Board); removed Editing-team.

• ppelberg moved this task from Incoming to Blocked / Needs More Work on the Editing-team (Kanban Board) board.

• ppelberg added a subscriber: • iamjessklein.

• ppelberg updated the task description. (Show Details)Sep 9 2021, 9:31 PM

I just asked for access to the working doc.

• ppelberg updated the task description. (Show Details)Sep 10 2021, 6:11 PM

MNeisler updated the task description. (Show Details)Sep 14 2021, 3:22 PM

@ppelberg
I completed my review of the hypotheses and research questions. See suggested changes and comments in the measurement plan. Happy to discuss these during our 1:1 this week.

• ppelberg updated the task description. (Show Details)Sep 29 2021, 8:39 PM

• ppelberg renamed this task from Publish talk page legibility measurement plan to Publish Usability Improvements Measurement Plan.Oct 15 2021, 7:44 PM

• ppelberg updated the task description. (Show Details)

• ppelberg edited parent tasks, added: T282639: [Release ticket] Deploy Topic Containers as Beta Feature at Partner Wikis; removed: T249579: [EPIC] Usability improvements: make the actions, activity and content within talk pages easier to understand.Oct 15 2021, 8:31 PM

• ppelberg mentioned this in T294481: Instrument Usability Improvements.Oct 27 2021, 7:21 PM

MNeisler added a project: Product-Analytics.Jan 26 2022, 3:23 PM

MNeisler moved this task from Triage to Tracking on the Product-Analytics board.

• ppelberg reassigned this task from • ppelberg to • iamjessklein.Jan 31 2022, 6:19 PM

• ppelberg moved this task from Blocked / Needs More Work to Ready to Be Worked On on the Editing-team (Kanban Board) board.

• ppelberg moved this task from Ready to Be Worked On to Design Review on the Editing-team (Kanban Board) board.Feb 5 2022, 2:35 AM

• ppelberg added a project: Goal.

I've added some edits and comments in the document.

• iamjessklein moved this task from Design Review to Doing on the Editing-team (Kanban Board) board.Mar 3 2022, 1:09 AM

Good news - for the "Avg. time it takes for someone to recognize what talk pages are for" metric, I've found the usability tests from May 2019 titled in UserTesting.com as Talk Pages 2019-WikiTester videos.

I will scan through these videos and then add that average number to baseline metric spreadsheet for comparison.

• iamjessklein moved this task from Doing to Ready to Be Worked On on the Editing-team (Kanban Board) board.Mar 17 2022, 6:21 PM

• ppelberg moved this task from Ready to Be Worked On to Upcoming on the Editing-team (Kanban Board) board.Mar 17 2022, 6:22 PM

Action

@iamjessklein to create ticket for the work that will be involved in the Diary Study Jess identified us as needing to run in order to qualitatively evaluate the impact of the set of Usability Improvements we are making.

• ppelberg moved this task from Blocked / Needs More Work to Ready for Sign Off on the Editing-team (Kanban Board) board.Jun 6 2022, 5:13 PM

Removing inactive assignee. (Please reset assignees of open tasks when offboarding staff.)

• ppelberg closed this task as Resolved.Jul 29 2022, 12:51 AM

• ppelberg claimed this task.

Publish Usability Improvements Measurement PlanClosed, ResolvedPublicActions