⚓ T258981 Publish New Discussion Tool measurement plan

		Status	Subtype	Assigned	Task
		Open		None	T233446 [Epic] New Discussion Tool
		Resolved		ppelberg	T258981 Publish New Discussion Tool measurement plan

ppelberg created this task.Jul 27 2020, 9:55 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 27 2020, 9:55 PM

ppelberg edited projects, added OWC2020 (New Discussion 1.0); removed OWC2020.Jul 27 2020, 9:56 PM

ppelberg renamed this task from Publish measurement plan to Publish New Discussion Tool measurement plan.Aug 12 2020, 7:03 PM

ppelberg added a parent task: T233446: [Epic] New Discussion Tool.

Update: 14-August
@MNeisler I think the Talk pages project/New Discussion/Measurement plan is in a good enough place for you to review.

Feedback
In addition to the specific questions I've added as comment within the doc, here are the "meta" questions I'd value hearing what you think about:

Section	Question(s)
"Hypotheses"	Do the "Hypotheses" seem practical considering the "Scope" of the intervention?
"Experiment plan"	What "metrics" do you think be helpful in answering the "Research questions" associated with each analysis?
The plan as a whole	Do you see any logical inconsistencies within the measurement plan as a whole?

...of course, if other thoughts come to mind, please share them!

Iterating
As for how we go about iterating on the measurement plan (read: getting to answers about the above), for now, let's talk via "comments" and "suggestions" within the doc itself.

ppelberg reassigned this task from ppelberg to MNeisler.Aug 15 2020, 1:27 AM

ppelberg updated the task description. (Show Details)

ppelberg edited projects, added Editing-team (Tracking), Product-Analytics; removed Editing-team.

ppelberg moved this task from Backlog to Analytics on the Editing-team (Tracking) board.

LGoto triaged this task as Medium priority.Aug 17 2020, 4:04 PM

LGoto edited projects, added Product-Analytics (Kanban); removed Product-Analytics.

@ppelberg I completed my initial review. Any changes or input of documented via "comments" and "suggestions" within the doc itself. Happy to discuss these further async in the doc and during our meeting this Wednesday.

In T258981#6409679, @MNeisler wrote:

@ppelberg I completed my initial review. Any changes or input of documented via "comments" and "suggestions" within the doc itself. Happy to discuss these further async in the doc and during our meeting this Wednesday.

Wonderful. Thank you for the update, @MNeisler. I've added comments in response. Let's discuss tomorrow (Wednesday) and then go from there.

Update: 3-Sep
I've updated the measurement plan to include the decisions we came to during the team meeting we had on Tuesday, 1-September and the meeting @MNeisler and had today.

Next steps

Megan is going to draft the "Metrics" we'll look at for each of the analyses we have planned
Megan and I will refine the "Metrics" and share with the team for discussion next week

In T258981#6433586, @ppelberg wrote:

Update: 3-Sep
I've updated the measurement plan to include the decisions we came to during the team meeting we had on Tuesday, 1-September and the meeting @MNeisler and had today.

Next steps

Megan is going to draft the "Metrics" we'll look at for each of the analyses we have planned

Megan and I will refine the "Metrics" and share with the team for discussion next week

The above is done. Next steps below.

Next steps

@MNeisler to review the "Pre-mortem" sections
Once the "Pre-mortem" is finished, we can finalize the experiment plan and get started on instrumentation.

Next steps

@MNeisler to review the "Pre-mortem" sections

Once the "Pre-mortem" is finished, we can finalize the experiment plan and get started on instrumentation.

I've completed my review of the pre-mortem sections and responded to the follow-up question re instrumentation. @ppelberg - Let me know if you have any other questions or sections you'd like reviewed.

@ppelberg - If ok, assigning this over to you for now as the next steps are to discuss v2 with the team. Per our discussions today, I'll help create instrumentation spec pending resolution of T265099

MNeisler moved this task from Doing to Needs Review on the Product-Analytics (Kanban) board.Oct 27 2020, 5:07 PM

In T258981#6544109, @MNeisler wrote:

@ppelberg - If ok, assigning this over to you for now as the next steps are to discuss v2 with the team. Per our discussions today, I'll help create instrumentation spec pending resolution of T265099

Eeek. I'm sorry for the lag. Yep, assigning this over to me sounds great. I've adjusted the task description "Done" section to reflect what is needing to be done.

ppelberg updated the task description. (Show Details)Oct 28 2020, 12:57 AM

MNeisler edited projects, added Product-Analytics; removed Product-Analytics (Kanban).Jan 26 2021, 5:51 PM

MNeisler moved this task from Triage to Tracking on the Product-Analytics board.

ppelberg moved this task from Backlog to Triaged on the DiscussionTools board.Jan 10 2022, 5:16 AM

This is moot considering we've completed the final analysis of the New Topic Tool and published the results on mediawiki.org: https://www.mediawiki.org/wiki/Talk_pages_project/New_discussion#Evaluating_impact

Publish New Discussion Tool measurement plan
Closed, ResolvedPublic
Actions

Description

Purpose

Draft

Open questions

release-engineering-team-todo

Done

Related Objects
Search...

Event Timeline

Publish New Discussion Tool measurement planClosed, ResolvedPublicActions