⚓ T352131 Publish findings from the Edit Check (references) A/B test

Audience	Publication location(s)	Announcement contents	Person responsible for sharing	Status
Volunteers involved with the Edit Check project	mw:Edit Check	A/B test result summary	@ppelberg	published: 23 May 2024
Partner wikis (T327707) and A/B test wikis (T345298)	Where the initial message was published.	Share results for each wiki, Draft	@Trizek-WMF, @Dyolf77_WMF, @Geugeor-WMF	T366382
All wikis	Diff blog (T366262)	Diff blog - Edit check references	@Trizek-WMF	published: 17 June 2024
Phase 1 wikis (T361843)	Tech/News w/ link to Diff post	@Trizek-WMF	@Trizek-WMF	published: 17 June 2024
Phase 2 wikis (T366381)	Tech/News w/ link to Diff post	@Trizek-WMF	#TODO
Phase 3 wikis (T367343)	TBD	TBD
WMF Staff	Internal staff meeting	Slides 35-39	@ppelberg	Presented on 6 June 2024

Status	Assigned	Task
Open	None	T265163 Create a system to encode best practices into editing experiences
In Progress	Trizek-WMF	T331946 [RELEASE TICKET] Make Edit Check (references) available to all newcomers at all Wikipedias
Open	MNeisler	T342930 [MILESTONE] Run an A/B test to evaluate Edit Check (references) impact
Open	DLynch	T361843 Make Edit Check (references) available to all newcomers at phase 1 Wikipedias
Open	Trizek-WMF	T352131 Publish findings from the Edit Check (references) A/B test
Resolved	MNeisler	T365741 Present Reference Check A/B test findings at June staff meeting
Resolved	Trizek-WMF	T366262 Publish findings from the Edit Check (references) A/B test on Diff

ppelberg created this task.Nov 28 2023, 2:07 AM

ppelberg moved this task from Backlog to Community Engagement on the Editing-team (Tracking) board.

VPuffetMichel moved this task from To Triage to Triaged on the VisualEditor board.Nov 30 2023, 4:45 PM

MNeisler triaged this task as Medium priority.Dec 1 2023, 5:23 PM

MNeisler moved this task from Triage to Upcoming Quarter on the Product-Analytics board.

MNeisler moved this task from Upcoming Quarter to Current Quarter on the Product-Analytics board.Jan 3 2024, 7:39 PM

MNeisler edited projects, added Product-Analytics (Kanban); removed Product-Analytics.Apr 19 2024, 7:22 PM

MNeisler moved this task from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.Apr 29 2024, 4:10 PM

MNeisler mentioned this in T342930: [MILESTONE] Run an A/B test to evaluate Edit Check (references) impact.

@Trizek-WMF I've drafted a summary of the Reference Check results on my sandbox page that can be published on mediawiki. Feel free to edit as needed and let me know if you have any questions or if there is additional text I can help provide.

Once finalized, this can be moved to the Edit Check Project Page under an Impact section or new subpage if preferred.

I review the page, and it is very clear. Good for the service!

I would have shown a graph regarding mobile edits as the numbers are quite impressive. :)

ppelberg updated the task description. (Show Details)May 8 2024, 7:39 PM

Assigning this over to me to review the summary @MNeisler drafted.

ppelberg edited projects, added Editing-team (Kanban Board); removed Editing-team (Tracking).May 13 2024, 7:23 PM

ppelberg moved this task from Incoming to Doing on the Editing-team (Kanban Board) board.

In T352131#9791890, @ppelberg wrote:

Assigning this over to me to review the summary @MNeisler drafted.

I've made some initial edits and will finish reviewing tomorrow (21 May).

In T352131#9814581, @ppelberg wrote:

In T352131#9791890, @ppelberg wrote:

Assigning this over to me to review the summary @MNeisler drafted.

I've made some initial edits and will finish reviewing tomorrow (21 May).

@MNeisler: I think this version looks fit for publishing...can you please read it over to ensure it's accurate/sound?

Once you do that, I think we can start publishing and sharing these results broadly.

ppelberg reassigned this task from ppelberg to MNeisler.May 22 2024, 7:34 PM

@ppelberg I finished reviewing and just made a few small corrections to fix typos and a broken link. The content looks good to me. This should be ready to now publish.

In T352131#9826159, @MNeisler wrote:

@ppelberg I finished reviewing and just made a few small corrections to fix typos and a broken link. The content looks good to me. This should be ready to now publish.

Wonderful – the findings are now published on mw:Edit check.

Thank you for reviewing, @MNeisler and thank you for the wonderful work conducting this experiment and summarizing the results which I have the privilege of publishing

I'm assigning this over to @Trizek-WMF to prepare a compressed version of what is now published on mw:Edit check that we can start sharing on-wiki with volunteers in a location they're likely to notice and be in a position to review these results...

ppelberg reassigned this task from MNeisler to Trizek-WMF.May 23 2024, 4:45 PM

ppelberg updated the task description. (Show Details)

ppelberg edited projects, added Editing-team (Tracking); removed Editing-team (Kanban Board).

ppelberg mentioned this in T365741: Present Reference Check A/B test findings at June staff meeting.May 23 2024, 4:50 PM

ppelberg updated the task description. (Show Details)

Trizek-WMF updated the task description. (Show Details)May 24 2024, 1:24 PM

We can combine the messages we will send with T331946: [RELEASE TICKET] Make Edit Check (references) available to all newcomers at all Wikipedias.

I grouped partner wikis and A/B test wikis, as the message works for both.

Trizek-WMF updated the task description. (Show Details)May 24 2024, 3:50 PM

ppelberg updated the task description. (Show Details)Tue, May 28, 6:12 PM

ppelberg added subscribers: • Geugeor-WMF, Dyolf77_WMF.

I've updated the task description to include that – in addition to @Trizek-WMF – @Geugeor-WMF and @Dyolf77_WMF will be sharing the Reference Check A/B Test results, per today's offline conversation.