Define wikis that will participate in A/B test of sticky header editing functionality
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	ppelberg
	Dec 23 2021, 10:56 PM

Description

This task is about identifying the Wikipedias that will participate in the A/B test of the sticky header editing functionality.

There are two parts to this task:

Identifying potential wikis for inclusion in the sticky header editing functionality test
Confirming with these wikis that they are comfortable participating in the sticky header editing functionality A/B test

Selection requirements

TBD

Candidate wikis

Wiki	Code	Status (e.g. participation confirmed)
Thai Wikipedia*	th.wiki
Vietnamese Wikipedia*	vi.wiki
Indonesian Wikipedia*	id.wiki
Basque Wikipedia	eu.wiki
French Wikipedia	fr.wiki
French Wiktionary	fr.wikitionary
Hebrew Wikipedia	he.wiki
Persian Wikipedia	fa.wiki
Portuguese Wikiversity	pt.wikiversity
Office Wiki	office.wiki
Bengali Wikipedia	bn.wiki
German Wikivoyage	de.wikivoyage
Korean Wikipedia	ko.wiki
Portuguese Wikipedia	pt.wiki
Serbian Wikipedia	sr.wiki
Turkish Wikipedia	tr.wiki
Venetian Wikipedia	vec.wiki
Wikimedia Incubator	incubator.wikimedia

* = the start of this A/B test will mark the first time these wikis are gaining access to the sticky header.

Done

Verify the ===Candidate wikis will produce a sufficient amount and diversity of usage data for us to draw conclusions from
Document which of the ===Candidate wikis are and are not open to participating in the A/B test

Related Objects
Search...

Status	Assigned	Task
Resolved	ovasileva	T283505 [EPIC] Fixed "sticky" site header
Resolved	Jdlrobson	T287545 [EPIC] Introduce editing functionality to the sticky header
Resolved	ppelberg	T294506 Run A/B test to evaluate impact of sticky header editing affordance
Resolved	ovasileva	T298280 Define wikis that will participate in A/B test of sticky header editing functionality

Event Timeline

ppelberg created this task.Dec 23 2021, 10:56 PM

Meta
@ovasileva: per the conversation we had on 10-December-2021, I'm assigning this task over to you to populate the task description's ===Candidate wikis section with the pilot/test wikis you had in mind for approaching about participating in the A/B test we plan to run of the sticky header w/ editing functionality included (T294506).

ovasileva updated the task description. (Show Details)Jan 4 2022, 12:56 PM

@ppelberg - added the two wikis I think would be the best fit for the A/B test (thwiki and viwiki). The full list of pilot wikis is available at T298519: Turn on desktop improvements on new set of pilot wikis. Let me know if you'd like to expand with other wikis from the list.

ovasileva moved this task from Incoming to Not ready to estimate on the Web-Team-Backlog-Archived board.Jan 6 2022, 12:15 PM

ovasileva reassigned this task from ovasileva to ppelberg.Jan 6 2022, 12:18 PM

Jdlrobson moved this task from Incoming to Sticky header on the Vector 2022 board.Jan 6 2022, 4:15 PM

Next step

@ppelberg + @MNeisler: to communicate whether they would value additional wikis being included in the A/B test, beyond th.wiki and vi.wiki.

Note: any wiki that is NOT included in the list below would require the Web Team approaching them about opting into the suite of Desktop Improvements features being turned on before we could even have the conversation about participating in an A/B test of the sticky header.

Basque Wikipedia
French Wikipedia
French Wiktionary
Hebrew Wikipedia
Persian Wikipedia
Portuguese Wikiversity
Office Wiki
Bengali Wikipedia
German Wikivoyage
Korean Wikipedia
Portuguese Wikipedia
Serbian Wikipedia
Turkish Wikipedia
Venetian Wikipedia
Wikimedia Incubator

ppelberg edited projects, added Editing-team (Kanban Board); removed Editing-team (Tracking).Jan 13 2022, 5:53 PM

ppelberg moved this task from Inbox to Ready for Sign Off on the Editing-team (Kanban Board) board.

In T298280#7620139, @ppelberg wrote:

Next step

@ppelberg + @MNeisler: to communicate whether they would value additional wikis being included in the A/B test, beyond th.wiki and vi.wiki.

Per the conversations @MNeisler, @ovasileva, and I had offline this week, the Editing Team would value the wikis listed in T298280#7620139 being included in the A/B test.

With the above in mind, I've added a note to T294506 to remind us that when doing the analysis we will need to consider the fact that by including the wikis in T298280#7620139 the test will include two control groups:

One control group will have access to the sticky header without editing functionality included
One control group will not have any access to the sticky header

ppelberg updated the task description. (Show Details)Jan 22 2022, 12:44 AM

Restricted Application added subscribers: Huji, revi. · View Herald TranscriptJan 22 2022, 12:44 AM

ppelberg updated the task description. (Show Details)Jan 22 2022, 12:44 AM

ppelberg updated the task description. (Show Details)

ppelberg mentioned this in T294506: Run A/B test to evaluate impact of sticky header editing affordance.Jan 22 2022, 12:49 AM

ppelberg updated the task description. (Show Details)Jan 24 2022, 7:19 PM

Update

I've added id.wiki to the list of participating wikis in the task description, per conversation with @ovasileva

Next steps

@ovasileva to resolve this task considering the Web Team will be implementing the actual A/B test bucketing (T299959).

ppelberg reassigned this task from ppelberg to ovasileva.Jan 24 2022, 7:30 PM

ppelberg edited projects, added Editing-team (Tracking); removed Editing-team (Kanban Board).

ppelberg moved this task from Backlog to Dependent on others on the Editing-team (Tracking) board.

Sounds good, thanks @ppelberg! Resolving.

Define wikis that will participate in A/B test of sticky header editing functionality Closed, ResolvedPublicActions