A/B Test (Caterpiller): Check that all is well with the languages by article count test
Closed, ResolvedPublic1 Estimated Story Points
Actions

Assigned To

Authored By

	debt
	Apr 29 2016, 9:04 PM

Description

This ticket will be for the Discovery-Analysis team to verify that the test is progressing as we want it to be, once it has been pushed into production.

Please refer to the epic for full details: https://phabricator.wikimedia.org/T131526

Related Objects
Search...

Status	Assigned	Task
Resolved	debt	T131526 [EPIC] Wikipedia.org A/B Test (Caterpiller): languages by article count
Resolved	mpopov	T134011 A/B Test (Caterpiller): Analyze the results of the languages by article count test
Resolved	debt	T134010 A/B Test (Caterpiller): Disable the test for the languages by article count
Resolved	mpopov	T134009 A/B Test (Caterpiller): Check that all is well with the languages by article count test
Resolved	Jdrewniak	T134008 A/B Test (Caterpiller): Implement the languages by article count test
Resolved	mpopov	T134007 A/B Test (Caterpiller): Specifications on the gathering of data for the languages by article count test
Resolved	Jdrewniak	T135558 Switch Portal EL & survey sampling algorithm to use seeded RNG

Event Timeline

debt created this task.Apr 29 2016, 9:04 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 29 2016, 9:04 PM

debt added a parent task: T131526: [EPIC] Wikipedia.org A/B Test (Caterpiller): languages by article count.Apr 29 2016, 9:10 PM

debt added a subtask: T134008: A/B Test (Caterpiller): Implement the languages by article count test.

debt added a parent task: T134010: A/B Test (Caterpiller): Disable the test for the languages by article count.

This should be ready to be done on Thursday.

mpopov claimed this task.Jun 6 2016, 11:07 PM

mpopov set the point value for this task to 1.

The test is in production now: https://www.wikipedia.org/#lang_dropdown-b

Yay! :)

mpopov moved this task from Backlog to In progress on the Discovery-Analysis (Current work) board.Jun 9 2016, 11:55 PM

Data appears OK. 45% of the sessions are in control group, and 55% of the sessions are in the test group, which is close enough to 50/50 that I'm not too concerned.

mpopov moved this task from In progress to Done on the Discovery-Analysis (Current work) board.Jun 10 2016, 8:40 PM

Yay!

debt closed this task as Resolved.Jun 14 2016, 11:19 PM

debt closed subtask T134008: A/B Test (Caterpiller): Implement the languages by article count test as Resolved.Jun 14 2016, 11:24 PM

debt moved this task from Done to Resolved on the Discovery-Analysis (Current work) board.Jul 20 2016, 4:22 PM

A/B Test (Caterpiller): Check that all is well with the languages by article count testClosed, ResolvedPublic1 Estimated Story PointsActions

Description

Related ObjectsSearch...

Event Timeline

A/B Test (Caterpiller): Check that all is well with the languages by article count test
Closed, ResolvedPublic1 Estimated Story Points
Actions

Related Objects
Search...