Turn off TextCat A/B test on the English Wikipedia on or after May 23
Closed, ResolvedPublic
Actions

Description

A week after the A/B test has been turned on (see T121542) and with the data pipeline verified (see T134318), we should turn the A/B test off.

Details

Subject	Repo	Branch	Lines +/-
Turn off textcat subtest of search satisfaction	mediawiki/extensions/WikimediaEvents	wmf/1.28.0-wmf.4	+8 -35
Turn off textcat subtest of search satisfaction	mediawiki/extensions/WikimediaEvents	wmf/1.28.0-wmf.3	+8 -35
Turn off textcat subtest of search satisfaction	mediawiki/extensions/WikimediaEvents	master	+8 -35

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Open	None	T118278 [EPIC] Improve Language Identification for use in Cirrus Search
Resolved	EBernhardson	T121543 Do an A/B Tests on Other Wikis with TextCat for Language Identification
Resolved	EBernhardson	T137158 Compile and then resolve issues with TextCat A/B test data
Declined	mpopov	T134320 Analyse results of TextCat A/B test
Resolved	EBernhardson	T130321 Disable Schema:Search, since it's outdated and redundant
Resolved	mpopov	T129564 Switch Desktop data collection for dashboards to use TestSearchSatisfaction2 instead of Search schema
Resolved	EBernhardson	T134319 Turn off TextCat A/B test on the English Wikipedia on or after May 23
Resolved	debt	T134318 Verify data pipeline for TextCat A/B test on English Wikipedia
Resolved	EBernhardson	T121542 Write and deploy an A/B Test on enwiki using TextCat for Language Identification
Resolved	dcausse	T121540 Investigate Updating Cybozu / ES Plugin for Language Identification
Resolved	EBernhardson	T124844 Add textcat to mediawiki vendor libs
Resolved	Smalyshev	T121538 Convert TextCat to PHP Library for Language Identification in Cirrus Search
Resolved	TJones	T123537 Generate wikitext-based and query-based language models for TextCat
Resolved	TJones	T123651 Decide which set of separators we have to use for TextCat ngrams
Resolved	• dpatrick	T123558 Security review for TextCat library
Resolved	mpopov	T132706 Validate click events in TestSearchSatisfaction2

Event Timeline

• Deskana created this task.May 3 2016, 9:46 PM

Restricted Application added subscribers: Zppix, Aklapper. · View Herald TranscriptMay 3 2016, 9:46 PM

• Deskana triaged this task as Medium priority.May 3 2016, 9:48 PM

• Deskana mentioned this in T134320: Analyse results of TextCat A/B test.

• Deskana added a parent task: T134320: Analyse results of TextCat A/B test.

• Deskana added a subtask: T134318: Verify data pipeline for TextCat A/B test on English Wikipedia.

EBernhardson renamed this task from Turn off TextCat A/B test on the English Wikipedia to Turn off TextCat A/B test on the English Wikipedia on or after May 23.May 23 2016, 4:49 PM

Change 290820 had a related patch set uploaded (by EBernhardson):
Turn off textcat subtest of search satisfaction

https://gerrit.wikimedia.org/r/290820

gerritbot added a project: Patch-For-Review.May 25 2016, 10:48 PM

EBernhardson claimed this task.May 25 2016, 10:48 PM

EBernhardson moved this task from Incoming to Needs review on the Discovery-Search (Current work) board.

Hi @EBernhardson - do we have a date to turn this off?

debt mentioned this in T129564: Switch Desktop data collection for dashboards to use TestSearchSatisfaction2 instead of Search schema.May 31 2016, 8:09 PM

Change 290820 merged by jenkins-bot:
Turn off textcat subtest of search satisfaction

https://gerrit.wikimedia.org/r/290820

Change 292046 had a related patch set uploaded (by EBernhardson):
Turn off textcat subtest of search satisfaction

https://gerrit.wikimedia.org/r/292046

Change 292048 had a related patch set uploaded (by EBernhardson):
Turn off textcat subtest of search satisfaction

https://gerrit.wikimedia.org/r/292048

Change 292048 merged by jenkins-bot:
Turn off textcat subtest of search satisfaction

https://gerrit.wikimedia.org/r/292048

Change 292046 merged by jenkins-bot:
Turn off textcat subtest of search satisfaction

https://gerrit.wikimedia.org/r/292046

Mentioned in SAL [2016-05-31T23:28:32Z] <dereckson@tin> Synchronized php-1.28.0-wmf.4/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: Turn off textcat subtest of search satisfaction (T134319) (duration: 00m 30s)

Mentioned in SAL [2016-05-31T23:37:44Z] <dereckson@tin> Synchronized php-1.28.0-wmf.3/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: Turn off textcat subtest of search satisfaction (T134319) (duration: 00m 23s)

ReleaseTaggerBot added projects: MW-1.28-release (WMF-deploy-2016-06-07_(1.28.0-wmf.5)), MW-1.28-release (WMF-deploy-2016-05-31_(1.28.0-wmf.4)), MW-1.28-release (WMF-deploy-2016-05-24_(1.28.0-wmf.3)).Jun 1 2016, 3:01 AM

EBernhardson moved this task from Needs review to Needs Reporting on the Discovery-Search (Current work) board.Jun 3 2016, 12:46 AM

Looks like this is resolved - closing.

debt closed subtask T134318: Verify data pipeline for TextCat A/B test on English Wikipedia as Resolved.Jun 8 2016, 12:43 AM

Turn off TextCat A/B test on the English Wikipedia on or after May 23Closed, ResolvedPublicActions

Description

Details

Related ObjectsSearch...

Event Timeline

Turn off TextCat A/B test on the English Wikipedia on or after May 23
Closed, ResolvedPublic
Actions

Related Objects
Search...