Maniphest T137170

Part Deux: TextCat A/B test for Language Identification - analysis of results
Closed, ResolvedPublic4 Estimated Story Points
Actions

Assigned To

Authored By

	debt
	Jun 6 2016, 11:17 PM

Tags

Referenced Files

None

Subscribers

Description

This is a continuation - with modifications - of a test that started in https://phabricator.wikimedia.org/T121543.

This ticket is to do the analysis of the test.

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		mpopov	T137170 Part Deux: TextCat A/B test for Language Identification - analysis of results
		Resolved		EBernhardson	T137169 Part Deux: TextCat A/B test for Language Identification - turn off test
		Resolved		mpopov	T137168 Part Deux: TextCat A/B test for Language Identification - ensure test is going well
		Resolved		EBernhardson	T137167 Part Deux: TextCat A/B test for Language Identification - create and deploy
		Resolved		EBernhardson	T137163 Part Deux: TextCat A/B test for Language Identification - specification

Event Timeline

debt created this task.Jun 6 2016, 11:17 PM

Restricted Application added a project: Discovery-Search. · View Herald TranscriptJun 6 2016, 11:17 PM

Restricted Application added subscribers: Zppix, Aklapper. · View Herald Transcript

debt added a subtask: T137169: Part Deux: TextCat A/B test for Language Identification - turn off test.Jun 6 2016, 11:17 PM

debt added subtasks: T137168: Part Deux: TextCat A/B test for Language Identification - ensure test is going well, T137167: Part Deux: TextCat A/B test for Language Identification - create and deploy, T137163: Part Deux: TextCat A/B test for Language Identification - specification.Jun 6 2016, 11:20 PM

debt removed projects: CirrusSearch, Discovery-Search.Jun 6 2016, 11:24 PM

debt triaged this task as Medium priority.Jun 16 2016, 5:26 PM

debt moved this task from Needs triage to Up Next on the Discovery-Analysis board.

mpopov claimed this task.Jun 21 2016, 8:16 PM

mpopov edited projects, added Discovery-Analysis (Current work); removed Discovery-Analysis.

mpopov set the point value for this task to 4.

mpopov moved this task from Backlog to In progress on the Discovery-Analysis (Current work) board.Jun 23 2016, 10:54 PM

Deskana closed subtask T137163: Part Deux: TextCat A/B test for Language Identification - specification as Resolved.Jul 7 2016, 7:20 PM

Deskana closed subtask T137168: Part Deux: TextCat A/B test for Language Identification - ensure test is going well as Resolved.

Deskana closed subtask T137167: Part Deux: TextCat A/B test for Language Identification - create and deploy as Resolved.

First draft (https://github.com/wikimedia-research/Discovery-Search-Test-TextCat/blob/master/report.pdf) off to Trey's review!

mpopov moved this task from In progress to Needs review on the Discovery-Analysis (Current work) board.Jul 12 2016, 5:36 PM

mpopov moved this task from Needs review to In progress on the Discovery-Analysis (Current work) board.Jul 12 2016, 8:15 PM

Second draft is under Trey's review now https://github.com/wikimedia-research/Discovery-Search-Test-TextCat/blob/master/report.pdf

mpopov moved this task from In progress to Needs review on the Discovery-Analysis (Current work) board.Jul 12 2016, 11:58 PM

mpopov moved this task from Needs review to In progress on the Discovery-Analysis (Current work) board.Jul 13 2016, 5:22 PM

Final draft: https://commons.wikimedia.org/wiki/File:Report_on_Cirrus_Search_TextCat_AB_Test_-_Language_Detection_on_English,_French,_Spanish,_Italian,_and_German_Wikipedias.pdf

mpopov moved this task from In progress to Done on the Discovery-Analysis (Current work) board.Jul 13 2016, 9:48 PM

minor quibble, It reads funny without the "we" in there, and as long as changing it the "just" seems unnecessary.

"what if just searched" -> "what if we searched".

Oops. Will correct and upload a corrected version.

debt closed this task as Resolved.Jul 20 2016, 4:19 PM

debt moved this task from Done to Resolved on the Discovery-Analysis (Current work) board.Jul 20 2016, 4:22 PM

debt closed subtask T137169: Part Deux: TextCat A/B test for Language Identification - turn off test as Resolved.Jul 21 2016, 6:10 PM