Verify that data from A/B test on suggester is coming through correctly (on or after 2015-09-09)
Closed, ResolvedPublic2 Estimated Story Points
Actions

Assigned To

Authored By

	• Deskana
	Sep 8 2015, 8:21 PM

Related Objects
Search...

Status	Assigned	Task
Resolved	mpopov	T111858 Analyze results of A/B test on suggester (on or after 2015-09-22)
Resolved	mpopov	T112813 Verify that data from A/B test on suggester is coming through correctly (on or after 2015-09-17) redux
Resolved	EBernhardson	T112585 Fix CompletionSuggestion data collection and re-start the test.
Resolved	mpopov	T111857 Verify that data from A/B test on suggester is coming through correctly (on or after 2015-09-09)
Resolved	EBernhardson	T111078 Run A/B test on the search suggester to measure zero results rate, starting on 2015-09-08
Resolved	EBernhardson	T111091 Allow extensions to change the method used to get suggestion results
Resolved	EBernhardson	T111137 Override core suggester in AB test between current suggestions and the experimental cirrus-suggest api

Event Timeline

• Deskana created this task.Sep 8 2015, 8:21 PM

• Deskana raised the priority of this task from to High.

• Deskana updated the task description. (Show Details)

• Deskana added a project: Discovery-ARCHIVED.

• Deskana subscribed.

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 8 2015, 8:21 PM

Ironholds moved this task from Needs triage to Analysis on the Discovery-ARCHIVED board.Sep 8 2015, 8:21 PM

• Deskana renamed this task from Verify that data from A/B test on suggester is coming through correctly (on or after 2015-08-09) to Verify that data from A/B test on suggester is coming through correctly (on or after 2015-09-09).Sep 8 2015, 8:23 PM

• Deskana set Security to None.

• Deskana added a project: Discovery-Analysis (Current work).

• Deskana added a subtask: T109018: Run an A/B test based on the phrase slop setting in Cirrus.Sep 9 2015, 2:38 AM

• Deskana added a parent task: T111858: Analyze results of A/B test on suggester (on or after 2015-09-22).

mpopov claimed this task.Sep 10 2015, 4:08 PM

mpopov moved this task from Backlog to In progress on the Discovery-Analysis (Current work) board.

mpopov edited a custom field.

• ksmith moved this task from Analysis to On Sprint Board on the Discovery-ARCHIVED board.Sep 10 2015, 8:12 PM

Status update: there is an ongoing email thread about the quality/validity of the data.

Ironholds moved this task from Stalled/Waiting to Done on the Discovery-Analysis (Current work) board.Sep 15 2015, 8:24 PM

We verified that the data is not coming through correctly, but that does mean that this task is resolved. Follow-up tasks should be filed to actually fix the A/B test and restart it.