Page MenuHomePhabricator
Create Task
Maniphest T109762

Perform final analysis for the second A/B test, write report, and publish it to Meta
Closed, ResolvedPublic4 Estimated Story Points
Actions

Description

Perform a final analysis of all 7 days of data for the second Cirrus A/B test

Related Objects

Event Timeline

Ironholds created this task.Aug 20 2015, 8:19 PM
Ironholds raised the priority of this task from to High.
Ironholds updated the task description. (Show Details)
Ironholds added a project: Discovery-ARCHIVED.
Ironholds subscribed.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 20 2015, 8:19 PM
Ironholds moved this task from Needs triage to Analysis on the Discovery-ARCHIVED board.Aug 20 2015, 8:20 PM
• Deskana added a project: Discovery-Analysis (Current work).Aug 27 2015, 8:08 PM
• Deskana set Security to None.
• Deskana merged a task: T109763: Report on the second A/B test.
• Deskana renamed this task from Perform final analysis for the second A/B test to Perform final analysis for the second A/B test, write report, and publish it to Meta.Aug 27 2015, 8:10 PM
• ksmith moved this task from Analysis to On Sprint Board on the Discovery-ARCHIVED board.Aug 27 2015, 8:10 PM
mpopov claimed this task.Aug 31 2015, 5:14 PM
mpopov moved this task from Backlog to In progress on the Discovery-Analysis (Current work) board.
mpopov edited a custom field.
• Deskana moved this task from In progress to Stalled/Waiting on the Discovery-Analysis (Current work) board.Sep 1 2015, 8:05 PM
mpopov added a comment.Sep 1 2015, 10:38 PM

Progress update: my log-processing scripts are running on the 11 days of data we have. User agent parsing gonna take a while.

mpopov moved this task from Stalled/Waiting to In progress on the Discovery-Analysis (Current work) board.Sep 2 2015, 6:32 PM
• Deskana subscribed.Sep 3 2015, 8:22 PM

@mpopov is hoping to have a first pass on this available by tomorrow afternoon.

mpopov added a comment.Sep 5 2015, 2:33 AM

Ready for @Ironholds' review:

mpopov moved this task from In progress to Needs review on the Discovery-Analysis (Current work) board.Sep 5 2015, 2:33 AM
Ironholds added a comment.Sep 5 2015, 5:41 AM

LGTM

Ironholds moved this task from Needs review to Done on the Discovery-Analysis (Current work) board.Sep 5 2015, 5:42 AM
mpopov added a comment.Sep 7 2015, 6:20 PM

Someone needs to give me upload permissions on Meta so I can include the plots in the report https://meta.wikimedia.org/wiki/Research:Reducing_Zero_Result_Searches_Through_Elasticsearch_Slop_Parameter_Changes

• Deskana added a comment.Sep 7 2015, 6:25 PM
In T109762#1614426, @mpopov wrote:

Someone needs to give me upload permissions on Meta

Done.

mpopov added a comment.Sep 7 2015, 6:39 PM

@Deskana Thank you very much!

mpopov added a comment.Sep 7 2015, 6:54 PM

Okie dokie, done: https://meta.wikimedia.org/wiki/Research:Reducing_Zero_Result_Searches_Through_Elasticsearch_Slop_Parameter_Changes

THE figure is: https://meta.wikimedia.org/wiki/File:Slop_odds_ratios_over_time.png

• Deskana closed this task as Resolved.Sep 24 2015, 4:06 AM
• Deskana moved this task from Done to Resolved on the Discovery-Analysis (Current work) board.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits