Page MenuHomePhabricator
Create Task
Maniphest T236338

QA new bucketing patch
Closed, ResolvedPublic
Actions

Description

This task is about making sure the new approach to bucketing contributors (T236337) is working as we expect it to.

Done

  • 1. Contributors are being assigned to test buckets correctly

Related Objects
Search...

Event Timeline

• ppelberg created this task.Oct 24 2019, 12:19 AM
• ppelberg mentioned this in T235101: Rerun mobile VE as default A/B test.
• ppelberg mentioned this in T235104: QA for EventLogging patch.
• ppelberg reassigned this task from • ppelberg to Mayakp.wiki.Oct 28 2019, 1:59 PM
• ppelberg added a project: Product-Analytics.
LGoto triaged this task as Medium priority.Oct 28 2019, 4:38 PM
LGoto edited projects, added Product-Analytics (Kanban); removed Product-Analytics.
• ppelberg added a comment.Oct 28 2019, 8:35 PM
In T235104#5603826, @matmarex wrote:

I can answer as well – I don't think it will be necessary to re-check those. We should only re-check that the buckets are balanced 50-50.

Considering the above, I am removing the "⚠️ This list being complete depends on the question asked in T235104 being answered." disclaimer from the task description.

• ppelberg updated the task description. (Show Details)Oct 28 2019, 8:35 PM
• ppelberg added a comment.Oct 28 2019, 8:39 PM

Quick update: this patch should be ready for QA this Thursday, 31-October.

By this time, T236337 will be deployed and so too will the config change [1] needed to turn the A/B test back on.

See T236337#5613244 for additional context.

cc @Mayakp.wiki

  1. https://gerrit.wikimedia.org/r/546724
• ppelberg added a comment.Oct 31 2019, 6:41 PM
In T236338#5613269, @ppelberg wrote:

Quick update: this patch should be ready for QA this Thursday, 31-October.

Correction: this patch will be ready for testing tomorrow, 1-Nov.

Reason: this patch will be merged during this afternoon's 4pm-5pm PST SWAT window.

Mayakp.wiki added a comment.Oct 31 2019, 9:21 PM

Thanks @ppelberg for the update.

Mayakp.wiki added a comment.EditedNov 16 2019, 1:23 AM

Checked that the buckets are Balancing correctly - overall as well by Browser and Country. Updated values provided in this document Refer Tab : T236338.
Will add notebook to Github as well.

Mayakp.wiki closed this task as Resolved.Nov 16 2019, 1:24 AM
Mayakp.wiki moved this task from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.
• ppelberg added a comment.Nov 19 2019, 2:03 AM
In T236338#5668607, @Mayakp.wiki wrote:

Checked that the buckets are Balancing correctly - overall as well by Browser and Country. Updated values provided in this document Refer Tab : T236338.
Will add notebook to Github as well.

This looks great – thank you, Maya.

• ppelberg updated the task description. (Show Details)Nov 19 2019, 2:03 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL