Change Details

== Background Due to a bug in eventlogging (see T175918), we were not able to obtain correct session data for the previous hovercards a/b test on English and German wikipedias == Pre-deployment checklist: [x] Ensure data is removed from MySQL - See T174815#3650853 onwards. [x] The fix for T175918 is deployed to the group2 wikis. - At the time of writing, this'll happen on Thursday, 28th September. == Acceptance Criteria [] Launch a/b test on en- and dewiki. [] Create a task for pausing A/B test exactly two weeks after launch date. == Questions [x] What are the bucket sizes for each group per project? @phuedx: The bucket sizes that we used in {T172291} resulted in [[ https://grafana.wikimedia.org/dashboard/db/eventlogging-schema?orgId=1&from=1504094400000&to=1505754000000 | rates circa 300 events/second ]], which led to replication issues between the EventLogging MySQL databases (see T174815#3574066 onwards). | wiki | on:off:control | `$wgPopupsAnonsExperimentalGroupSize` | | -- | -- | -- | | enwiki | ~~0.03:0.03:0.94~~ 0.015:0.15:0.97 | ~~0.06~~ 0.03 | | dewiki | ~~0.08:0.08:0.84~~ 0.04:0.04:0.92 | ~~0.16~~ 0.08 |

== Background Due to a bug in eventlogging (see T175918), we were not able to obtain correct session data for the previous hovercards a/b test on English and German wikipedias == Pre-deployment checklist: [x] Ensure data is removed from MySQL - See T174815#3650853 onwards. [x] The fix for T175918 is deployed to the group2 wikis. - See T175918#3645697. [] Analytics Engineering confirms that the backend for Popups events has been switched to Hadoop from MySQL. == Acceptance Criteria [] Launch a/b test on en- and dewiki. [] Create a task for pausing A/B test exactly two weeks after launch date. == Questions [x] What are the bucket sizes for each group per project? @phuedx: The bucket sizes that we used in {T172291} resulted in [[ https://grafana.wikimedia.org/dashboard/db/eventlogging-schema?orgId=1&from=1504094400000&to=1505754000000 | rates circa 300 events/second ]], which led to replication issues between the EventLogging MySQL databases (see T174815#3574066 onwards). | wiki | on:off:control | `$wgPopupsAnonsExperimentalGroupSize` | | -- | -- | -- | | enwiki | ~~0.03:0.03:0.94~~ 0.015:0.15:0.97 | ~~0.06~~ 0.03 | | dewiki | ~~0.08:0.08:0.84~~ 0.04:0.04:0.92 | ~~0.16~~ 0.08 |

== Background Due to a bug in eventlogging (see T175918), we were not able to obtain correct session data for the previous hovercards a/b test on English and German wikipedias == Pre-deployment checklist: [x] Ensure data is removed from MySQL - See T174815#3650853 onwards. [x] The fix for T175918 is deployed to the group2 wikis. - At the time of writing, this'll happen on Thursday, 28th September- See T175918#3645697. [] Analytics Engineering confirms that the backend for Popups events has been switched to Hadoop from MySQL. == Acceptance Criteria [] Launch a/b test on en- and dewiki. [] Create a task for pausing A/B test exactly two weeks after launch date. == Questions [x] What are the bucket sizes for each group per project? @phuedx: The bucket sizes that we used in {T172291} resulted in [[ https://grafana.wikimedia.org/dashboard/db/eventlogging-schema?orgId=1&from=1504094400000&to=1505754000000 | rates circa 300 events/second ]], which led to replication issues between the EventLogging MySQL databases (see T174815#3574066 onwards). | wiki | on:off:control | `$wgPopupsAnonsExperimentalGroupSize` | | -- | -- | -- | | enwiki | ~~0.03:0.03:0.94~~ 0.015:0.15:0.97 | ~~0.06~~ 0.03 | | dewiki | ~~0.08:0.08:0.84~~ 0.04:0.04:0.92 | ~~0.16~~ 0.08 |