Page MenuHomePhabricator

Tracking contributions made by contributors enrolled in A/B tests
Open, NormalPublic

Description

Problem

As edits are made using experimental features (or not, if they're in a control group) by editors enrolled into A/B tests (see T208438), we'll want to track those edits.

Solution

Instead of tagging edits – which requires patching MW extensions and waiting for their deployment and which are then seen by everyone – it's probably better to use EventLogging and send info as events.

Schema Draft

Here's how the EL schema can possibly look like:

FieldPurpose
user_idnumeric user ID, unique per-wiki but not globally
user_nameusername, unique globally
testname of the A/B test (e.g. team name + feature name
groupwhich group the user is in, e.g. "control" or "treatment"/"intervention"
revision_idID of the edit

Event Timeline

mpopov created this task.Oct 31 2018, 4:40 PM
nettrom_WMF moved this task from Triage to Backlog on the Product-Analytics board.Nov 9 2018, 7:40 PM
mpopov triaged this task as Normal priority.Jun 28 2019, 6:38 PM
mpopov added a project: Better Use Of Data.