Page MenuHomePhabricator

Update traffic limits in TKUI for cache-splitting and non-cache splitting experiments
Closed, ResolvedPublic1 Estimated Story Points

Description

Decision Brief Complete Decision Brief

  • Updating external comms to ensure clarity around enrolled populations and rare actions

Acceptance Criteria [of recommended solution in Decision Brief]

  • In TKUI, update the maximum traffic limit for cache-splitting experiments on enwiki to 1%
  • In TKUI, implement action-based limits for non-cache splitting experiments:
  • Default setting has a maximum of 1% for enwiki and 10% for all other wikis for reader experiments
  • If user selects "Editing experiment" then change the maximum (i.e. validation limit) to 25% for enwiki and other all other wikis (this case will be evaluated and updated manually)
  • If a user selects "Account creation experiment" then change the maximum (i.e. validation limit) to 50% for enwiki and other all other wikis (this case will be evaluated and updated manually)
  • Documentation has been updated based on the above (https://wikitech.wikimedia.org/wiki/Test_Kitchen/Conduct_an_experiment#Experiment_design:_user_traffic_per_wiki)

Details

Related Changes in Gerrit:
Related Changes in GitLab:
TitleReferenceAuthorSource BranchDest Branch
Updated max traffic for enwiki for everyone experimentsrepos/data-engineering/test-kitchen!330sfaciT425367-update-max-trafficmain
Customize query in GitLab

Event Timeline

JVanderhoop-WMF renamed this task from Update traffic limits for cache-splitting and non-cache splitting exeriments to Update traffic limits in TKUI for cache-splitting and non-cache splitting experiments.May 4 2026, 5:28 PM
JVanderhoop-WMF triaged this task as High priority.
JVanderhoop-WMF added a project: OKR-Work.
Sfaci set the point value for this task to 1.

Change #1290803 had a related patch set uploaded (by Santiago Faci; author: Santiago Faci):

[operations/deployment-charts@master] Test Kitchen UI: Deploy v1.3.5 release to production

https://gerrit.wikimedia.org/r/1290803

Change #1290803 merged by jenkins-bot:

[operations/deployment-charts@master] Test Kitchen UI: Deploy v1.3.5 release to staging

https://gerrit.wikimedia.org/r/1290803

Change #1290916 had a related patch set uploaded (by Santiago Faci; author: Santiago Faci):

[operations/deployment-charts@master] test-kitchen chart: Updated to support growthbook specific configuration

https://gerrit.wikimedia.org/r/1290916

Change #1290932 had a related patch set uploaded (by Clare Ming; author: Clare Ming):

[operations/deployment-charts@master] Test Kitchen UI: Deploy v1.3.6 release to production

https://gerrit.wikimedia.org/r/1290932

Change #1290932 merged by jenkins-bot:

[operations/deployment-charts@master] Test Kitchen UI: Deploy v1.3.6 release to production

https://gerrit.wikimedia.org/r/1290932