Background
The Experiment Platform team have verified that the Experimentation Platform is capable of running a test on all visitors using the JS SDK (see T392313: [Epic] SDS 2.4.11 Run a Synthetic A/A Experiment and most recent update to Hypothesis SDS2.4.11 Synthetic A/A experiment / e2e testing of edge uniques for data collection in Asana). We would like to verify that it is capable of running a synthetic A/A test on logged-in visitors only using the PHP SDK.
To do this we will duplicate and tweak the experiment configuration for T395342: Configure synthetic A/A experiment in xLab:
| Detail | Configuration |
|---|---|
| Traffic allocation | English Wikipedia, 25% |
| Identifier type | mw-user |
| Duration | 14 days |
| Experiment name (machine-readable name) | "Logged-in Synthetic A/A Test (PHP SDK)" (synth-aa-test-mw-php) |
| Treatment group name (machine-readable name) | "Control 2" (control-2) "No changes for subjects in this group." |
| Instrumentation | PageVisit, producing action: "page-visited" events server-side |
| Metrics | "Page visits", "Page visits per hour" |
NOTE: The PageVisit experiment/instrument will have to be implemented using the PHP SDK.
AC
- Implement the PageVisit experiment/instrument using the PHP SDK
- Deploy the PHP PageVisit experiment/instrument
- The experiment's configuration is present in
- Experiment is registered for automated analysis in experiments registry
- Experiment is documented at https://wikitech.wikimedia.org/wiki/Metrics_Platform/List_of_active_and_archived_experiments