Background
As part of T370209 ([EPIC] Experiment: Display article recommendations in more prominent locations) we're running an experiment (T373584-Build second recommendation experiment within browser extension) where users who download our browser extension get shown article recommendations in the sidebar:
The goal of this task is to analyse the instrumentation and metrics from this experiment.
Requirements
The instrumentation for this experiment is stored in StatsD and is accessible via Graphite queries. Although the experiment was running on many wikis, we're interested in results for English Wikipedia and Spanish Wikipedia.
Metrics definitions
- enabled - MediaWiki.experiment.web.sidebar.enwiki.enabled.count - Event sent on each pageview for each experiment participant.
- click - MediaWiki.experiment.web.sidebar.enwiki.click.count - Event sent every time an experiment participant clicks on a recommended article.
- time-range: Use the 2 weeks of data prior to October 15, considering the issue discussed at slack.
- For the purposes of this experiment, we're assuming participants get shown recommendations on each pageview, which corresponds to the enabled event.
Daily enabled/click metrics are available for export from the following Grapha dashboard:
https://grafana-rw.wikimedia.org/d/d3d538c9-00c3-4b4f-9e79-71cfcb3f0c75/web-experiments?forceLogin=&orgId=1&from=1726001580000&to=1728489045020&viewPanel=8
