Background
The instrumentation was enabled by T409324 and T410533.
Related Documents
Instrumentation Spec
Measurement plan
Acceptance criteria
- check that all events are collected in the Data Lake at TK
Description
Description
Related Objects
Related Objects
Event Timeline
Comment Actions
Data QA summary of mobile sticky header instrument
Table: mediawiki_product_metrics_readerexperiments_stickyheaders
Here are the QA results based on the data collected between Dec 12 and Dec 18.
| Event to be tracked | Field value in table | Test result | Note |
|---|---|---|---|
| Send ticks at 30 second intervals | action=tick; action_context= count in string; | ✅ PASS | |
| Users click to fold the section on section headers (both control and treatment) | action=click, action_subtype=fold, action_source= section_header, action_context= page length bucket | ✅ PASS | |
| Users click to unfold the section on section headers (both control and treatment) | action=click, action_subtype=unfold, action_source= section_header, action_context= page length bucket; | ✅ PASS | We discovered that unfold events in the treatment group were abnormally high earlier. The engineer deployed a fix on December 17, and we have confirmed that the event volume has dropped. For subsequent analysis, we should use data starting from December 18. (See the trend in the chart below) |
| Users click to fold/unfold the section on sticky section headers (only treatment) | action=click, action_subtype= fold/unfold, action_source= sticky_section_header, action_context= page length bucket; | ✅ PASS | Same as above |
| User loads page | action= page-visited, action_context= page length bucket; | ✅ PASS | |
| Experiment bucketing | experiment.assigned | ✅ PASS | |
| Contextual attributes | |||
| By wiki | mediawiki.database | ✅ PASS | |
| platform | agent.client_platform_family | ✅ PASS | |
| logged-out | performer.is_logged_in, performer.is_temp | ✅ PASS | |
| namespace | page.namespace_id | ✅ PASS | |
{F71132115}