Follow up to: T407431: Growth's "48 hour" newcomer notifications: end A/B test experiment & release changes
User Story:
As the Growth team, I want reliable product health metrics that track engagement with newcomer notifications, so I can understand which messages draw interest and lead to clicks or taps.
Acceptance Criteria:
Create an analytics dashboard that displays the aggregate CTR for each of the following notifications:
- Get started
- Re-engage
- Keep going
In dashboard description provide a short definition of each notification audience, or link to: T407431
Example descriptions:
- Get Started: at 48 hours, delivered to users with 0 edits
- Keep Going: at 48 hours, delivered to users who have completed 0 suggested edits, but at least one edit, and less edits than max (max configured in Community Configuration)
- Re-engage: at 48 hours, delivered to users who have completed at least 1 suggested edit, but less than max (max configured in Community Configuration)
Notes:
- we need to figure out the right stream in xLab/TestKitchen for that -> consult docs / Experimentation Platform team
- The instrumentation code used for the experiment is in ext.growthExperiments.NotificationsTracking/EchoNotificationsTracker.js and is still configured for the experiment, see ext.growthExperiments.NotificationsTracking/index.js#13, hence not collecting data . We need to change the config to follow a long-lived setup, see Test_Kitchen/Measure_product_health