Page MenuHomePhabricator
Create Task
Maniphest T422823

Update logged in/out reader retention rate AA instrumentation
Closed, ResolvedPublic1 Estimated Story Points
Actions

Description

https://gerrit.wikimedia.org/r/plugins/gitiles/mediawiki/extensions/WikimediaEvents/+/master/modules/ext.wikimediaEvents/testKitchen/loggedOutReaderRetention.js should call sendExposure() before T421740: Switch experiment_assignment_v1 to use experiment_exposure events happens, so that we can continue to have these repeat A/As analyzed in GrowthBook.

Let's also address some minor issues with the code.

Acceptance criteria

Related Objects
Search...

Event Timeline

mpopov created this task.Apr 9 2026, 1:04 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 9 2026, 1:04 PM
mpopov renamed this task from Update logged out reader retention rate AA instrumentation to Update logged in/out reader retention rate AA instrumentation.Apr 9 2026, 1:14 PM
mpopov updated the task description. (Show Details)
mpopov added a comment.Apr 9 2026, 1:46 PM

Logged-in AA instrumentation uses a custom stream (mediawiki.product_metrics.reader_retention_logged_in, sigh). We should switch it to use the base stream, configure the logged-in AAs contextual attributes in TK UI, and decommission the custom stream.

mpopov claimed this task.Apr 10 2026, 7:51 PM
mpopov triaged this task as Medium priority.
mpopov edited projects, added Test Kitchen (Test Kitchen (Experiment Platform Sprint 22)); removed Test Kitchen.
mpopov set the point value for this task to 1.
mpopov moved this task from Ready for Development to Needs Review on the Test Kitchen (Test Kitchen (Experiment Platform Sprint 22)) board.
mpopov mentioned this in T422971: Make experiment_assignment_v1 backwards compatible with logged out retention AAs.Apr 10 2026, 8:54 PM
mpopov added a project: Essential-Work.
mpopov added a parent task: T421740: Switch experiment_assignment_v1 to use experiment_exposure events.Apr 10 2026, 9:27 PM
mpopov mentioned this in T421740: Switch experiment_assignment_v1 to use experiment_exposure events.
AnneT subscribed.Apr 13 2026, 1:29 PM
In T422823#11804471, @mpopov wrote:

Logged-in AA instrumentation uses a custom stream (mediawiki.product_metrics.reader_retention_logged_in, sigh). We should switch it to use the base stream, configure the logged-in AAs contextual attributes in TK UI, and decommission the custom stream.

Hey @mpopov, we did this to ensure we were not collecting more data than needed (see the thread starting with this comment - we wanted to ensure we were not collecting page info). Can you confirm that, with the updated stream configuration options, we will only collect the attributes that we select?

ReleaseTaggerBot added a project: MW-1.46-notes (1.46.0-wmf.24; 2026-04-14).Apr 13 2026, 4:00 PM
mpopov added a comment.Apr 13 2026, 4:55 PM

Can you confirm that, with the updated stream configuration options, we will only collect the attributes that we select?

@AnneT: Yep, starting with round 2 you can just use the default web base stream and select the desired contextual attributes in TK UI.

AnneT added a comment.Apr 13 2026, 4:56 PM

@mpopov awesome, thanks!

mpopov moved this task from Needs Review to Done on the Test Kitchen (Test Kitchen (Experiment Platform Sprint 22)) board.Mon, Apr 20, 3:07 PM
KReid-WMF closed this task as Resolved.Thu, Apr 23, 3:13 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits