5 Day Indicator Analysis:

I am not able to verify this with the current build/text. Will check in next AB test.

Prod data passed for app version 50610-r-2026-10-06

Note: I have revised the 15 Day Analysis results (see above), my Treatment results were undercounting Saved engaged cohort who had upgraded app versions during experiment period, my queries missed an upgrade version. Now that's been included the correct versions (we had 4 releases including the initial Post-release version) the comparison between Treatment and Control is less stark. We still see decreases (except for share of Saved Engaged uniques which went up). Haley has mapped out further analysis in a separate task https://phabricator.wikimedia.org/T439636 which I will be working on next week.

Semantic Search Phase 2 Data Instrumentation Planning Deck

Verifying I am seeing data for build 6184-beta-2026-09-25 but only seeing users where experiment.assigned= control

Build '50609-beta' event data looks good (I can see new action_context "topics_count` and articles_count values, very cool!)

iOS For You Feed Analysis Results
Data

Noting here Count iOS New Installs has been resolved https://phabricator.wikimedia.org/T417472#12072727

KR 1: 5% increase in Home Feed second day return for treatment group vs control for eligible users (have at least one Topic interest)
Result: We saw a -1.4% decrease in 2nd Day Return Rate for eligible New Article Home Feed uniques

GrowthBook Experiment Results:
Android For You Feed New Article Module AB Test Redux

@ABendall-WMF
Need to decide evaluation duration and feature analysis due date, recommend at least 21 days since we are looking at 2nd Week feature return rate.

5 Day Indicator
Goal: 10% of unique users who see Reminder prompt set up a Reminder
Result: So far 3.9% of uniques who have seen the Reminder Config have setup a Reminder

Data Validation for iOS Prod 6169:

We monitored this AB Test in Growthbook SN will conduct Measurement Plan analysis and report here at end of experiment 30 Day duration.

Prod has passed except for below:

Data validation Passed for Prod release 6175-r-2026-09-15

Verifying I am seeing revision tag values for app web edit android and app web edit ios in event.mediawiki_revision_tags_change data

Looking at For You Load Time by Interests Selected by New Article Module AB Test Group Assigned

Added Tables for Android For You Median Load Time by Wiki and Load Time by Wiki and by AB New ArticleTreatment Group, > 50 events, Date Range Past 3 Days to Dashboard

Latency data has been validated.