| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T228175 Event Platform Client Libraries | |||
| Resolved | Sharvaniharan | T228179 Event Platform Client — Android | |||
| Resolved | Sharvaniharan | T286000 Android Legacy to MEP Instrumentation - MobileWikiAppDailyStats | |||
| Resolved | SNowick_WMF | T286001 Android Legacy to MEP Data QA - MobileWikiAppDailyStats |
Event Timeline
For data QA will be comparing directional trend between MEP and Legacy data using sample daily retention rates, distribution of user`appInstallAgeDays` over time and distribution of is_anon true/false over time.
@SNowick_WMF This is unblocked and in beta for analyzing >=2.7.50378-beta-2021-10-13 version.
The following is comparison of retention data for Legacy vs MEP datasets, isolated by app version, and, because app release dates are usually less than 7 days, the last comparison is for combined versions to obtain a 7 Day Retention figure. Thanks to @mpopov for refining and validating retention query process.
Version 2.7.50382-r-2021-10-25
| Dataset | Avg 1 Day Retention | Avg 3 Day Retention |
|---|---|---|
| Legacy | 24.07% | 27.60% |
| MEP | 25.98% | 29.83% |
| Difference (Legacy - MEP) | -1.91 | -2.22 |
| Percent Change | -1.91% | -1.94% |
Version 2.7.50383-r-2021-11-02
| Dataset | Avg 1 Day Retention | Avg 3 Day Retention |
|---|---|---|
| Legacy | 22.47% | 23.24% |
| MEP | 24.36% | 25.32% |
| Difference (Legacy - MEP) | -1.89 | -2.08 |
| Percent Change | -2.02% | -2.14% |
Combined versions ( 2.7.50382-r-2021-10-25, 2.7.50383-r-2021-11-02, 2.7.50384-r-2021-11-08 & 2.7.50385-r-2021-11-15)
| Dataset | Avg 1 Day Retention | Avg 3 Day Retention | Avg 7 Day Retention |
|---|---|---|---|
| Legacy | 24.48% | 30.47% | 29.66% |
| MEP | 26.54% | 33.23% | 27.85% |
| Difference (Legacy - MEP) | -2.06 | -2.76 | 1.81 |
| Percent Change | -2.02% | -2.16% | 1.57% |