Page MenuHomePhabricator

Event Platform Client — Android
Closed, ResolvedPublic

Description

Task for discussing the integration of the new MEP client for the Android Wikipedia app. Subtasks can be created as needed.

Event Timeline

Assuming this task is about Product-Analytics / Product-Infrastructure-Team-Backlog hence adding project tags so others can find this task under these projects.

jlinehan triaged this task as Medium priority.Jul 18 2019, 5:53 PM
jlinehan moved this task from Inbox to Epics on the Better Use Of Data board.
jlinehan moved this task from Epics to Inbox on the Better Use Of Data board.
jlinehan moved this task from Inbox to Epics on the Better Use Of Data board.
jlinehan renamed this task from Event Platform Client Library: Android to EPC Implementation: Android.Aug 27 2019, 1:22 PM
jlinehan renamed this task from EPC Implementation: Android to EPC Impl: Android.Aug 27 2019, 1:39 PM
jlinehan renamed this task from EPC Impl: Android to EPC Implementation: Android.Aug 27 2019, 1:43 PM
jlinehan renamed this task from EPC Implementation: Android to EPC Android Implementation.
jlinehan renamed this task from EPC Android Implementation to EPC Android.Aug 27 2019, 1:48 PM
jlinehan raised the priority of this task from Medium to High.Sep 10 2019, 3:39 PM
jlinehan renamed this task from EPC Android to MEP Client Android.Feb 18 2020, 4:07 PM
jlinehan updated the task description. (Show Details)
jlinehan added a subscriber: mpopov.
Mholloway renamed this task from MEP Client Android to Event Platform Client — Android.Oct 5 2020, 8:48 PM
Mholloway claimed this task.
Mholloway moved this task from Task Backlog to Doing on the Product-Data-Infrastructure board.

@Dbrant Let's use schema MobileWikiAppUserContribution as our first schema to move. I can work with @mpopov and @Mholloway to add description info in Gerrit.

Change 637754 had a related patch set uploaded (by Mholloway; owner: Michael Holloway):
[schemas/event/secondary@master] Created /analytics/mobile_apps/user_contribution/1.0.0

https://gerrit.wikimedia.org/r/637754

Note: Doc for this schema is here if anyone needs flow chart, etc. Mikhail added the description for each action (thanks!)

Mikhail added the description for each action (thanks!)

All credit for that goes to @Mholloway :) thanks, Michael!

Change 637754 merged by Mholloway:
[schemas/event/secondary@master] Created /analytics/mobile_apps/android_user_contribution_screen

https://gerrit.wikimedia.org/r/637754

Mikhail added the description for each action (thanks!)

All credit for that goes to @Mholloway :) thanks, Michael!

Thanks @Mholloway, Mikhail and I discussed using the descriptions later to make a data directory using all the info in the schema so putting them in at the beginning is important. If you run into questions in the future let me know and I can help with descriptions as well.

Change 639284 had a related patch set uploaded (by Mholloway; owner: Michael Holloway):
[operations/mediawiki-config@master] Add event stream config for android.user_contributions_screen

https://gerrit.wikimedia.org/r/639284

Change 639284 merged by jenkins-bot:
[operations/mediawiki-config@master] Add event stream config for android.user_contributions_screen

https://gerrit.wikimedia.org/r/639284

Mentioned in SAL (#wikimedia-operations) [2020-12-01T17:34:54Z] <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Add event stream config for android.user_contributions_screen T228179 (duration: 01m 07s)

Superset table comparing Legacy and MEP event counts. Will update when app has been live for enough time to accumulate data.

Found differences between event counts on MEP and Legacy tables, on further investigation the most obvious difference is based on presence of app_install_id where users on Legacy were not showing up at all on MEP. This anomaly was mostly isolated to event ipblock. The ipblock is the event with the highest counts on both tables. (Superset data table

Engineering has speculated that this may be caused by users quitting the app after receiving the ipblock notice and therefore their eventa data is not sent from client. There is also a possibility that the bundling of events we are using for sending data to MEP is an issue.

The plan is to change how clients send events on user app close, which @Sharvaniharan will implement for next available release, after which we will see if that explains data loss. Another possibility to un-bundle events sent to MEP if we find the first test doesn't resolve data loss.

Counts below are app_install_ids that do not appear in the corresponding table, by event:

datacaption_viewcaption_view2desc_viewdesc_view2filt_allfilt_captionfilt_descfilt_tagip_blockmisc_viewmisc_view2open_histtag_viewtag_view2
legacy148292840433355321213811494
modern11122535