Page MenuHomePhabricator

Spike Seeing impression events without `campaign_id` values - by app version
Closed, ResolvedPublicSpike

Description

As discussed in iOS meeting we are seeing some impression events that are missing campaign_id values - here is result of events by app version, data started 2024-06-06 - Data w/events by date/version and some extra dimensions like count unique users and events by wiki_id.

app versionn_events
7.4.10.3385301
7.4.5.28715
7.4.6.29726
7.4.7.3201128
7.4.8.32634
7.4.9.3332130
7.5.0.35631099
7.5.1.360111

Also to look into:
While investigating I saw that values for 'device_family' for every event is 'Other' in user_agent_map in app_donor_experience, 'ios_user_history and app_session` datasets where os_family = iOS. Note ths may apply to more than just these schemas, still collecting data. It's possible this is consistent across all our iOS data and I just hadn't looked into it this deeply.

Event Timeline

SNowick_WMF triaged this task as Medium priority.

This was due to a change in the campaign url query parameters in the campaign config (https://donate.wikimedia.org/w/index.php?title=MediaWiki%3AAppsCampaignConfig.json&diff=39950&oldid=39789). This has since been reverted, so we should start collecting those IDs from these versions again.

Android sends the campaign ID value (JP_2024_05) for metrics instead of utm_source, so iOS could consider switching to that for consistency, if the backend teams are good with that @SNowick_WMF.

Thanks @Tsevener I am able to pull all JP camapign ids as-is, maybe it makes sense to change the iOS format to match Android for ES campaigns? Do you mean we need to check/verify with Fundraising backend team?

@SNowick_WMF yeah, we'll need to do a client-side change and confirm with Fundraising Tech how we should pull and send the ID. We also send this ID to their submitPayment endpoint (in addition to MEP), so it could affect some of their stuff as well. This is captured in T367360.

@SNowick_WMF could you confirm that you aren't seeing issues anymore? And if so, close this one out. Thanks!

Verifying we are no longer seeing impression events in app_donor_experience without campaign_id values in action_data for any events beyond app version 7.5.2.3622. Closing this ticket as resolved.
Data.