Page MenuHomePhabricator

Data Validation for Android Image Recommendation Events
Closed, ResolvedPublic

Description

Validate event data sent to new schema android_image_recommendation_event

Data Validation [IN PROGRESS]

Details

Other Assignee
SNowick_WMF

Event Timeline

Beta Event Data Validation Issues: (Validation Data)

  1. RESOLVED Onboarding next events: We see lower count of next events at Step 1 that eventually get to final 'get_started' event but no 'next' events on active_interface = onboarding_step_2_dialog and onboarding_step_3_dialog. Still waiting to see if we have any 'back` events for same active_interfaces but getting none so far. Will keep an eye on count difference but should look into missing events. See: Data sample
  1. RESOLVED - Some images have multiple wikis for value in recommendation_source_project, should be a singular value. This may be an issue with these specific images, will need to investigate. See: Data sample. Issues affect images from both Commons and Wikipedia as recommendation_source

The rest of events that are missing data are somewhat less frequent/common, will keep an eye on those events, mostly everything looks good aside from these 2 points.

SNowick_WMF renamed this task from Data Validation for Image Recs to Data Validation for Android Image Recommendation Events.Sep 29 2023, 10:28 PM
SNowick_WMF reassigned this task from SNowick_WMF to Sharvaniharan.
SNowick_WMF updated Other Assignee, added: SNowick_WMF; removed: Sharvaniharan.

Hi @SNowick_WMF

Will look into the next events.
However, the recommendation_source_project is a list of projects that the image can be used in.. so i feel we should collect it as a list. As far as I understand, that is expected for some images to have more than one. Also beneficial to cross-check with growth analytics.
Thank you.

@Sharvaniharan Thanks w/r/t multiple wikis listed - that makes sense - I resolved since it's as is should be.

Note on next events: Next button is not measurable because if one impression happens they all happen - the overlay element (3rd party library) gives callbacks for item shown but not button clicked, if they click anywhere on screen the tooltip will advance). Data we are getting is as expected, closing both validation issues.

Moving this to Ready for release @SNowick_WMF, since the next button events are as expected.

Production data so far passes validation, waiting on a few edge-case, uncritical events events but data looks great. Production Data Validation