Page MenuHomePhabricator

Validate `ios_search` data post-release
Closed, ResolvedPublic

Event Timeline

SNowick_WMF renamed this task from Validate data post-release to Validate `ios_search` data post-release.

Validating that most fields are populated as expected, some events are not appearing yet, likely because this is beta user only data.
Data Validation T335544

Data counts looks good, as expected, but want to note we are not seeing actions linked to source values top_of_feed or article which should be investigated as these are main access points. The counts for source unknown are very high so it's possible these events are not being sent with correct source.

https://docs.google.com/spreadsheets/d/14PzgjgSlwfGIYHd9BlcWwm7n4YxzGDoO5bq35k_aLtY/edit#gid=430006490

Also noting we are not seeing events for didyoumeanor autoswitch which may not be an issue if these events are deprecated/old.

Hi Shay! Opened a PR - https://github.com/wikimedia/wikipedia-ios/pull/4546 - fixing some events. Apparently, only the autoswitch option has been deprecated, and we still get the didyoumean events. It should start appearing on the next release, along with the fixed source strings

Fix is in 7.3.1 (Testflight beta).

Looks like the fix worked for the missing source values - we are now seeing events for top_of_feed and article. However still not seeing any action = didyoumean - is it possible users aren't accessing that option and/or can you check the data wiring for that? Thanks

Data validation v2

Looks like the fix worked for the missing source values - we are now seeing events for top_of_feed and article. However still not seeing any action = didyoumean - is it possible users aren't accessing that option and/or can you check the data wiring for that? Thanks

Data validation v2

I'll check it today and let you know if it required a fix, thanks for the update!

Change 936337 had a related patch set uploaded (by Mazevedo; author: Mazevedo):

[schemas/event/secondary@master] Add missing source property to ios search schema

https://gerrit.wikimedia.org/r/936337

Change 936337 merged by jenkins-bot:

[schemas/event/secondary@master] Add missing source property to ios search schema

https://gerrit.wikimedia.org/r/936337

Hi Shay! Opened a PR - https://github.com/wikimedia/wikipedia-ios/pull/4546 - fixing some events. Apparently, only the autoswitch option has been deprecated, and we still get the didyoumean events. It should start appearing on the next release, along with the fixed source strings

There was an issue with the didyoumean option, I opened a patch for it, and it was already merged on Gerrit. The app change will ship with 7.3.1

Validating that we can see action = didyoumean - these are only associated with source = places and only a few events but it is showing up in data. Counts look good, this is one of our most actively used features with a daily average of 18K unique users and 334K events.