Follow up to T351292
Description
Once the relevant stream config has been deployed to production, verify that data is coming into Hive from the 4 Android article instruments that are submitting events via Metrics Platform Java client library 2.0.
2 of the instruments validate against the app base schema:
- article_link_preview_interaction
- article_toolbar_interaction
2 of the instruments validate against custom schemas:
- article_toc_interaction
- find_in_page_interaction
Developer Notes
An engineer with analytics-privatedata-users credentials needs to query the event table in Hive to verify that the following 4 tables have been created:
- android_product_metrics_article_link_preview_interaction
- android_product_metrics_article_toc_interaction
- android_product_metrics_article_toolbar_interaction
- android_product_metrics_find_in_page_interaction
For each of the above tables, query for the contextual properties in the provide_values key of the producers config (see https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/980963/) and make sure data is being populated for each property, as well as the relevant InteractionData properties.
For the custom data tables (article_toc_interaction and find_in_page_interaction), check that the custom data submitted by the relevant article instruments are being populated as expected.
An engineer with no access to the above may still check the event submission rate to those streams using the EventGate Grafana dashboard: https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&var-service=eventgate-analytics-external&var-stream=android.product_metrics.article_link_preview_interaction&var-stream=android.product_metrics.article_toc_interaction&var-stream=android.product_metrics.article_toolbar_interaction&var-stream=android.product_metrics.find_in_page_interaction&var-kafka_broker=All&var-kafka_producer_type=All&var-dc=thanos&var-site=All
Acceptance Criteria
- 4 new Android tables are created in Hive.
- Events from these instruments are not creating event validation errors (provide links/screenshots from Grafana or Logstash) - Grafana dashboard
- For each table, expected data is being populated per stream config. << see T352947#9470713
- For each table, expected InteractionData properties are being populated as expected per article instruments. << InteractionData is getting properly populated -- see tabs in this spreadsheet
- For the custom data tables, expected custom data is being submitted correctly per article instruments submitting custom data. << see this tab in spreadsheet
Required
- If data looks good and is coming in as expected, provide Grafana dashboard links to the Android team (sample queries with a sampling of results would be nice too - as a csv or spreadsheet) showing average number of events per sec
- If unexpected data is showing up or any other errors are occurring, create bug tickets to remediate. << T355360 filed