Change Details

Follow up to T351292 ==Description Once the relevant [[ https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/980963/ | stream config has been deployed to production ]], verify that data is coming into Hive from the 4 Android article instruments that are submitting events via Metrics Platform Java client library 2.0. 2 of the instruments validate against the [[ https://gerrit.wikimedia.org/r/plugins/gitiles/schemas/event/secondary/+/refs/heads/master/jsonschema/analytics/product_metrics/app/base/1.1.0.yaml | app base schema ]]: - article_link_preview_interaction - article_toolbar_interaction 2 of the instruments validate against [[ https://gerrit.wikimedia.org/r/c/schemas/event/secondary/+/974674/ | custom schemas ]]: - article_toc_interaction - find_in_page_interaction == Developer Notes An engineer with [[ https://wikitech.wikimedia.org/wiki/Analytics/Data_access#Analytics_shell_(posix)_groups_explained | analytics-privatedata-users ]] credentials needs to query the `event` table in Hive to verify that the following 4 tables have been created: - android_product_metrics_article_link_preview_interaction - android_product_metrics_article_toc_interaction - android_product_metrics_article_toolbar_interaction - android_product_metrics_find_in_page_interaction For each of the above tables, query for the contextual properties in the `provide_values` key of the `producers` config (see https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/980963/) and make sure data is being populated for each property, as well as the relevant `InteractionData` properties. For the custom data tables (`article_toc_interaction` and `find_in_page_interaction`), check that the [[ https://github.com/wikimedia/apps-android-wikipedia/pull/4286/files#diff-52bfe3cada64c272314da9af8e23c910abcd2da96470ee6803fe406d2b34d29a | custom data submitted by the relevant article instruments ]] are being populated as expected. ==Acceptance Criteria [] 4 new Android tables are created in Hive. [] Events from these instruments are not creating event validation errors (provide links/screenshots from Grafana or Logstash) [] For each table, expected data is being populated per [[ https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/980963/ | stream config ]]. [] For each table, expected `InteractionData` properties are being populated as expected per [[ https://github.com/wikimedia/apps-android-wikipedia/pull/4286/files#diff-52bfe3cada64c272314da9af8e23c910abcd2da96470ee6803fe406d2b34d29a | article instruments ]]. [] For the custom data tables, expected custom data is being submitted correctly per [[ https://github.com/wikimedia/apps-android-wikipedia/pull/4286/files#diff-52bfe3cada64c272314da9af8e23c910abcd2da96470ee6803fe406d2b34d29a | article instruments submitting custom data]]. ==Required [] If data looks good and is coming in as expected, provide Grafana dashboard links to the Android team (sample queries with a sampling of results would be nice too - as a csv or spreadsheet) showing average number of events per sec [] If unexpected data is showing up or any other errors are occurring, create bug tickets to remediate.

Follow up to T351292 ==Description Once the relevant [[ https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/980963/ | stream config has been deployed to production ]], verify that data is coming into Hive from the 4 Android article instruments that are submitting events via Metrics Platform Java client library 2.0. 2 of the instruments validate against the [[ https://gerrit.wikimedia.org/r/plugins/gitiles/schemas/event/secondary/+/refs/heads/master/jsonschema/analytics/product_metrics/app/base/1.1.0.yaml | app base schema ]]: - article_link_preview_interaction - article_toolbar_interaction 2 of the instruments validate against [[ https://gerrit.wikimedia.org/r/c/schemas/event/secondary/+/974674/ | custom schemas ]]: - article_toc_interaction - find_in_page_interaction == Developer Notes An engineer with [[ https://wikitech.wikimedia.org/wiki/Analytics/Data_access#Analytics_shell_(posix)_groups_explained | analytics-privatedata-users ]] credentials needs to query the `event` table in Hive to verify that the following 4 tables have been created: - android_product_metrics_article_link_preview_interaction - android_product_metrics_article_toc_interaction - android_product_metrics_article_toolbar_interaction - android_product_metrics_find_in_page_interaction For each of the above tables, query for the contextual properties in the `provide_values` key of the `producers` config (see https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/980963/) and make sure data is being populated for each property, as well as the relevant `InteractionData` properties. For the custom data tables (`article_toc_interaction` and `find_in_page_interaction`), check that the [[ https://github.com/wikimedia/apps-android-wikipedia/pull/4286/files#diff-52bfe3cada64c272314da9af8e23c910abcd2da96470ee6803fe406d2b34d29a | custom data submitted by the relevant article instruments ]] are being populated as expected. An engineer with no access to the above may still check the event submission rate to those streams using the EventGate Grafana dashboard: https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&var-service=eventgate-analytics-external&var-stream=android.product_metrics.article_link_preview_interaction&var-stream=android.product_metrics.article_toc_interaction&var-stream=android.product_metrics.article_toolbar_interaction&var-stream=android.product_metrics.find_in_page_interaction&var-kafka_broker=All&var-kafka_producer_type=All&var-dc=thanos&var-site=All ==Acceptance Criteria [] 4 new Android tables are created in Hive. [] Events from these instruments are not creating event validation errors (provide links/screenshots from Grafana or Logstash) [] For each table, expected data is being populated per [[ https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/980963/ | stream config ]]. [] For each table, expected `InteractionData` properties are being populated as expected per [[ https://github.com/wikimedia/apps-android-wikipedia/pull/4286/files#diff-52bfe3cada64c272314da9af8e23c910abcd2da96470ee6803fe406d2b34d29a | article instruments ]]. [] For the custom data tables, expected custom data is being submitted correctly per [[ https://github.com/wikimedia/apps-android-wikipedia/pull/4286/files#diff-52bfe3cada64c272314da9af8e23c910abcd2da96470ee6803fe406d2b34d29a | article instruments submitting custom data]]. ==Required [] If data looks good and is coming in as expected, provide Grafana dashboard links to the Android team (sample queries with a sampling of results would be nice too - as a csv or spreadsheet) showing average number of events per sec [] If unexpected data is showing up or any other errors are occurring, create bug tickets to remediate.

Follow up to T351292 ==Description Once the relevant [[ https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/980963/ | stream config has been deployed to production ]], verify that data is coming into Hive from the 4 Android article instruments that are submitting events via Metrics Platform Java client library 2.0. 2 of the instruments validate against the [[ https://gerrit.wikimedia.org/r/plugins/gitiles/schemas/event/secondary/+/refs/heads/master/jsonschema/analytics/product_metrics/app/base/1.1.0.yaml | app base schema ]]: - article_link_preview_interaction - article_toolbar_interaction 2 of the instruments validate against [[ https://gerrit.wikimedia.org/r/c/schemas/event/secondary/+/974674/ | custom schemas ]]: - article_toc_interaction - find_in_page_interaction == Developer Notes An engineer with [[ https://wikitech.wikimedia.org/wiki/Analytics/Data_access#Analytics_shell_(posix)_groups_explained | analytics-privatedata-users ]] credentials needs to query the `event` table in Hive to verify that the following 4 tables have been created: - android_product_metrics_article_link_preview_interaction - android_product_metrics_article_toc_interaction - android_product_metrics_article_toolbar_interaction - android_product_metrics_find_in_page_interaction For each of the above tables, query for the contextual properties in the `provide_values` key of the `producers` config (see https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/980963/) and make sure data is being populated for each property, as well as the relevant `InteractionData` properties. For the custom data tables (`article_toc_interaction` and `find_in_page_interaction`), check that the [[ https://github.com/wikimedia/apps-android-wikipedia/pull/4286/files#diff-52bfe3cada64c272314da9af8e23c910abcd2da96470ee6803fe406d2b34d29a | custom data submitted by the relevant article instruments ]] are being populated as expected. An engineer with no access to the above may still check the event submission rate to those streams using the EventGate Grafana dashboard: https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&var-service=eventgate-analytics-external&var-stream=android.product_metrics.article_link_preview_interaction&var-stream=android.product_metrics.article_toc_interaction&var-stream=android.product_metrics.article_toolbar_interaction&var-stream=android.product_metrics.find_in_page_interaction&var-kafka_broker=All&var-kafka_producer_type=All&var-dc=thanos&var-site=All ==Acceptance Criteria [] 4 new Android tables are created in Hive. [] Events from these instruments are not creating event validation errors (provide links/screenshots from Grafana or Logstash) [] For each table, expected data is being populated per [[ https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/980963/ | stream config ]]. [] For each table, expected `InteractionData` properties are being populated as expected per [[ https://github.com/wikimedia/apps-android-wikipedia/pull/4286/files#diff-52bfe3cada64c272314da9af8e23c910abcd2da96470ee6803fe406d2b34d29a | article instruments ]]. [] For the custom data tables, expected custom data is being submitted correctly per [[ https://github.com/wikimedia/apps-android-wikipedia/pull/4286/files#diff-52bfe3cada64c272314da9af8e23c910abcd2da96470ee6803fe406d2b34d29a | article instruments submitting custom data]]. ==Required [] If data looks good and is coming in as expected, provide Grafana dashboard links to the Android team (sample queries with a sampling of results would be nice too - as a csv or spreadsheet) showing average number of events per sec [] If unexpected data is showing up or any other errors are occurring, create bug tickets to remediate.