Page MenuHomePhabricator

Empty tables for mediawiki_web_ui_scroll_migrated and mediawiki_web_ui_actions
Closed, ResolvedPublic1 Estimated Story Points

Description

@jwang identified an issue while working on the QA WebUIScroll porting to the new metrics platform (T352342). The schema for mediawiki_web_ui_scroll_migrated is currently empty, which is unexpected. Although the table was created successfully, there seems to be a failure between the creation of the table, the validation of the events (there would be Logstash errors if validation failed) and what happens after.

Upon further investigation, we also observed that the mediawiki_web_ui_actions schema does not have saved events (T353029).

Update: On checking the Network tab in prod, we're also not seeing the Metrics Platform events.

Event Timeline

Change 982903 had a related patch set uploaded (by Kimberly Sarabia; author: Kimberly Sarabia):

[operations/mediawiki-config@master] Add new stream names to the config variable

https://gerrit.wikimedia.org/r/982903

Change 982903 merged by jenkins-bot:

[operations/mediawiki-config@master] Add new stream names to the config variable

https://gerrit.wikimedia.org/r/982903

Mentioned in SAL (#wikimedia-operations) [2024-01-08T14:12:57Z] <urbanecm@deploy2002> Started scap: Backport for [[gerrit:987159|Add agent.app_install_id to android.product_metrics.* streams (T353680)]], [[gerrit:982467|Remove partial migration of EditAttemptStep instrument (T351335)]], [[gerrit:982903|Add new stream names to the config variable (T353297)]]

Mentioned in SAL (#wikimedia-operations) [2024-01-08T14:14:43Z] <urbanecm@deploy2002> urbanecm and phuedx and ksarabia and sfaci: Backport for [[gerrit:987159|Add agent.app_install_id to android.product_metrics.* streams (T353680)]], [[gerrit:982467|Remove partial migration of EditAttemptStep instrument (T351335)]], [[gerrit:982903|Add new stream names to the config variable (T353297)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Mentioned in SAL (#wikimedia-operations) [2024-01-08T14:35:48Z] <urbanecm@deploy2002> Started scap: Backport for [[gerrit:987159|Add agent.app_install_id to android.product_metrics.* streams (T353680)]], [[gerrit:982467|Remove partial migration of EditAttemptStep instrument (T351335)]], [[gerrit:982903|Add new stream names to the config variable (T353297)]], [[gerrit:988504|agent.app_ -> agent_app_ in android.product_metrics.* streams (T353680)]]

Mentioned in SAL (#wikimedia-operations) [2024-01-08T14:37:14Z] <urbanecm@deploy2002> urbanecm and phuedx and ksarabia and sfaci: Backport for [[gerrit:987159|Add agent.app_install_id to android.product_metrics.* streams (T353680)]], [[gerrit:982467|Remove partial migration of EditAttemptStep instrument (T351335)]], [[gerrit:982903|Add new stream names to the config variable (T353297)]], [[gerrit:988504|agent.app_ -> agent_app_ in android.product_metrics.* streams (T353680)]] synce

Mentioned in SAL (#wikimedia-operations) [2024-01-08T14:46:11Z] <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:987159|Add agent.app_install_id to android.product_metrics.* streams (T353680)]], [[gerrit:982467|Remove partial migration of EditAttemptStep instrument (T351335)]], [[gerrit:982903|Add new stream names to the config variable (T353297)]], [[gerrit:988504|agent.app_ -> agent_app_ in android.product_metrics.* streams (T353680)]] (duration: 10m 22s)

This has just been backported and we will QA this tomorrow when it has had time to aggegate.

ovasileva set the point value for this task to 1.Jan 8 2024, 6:47 PM

The tables are no longer empty. @jwang Do you mind re-QAing this?

The tables are no longer empty. @jwang Do you mind re-QAing this?

QA continuation to be tracked in T352342: QA WebUIScroll port to the new metrics platform

Sign off will be making a separate ticket with criteria for analysis review to determine whether Web team can fully transition to the adopted schemas

Jdlrobson subscribed.

Kim will sign this off once she's made a follow up ticket. We should set criteria on when we want to adopt the new schemas that data engineering have helped us make.