Portal Dashboard is down due to the removal of raw user agent strings from EventLogging. Some other dashboards may be affected as well and need to be identified.
Description
Description
Details
Details
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| Get browser info from new userAgent field | wikimedia/discovery/golden | master | +10 -1 |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | • chelsyx | T162178 Fix data retrieval scripts using raw user agent strings | |||
| Resolved | • chelsyx | T161806 Portal Dashboard: does not display US stats when grouping by region |
Event Timeline
Comment Actions
We need to get this fixed quickly - the update to the user agent strings knocked down our portal dashboard unexpectedly.
Comment Actions
Change 346655 had a related patch set uploaded (by Chelsyx):
[wikimedia/discovery/golden@master] Get browser info from new userAgent field
Comment Actions
This patch fixed the bug in portal/user_agents.R. After the data is backfilled (We should backfill data from March 29), portal dashboard should be able to work again.
There are other scripts in golden that are affected by the raw userAgent strings removal: search/load_times.R, search/app_event_counts.R and portal/app_link_clicks.sql. Since the version of MariaDB we're using doesn’t support JSON functions, and the queries in these scripts can still accomplish the task, I think there is no need to fix them now. @mpopov please let me know if you think otherwise.
Comment Actions
Correct! While those scripts/queries do make use of userAgent field, they are not affected by the change. The only truly affected one is portal/user_agents.R Reviewing your patch now, thanks! :)
Comment Actions
Change 346655 merged by Bearloga:
[wikimedia/discovery/golden@master] Get browser info from new userAgent field