Page MenuHomePhabricator

Multimedia health metrics stalled since Feb 2016
Closed, ResolvedPublic3 Estimated Story Points

Description

Logs on 1003 have errors:

nuria@stat1003:/srv/reportupdater/log$ less limn-multimedia-data-multimedia.log

xecuting "<Report key=deletions type=sql granularity=months lag=0 is_funnel=False first_date=2004-01-01 start=20
14-06-01 end=2014-07-01 db_key=mediawiki sql_template=select date('{from_timestamp}') as date, count(*) as {wiki} from {wiki}.logging where log_ty
pe = 'de... script=None explode_by={'wiki': 'all'} max_data_points=None results={'header': '[]', 'data': '0 rows'}>".

Several selects are doing; "select from all.images" which is not a real db.

Code on reportupdater:

https://github.com/wikimedia/analytics-reportupdater/blob/master/reportupdater/reader.py#L149

Event Timeline

MarkTraceur claimed this task.
MarkTraceur subscribed.
This comment was removed by MarkTraceur.

See, for history, T132404 and T132481 which may have caused and/or not solved this issue.

To my discredit, I should have followed up on the ticket, but in my inadequate defence, I still don't like that "all" is included in the queries, especially now that it crashes all other reports.

What Happened to Our Numbers, a story by #wikimedia-analytics:

  1. We had our data at https://datasets.wikimedia.org/limn-public-data/metrics/multimedia-health/ being generated by ReportUpdater via a puppet config file.
  2. In https://github.com/wikimedia/operations-puppet/commit/bf5fd0a1fd32ef7011d4ac89f730e9476e153d60 mforns changed the config file and forgot to change all of the copy-pasted config entries.
  3. Data was never updated in multimedia-health, but was updated as usual in beta-features-enables.

The puppet code is being fixed and our data should be re-generated once it's deployed.

Nuria renamed this task from Reportiupdater queries not working for uploader metric on multimedia to Reportupdater queries not working for uploader metric on multimedia .Jul 12 2016, 8:50 PM
mforns renamed this task from Reportupdater queries not working for uploader metric on multimedia to Multimedia health metrics stalled since Feb 2016.Jul 12 2016, 9:15 PM
mforns claimed this task.
mforns set the point value for this task to 3.

I fixed the puppet code, but I used the other task's ID, so the gerrit patch went to the other one, sorry. https://gerrit.wikimedia.org/r/#/c/298605/

mforns moved this task from Done to In Code Review on the Analytics-Kanban board.