Page MenuHomePhabricator

Create an automatically updated dashboard out of the Wikidata Quality Report
Closed, ResolvedPublic

Description

Problem:
The report at https://wikidata-analytics.wmcloud.org/app_direct/WD_docs/Wikidata%20Quality%20Report.nb.html is very useful to our community but it has not received updates since October 2020.

Solution:
Create an auto-updated dashboard out of the Wikidata Quality Report's "critical Item" section.

Acceptance criteria:

  • We have the "critical Item" section of the report as a "Wikidata Quality Dashboard"
  • The new dashboard is regularly updated

Event Timeline

Manuel renamed this task from critical Wikidata Items report not updating to Create an automatically updated dashboard out of the Wikidata Quality Report.Dec 8 2021, 12:37 PM
Manuel updated the task description. (Show Details)
Manuel subscribed.

This is now updated daily, right?

Nope. There are several timestamps and you are looking only at the report timestamp which is indeed updated daily because the report automatically re-renders itself every day.

Take a look at the text of the report, the very first few paragraphs, and you will find that there are two additional timestamps: (a) the Wikidata JSON dump to hdfs timestamp and (b) the WDCM re-use statistics timestamp. The report is updated every time we have a new version of the Wikidata JSON dump copied to hdfs to the wmf.wikidata_entity table.

Ah ok, perfect! (The mentioned timestamp can be found in the overview section.)