Statistics fail on Wikidata harvested dataset
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	JeanFred
	Sep 9 2019, 9:14 PM

Description

2019-09-09_13:46:59 Make statistics...

Traceback (most recent call last):
  File "/data/project/heritage/heritage/erfgoedbot/database_statistics.py", line 281, in <module>
    main()
  File "/data/project/heritage/heritage/erfgoedbot/database_statistics.py", line 274, in main
    country, language, conn, cursor)
KeyError: u'au'

Details

	Subject	Repo	Branch	Lines +/-
	Do not skip Wikidata datasets when making statistics	labs/tools/heritage	master	+1 -1

Customize query in gerrit

Related Objects

Mentioned In: T138668: Harvest Wikidata into the Monuments database
Mentioned Here: T138668: Harvest Wikidata into the Monuments database
rTHER0a4fbae30cd3: Map itemLabel to name field
rTHERdff30f0b087c: Do not skip Wikidata datasets when making statistics

Event Timeline

JeanFred created this task.Sep 9 2019, 9:14 PM

Can’t reproduce this locally. I did a harvest of ge:ka and another of au:en, ran fill_table_monuments_all and then database_statistics − the stats are generated just fine :-/

Change 535292 had a related patch set uploaded (by Jean-Frédéric; owner: Jean-Frédéric):
[labs/tools/heritage@master] Do not skip Wikidata datasets when making statistis

https://gerrit.wikimedia.org/r/535292

gerritbot added a project: Patch-For-Review.Sep 9 2019, 9:24 PM

Change 535292 merged by jenkins-bot:
[labs/tools/heritage@master] Do not skip Wikidata datasets when making statistics

https://gerrit.wikimedia.org/r/535292

Mentioned in SAL (#wikimedia-cloud) [2019-09-09T21:42:35Z] <JeanFred> Deploy latest from Git master: 0a4fbae, dff30f0 (T232394, T138668)