Page MenuHomePhabricator
Create Task
Maniphest T140795

Map sources using Wikidata to wd_item
Closed, ResolvedPublic
Actions

Description

Since the resolution of T55808 we can harvest Wikidata IDs from the lists. We should complete the mappings of lists already using Wikidata IDs.

A quick search yields the following candidates:

  • gb-eng (en)
  • es-vc (ca)
  • es-ct (ca)
  • ca (en)
  • de-he (de)

Details

SubjectRepoBranchLines +/-
Harvest Wikidata item for es-ct (ca)labs/tools/heritagemaster+8 -2
Harvest Wikidata item in gb-eng (en)labs/tools/heritagemaster+16 -2
Harvest Wikidata item for Canada in English ca_(en)labs/tools/heritagemaster+31 -6
Customize query in gerrit

Related Objects

Event Timeline

JeanFred created this task.Jul 19 2016, 5:34 PM
Restricted Application added subscribers: Zppix, Aklapper. · View Herald TranscriptJul 19 2016, 5:34 PM
gerritbot subscribed.Jul 19 2016, 10:36 PM

Change 299890 had a related patch set uploaded (by Jean-Frédéric):
Harvest Wikidata item in gb-eng (en)

https://gerrit.wikimedia.org/r/299890

gerritbot added a project: Patch-For-Review.Jul 19 2016, 10:36 PM
gerritbot added a comment.Jul 19 2016, 10:47 PM

Change 299891 had a related patch set uploaded (by Jean-Frédéric):
Harvest Wikidata item for Canada in English ca_(en)

https://gerrit.wikimedia.org/r/299891

gerritbot added a comment.Jul 21 2016, 11:13 AM

Change 299891 merged by jenkins-bot:
Harvest Wikidata item for Canada in English ca_(en)

https://gerrit.wikimedia.org/r/299891

Lokal_Profil updated the task description. (Show Details)Jul 21 2016, 3:06 PM
gerritbot added a comment.Jul 21 2016, 3:06 PM

Change 299890 merged by jenkins-bot:
Harvest Wikidata item in gb-eng (en)

https://gerrit.wikimedia.org/r/299890

Stashbot subscribed.Jul 25 2016, 1:30 PM

Mentioned in SAL [2016-07-25T13:30:13Z] <JeanFred> Deployed latest from Git: ff61234, 112c14f, 7e98153, b614e78, aafc788 & 3222df9 (T140795), baad88c, ac388ee

Lokal_Profil updated the task description. (Show Details)Jul 26 2016, 8:43 AM
JeanFred added a comment.EditedJul 26 2016, 9:28 AM

Not sure it worked though :-( This API call returns the gb-en monuments with Wikidata item, and it’s empty: https://tools.wmflabs.org/heritage/api/api.php?action=search&srcountry=gb-en&srwithwd_item=1&format=json

JeanFred added a comment.Sep 11 2016, 3:58 PM
In T140795#2495077, @JeanFred wrote:

Not sure it worked though :-( This API call returns the gb-en monuments with Wikidata item, and it’s empty: https://tools.wmflabs.org/heritage/api/api.php?action=search&srcountry=gb-en&srwithwd_item=1&format=json

The good URL is https://tools.wmflabs.org/heritage/api/api.php?action=search&srcountry=gb-eng&srwithwd_item=1&format=html

Lokal_Profil edited projects, added good first task; removed Patch-For-Review.Oct 2 2016, 9:32 PM
Restricted Application added a subscriber: TerraCodes. · View Herald TranscriptOct 2 2016, 9:32 PM
Abbe98 subscribed.Oct 17 2016, 3:19 PM
gerritbot added a comment.Oct 24 2016, 5:10 PM

Change 317538 had a related patch set uploaded (by Jean-Frédéric):
Harvest Wikidata item in es-ct (ca)

https://gerrit.wikimedia.org/r/317538

gerritbot added a project: Patch-For-Review.Oct 24 2016, 5:10 PM
JeanFred mentioned this in T148990: Harvest Wikidata item into the monuments database from the linked article.Oct 24 2016, 5:15 PM
Multichill subscribed.Oct 24 2016, 6:10 PM

Why don't we just add the mappings for all sources in one go? Default field name is wd_item and if people decide to add it, it works right away. That saves us for having to do a change for every source that decides to enable this. Worst case they give the field another name and we just need to rename it.

Multichill added a comment.Oct 24 2016, 6:12 PM

The Wikidata link should probably be to the entity. So http://www.wikidata.org/entity/Q5567227 instead of https://www.wikidata.org/wiki/Q5567227 .

We might want to consider adding support for outputting rdf triples and other semantic fun....

gerritbot added a comment.Oct 25 2016, 7:23 AM

Change 317538 merged by jenkins-bot:
Harvest Wikidata item for es-ct (ca)

https://gerrit.wikimedia.org/r/317538

Stashbot mentioned this in T148772: Bounding box in documentation should be changed.Oct 26 2016, 11:03 PM
Stashbot mentioned this in T148773: Error calling search with bounding box.

Mentioned in SAL (#wikimedia-labs) [2016-10-26T23:03:12Z] <JeanFred> Deploy latest from Git master: c943e89, e3ba148, 063f9e2 (T148772 & T148773), 1db9f42, fe119e1, de2e590, 82147b8, f6ff350 & 63a1819 (T140795)

JeanFred added a comment.Oct 26 2016, 11:05 PM

Somehow there has been no harvesting today. (Labs maintenance?) Anyhow, let’s see if next run picks those up.

JeanFred updated the task description. (Show Details)Oct 28 2016, 11:21 AM

No unknown fields anymore :) https://commons.wikimedia.org/w/index.php?search=wikidata+prefix%3ACommons%3AMonuments+database%2FUnknown+fields&title=Special:Search&go=Lire&searchToken=alrzyhhg8403a5ial1kd9sf7r

Multichill added a comment.Oct 28 2016, 11:42 AM

Ehm, https://commons.wikimedia.org/wiki/Commons:Monuments_database/Unknown_fields/monuments_it_(it) ?

JeanFred added a comment.Oct 28 2016, 11:45 AM

4 elements sounds more like an error than anything else, no?

JeanFred added a comment.Nov 10 2016, 2:02 PM

Statistics are now computed as well :)
https://commons.wikimedia.org/wiki/Commons:Monuments_database/Statistics

JeanFred closed this task as Resolved.Nov 10 2016, 2:02 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits