Page MenuHomePhabricator

Add wikibase/wikidata export format to citoid service
Open, NormalPublic

Description

As opposed to mediawiki, where all citation data are stored as strings, Wikidata has a strict typing system. https://www.wikidata.org/wiki/Special:ListDatatypes

I think integration of citoid with wikidata would benefit from creating a wikibase specific export format. In particular, allowing:

  • Plausibly a structured date format compatible with wikibase dates. Failing that, validate all date fields and return ISO dates (currently return unvalidated strings which may be invalid for wikibase).
  • Validating language codes against wikibase's allowed values
  • Plausibly including language code with every monolingual type, if possible.
  • Plausibly a hierarchical structure for containers (i.e. the book, journal, or website the item is published in, for creating new items.)

Other issues:

Wikidata expects isbns to have dashes (we don't).
Wikidata wants the pmcid without the pmc prefix.
Seperate properties for ISBN10 and ISBN13

Alternatively we may even consider a wikidata format, which will actually try to obtain the correct QIDs in the background for certain params.

Event Timeline

Mvolz triaged this task as Normal priority.Oct 29 2018, 11:15 AM
Mvolz created this task.
Mvolz added a project: Services.
Mvolz updated the task description. (Show Details)Oct 29 2018, 2:45 PM
mobrovac added a subscriber: mobrovac.

+1 to the idea. We could then have ref import/export to/fro WB and WP and other utilities.

Dates in particular seem like something that could be a big source of pain because on the one hand we don't always have the full date available and on the other WikiBase has a rather intricate way of ingesting time-based data. But we can iterate on that.

Mvolz updated the task description. (Show Details)Nov 5 2018, 9:26 AM
Elitre removed a subscriber: Elitre.Nov 8 2018, 5:05 PM
Mvolz updated the task description. (Show Details)Nov 11 2018, 5:27 PM
Mvolz updated the task description. (Show Details)
Mvolz renamed this task from Add wikibase export format to citoid service to Add wikibase/wikidata export format to citoid service.Nov 15 2018, 11:29 AM
Mvolz updated the task description. (Show Details)
Mvolz moved this task from Backlog to Service on the Citoid board.Dec 11 2018, 11:31 AM

Change 513975 had a related patch set uploaded (by Mvolz; owner: Mvolz):
[mediawiki/services/citoid@master] Add wikibase format

https://gerrit.wikimedia.org/r/513975

Change 513975 merged by jenkins-bot:
[mediawiki/services/citoid@master] Add wikibase format; rm legacy basefields param

https://gerrit.wikimedia.org/r/513975

Addshore moved this task from incoming to in progress on the Wikidata board.Jun 21 2019, 11:25 PM