Maniphest T167419

Decide the data format for third-party datasets
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Hjfocs
	Jun 8 2017, 2:02 PM

Tags

Referenced Files

None

Subscribers

Description

Currently, the tool only accepts datasets serialized in QuickStatements.
While it is indeed a very compact format, useful to upload large datasets, it is totally non-standard (cf. the only available documentation).

We should foresee the support of stable formats for both the self-sustainability of the project and a standardized data donation workflow: RDF and/or JSON, cf. T166501#3331824

Related Objects

Mentioned Here: T166501: [Story] Decide the back-end re-implementation

Event Timeline

Hjfocs created this task.Jun 8 2017, 2:02 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 8 2017, 2:02 PM

Note on StrepHit serialization of extracted facts:

QuickStatements is here: https://github.com/Wikidata/StrepHit/blob/master/strephit/commons/serialize.py#L136;
RDF can be ported from the Fact Extractor project: https://github.com/dbpedia/fact-extractor/blob/master/lib/to_assertions.py.

Hjfocs moved this task from To do to Upcoming on the Wikidata-primary-sources board.Jun 12 2017, 1:13 PM

Hjfocs claimed this task.Jun 14 2017, 10:28 AM

We will keep the QuickStatements support and enable the RDF one.

Hjfocs moved this task from Upcoming to Done on the Wikidata-primary-sources board.Jun 14 2017, 10:30 AM