Include redirects in RDF dumps
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	daniel
	Mar 24 2015, 4:21 PM

Description

Wikidata redirects defined on Q-id to be an alias for another Q-id. This should be reflected by a owl:sameAs relationship between the respective entity URIs (but not the document URIs). The Document URI of the redirect could have rdf:type wikibase:Redirect or something similar.

This is needed to allow references to entities that were turned into redirects/aliases to be handled correctly by rdf consumers like triple stores.

NOTE: T69033 calls for redirects to item X to be included in the output for item X. That would imply all redirects would be present in an RDF dump. The straight forward implementation would be very inefficient though (it would mean looking up redirects for each entity). Instead, we should omit that lookup in dump mode, and process redirects as they appear in the ID stream that drives the dump output.

Details

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	Include redirects in RDF dumps	mediawiki/extensions/Wikibase	master	+20 -1

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Open	None	T88728 Improve Wikimedia dumping infrastructure
Open	None	T88991 improve Wikidata dumps [tracking]
Open	None	T46581 Partial Wikidata dumps
Resolved	Smalyshev	T46580 Script for creating RDF dumps of all entities
Duplicate	None	T211495 Dump(s) of Wikidata classes
Duplicate	None	T211497 Dump(s) of Wikidata instances of Q5
Open	None	T162351 Create a "page prop" RDF dump for Wikidata entities ("pagePropertiesRdf")
Open	None	T98320 [Task] Create dump of entity redirects (JSON or n-triples)
Invalid	None	T285307 Create randomly split partial entity dumps
Resolved	Lydia_Pintscher	T44063 [Epic] Provide a plain linked data interface for accessing entities
Resolved	hoo	T101837 [Story] switch default rdf format to full (include statements)
Open	None	T50143 Implement complete RDF mapping for entities (tracking)
Resolved	daniel	T93767 Include redirects in RDF dumps
Resolved	daniel	T96364 Create a PHP service interface for accessing entity redirects

Event Timeline

daniel created this task.Mar 24 2015, 4:21 PM

daniel raised the priority of this task from to Needs Triage.

daniel updated the task description. (Show Details)

daniel added a project: Wikidata.

daniel added subscribers: daniel, Smalyshev, Denny, mkroetzsch.

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 24 2015, 4:21 PM

Lydia_Pintscher triaged this task as Medium priority.Mar 30 2015, 9:47 AM

Lydia_Pintscher set Security to None.

daniel added a parent task: T50143: Implement complete RDF mapping for entities (tracking).Mar 30 2015, 10:59 AM

Lydia_Pintscher moved this task from incoming to ready to go on the Wikidata board.Mar 30 2015, 12:53 PM

Liuxinyu970226 subscribed.Apr 1 2015, 12:26 AM

Isn't this one the same as T69033?

Smalyshev updated the task description. (Show Details)Apr 8 2015, 6:41 AM

@Smalyshev: not exactly. T69033 calls for redirects to item X to be included in the output for item X. This ticket asks for all redirects to be present in RDF dumps. Logically, T69033 would imply that, but the straight forward implementation would be very inefficient (it would mean looking up redirects for each entity). Instead, we should omit that lookup in dump mode, and process redirects as they appear in the ID stream that drives the dump output.

I'll edit the description to make the distinction clear.

daniel updated the task description. (Show Details)May 4 2015, 6:22 PM

daniel added a subtask: T96364: Create a PHP service interface for accessing entity redirects.

Change 208716 had a related patch set uploaded (by Daniel Kinzler):
Include redirects in RDF dumps

https://gerrit.wikimedia.org/r/208716

gerritbot added a project: Patch-For-Review.May 4 2015, 7:19 PM