Page MenuHomePhabricator

Support SDC URIs in WDQS URI schemes
Closed, ResolvedPublic

Description

Right now, WDQS assumes for it's default prefix/URL system that entity and predicate prefixes come from the same host. This influences both default prefixes and more importantly, URIs for dictionaries and inlining. We should enable WDQS to be able to handle scheme where entity URIs may come from different places, e.g. mixing entity with wd: prefix for wikidata and sdc: prefix for commons.
For default prefixes, we can just add a config, but we also may want the inlining to work for both URI schemes, which may require some additional support.

The goals to achieve are:

  1. Have sdc: items and data triples recognized by Munger/Updater as proper entities.
  2. Have all SDC URIs be properly inlined.
  3. Have Updater handle all statements properly
  4. Have sdc: and sdcs: prefixes to work by default.

We still need to have single URI for:

  • statement prefix (Updater assumes there's single statement prefix)
  • property prefixes

Needs refactoring:

  • Entity ID <-> URI conversion, can be different for different URIs.

Event Timeline

Smalyshev triaged this task as Medium priority.Aug 1 2019, 6:52 PM
Smalyshev added a project: User-Smalyshev.

Change 527663 had a related patch set uploaded (by Smalyshev; owner: Smalyshev):
[wikidata/query/rdf@master] Refactor URIs to use specialized methods instead of strings

https://gerrit.wikimedia.org/r/527663

Change 528293 had a related patch set uploaded (by Smalyshev; owner: Smalyshev):
[wikidata/query/rdf@master] Implement SDC URI scheme

https://gerrit.wikimedia.org/r/528293

Change 527663 merged by jenkins-bot:
[wikidata/query/rdf@master] Refactor URIs to use specialized methods instead of strings

https://gerrit.wikimedia.org/r/527663

Change 529323 had a related patch set uploaded (by Gehel; owner: Gehel):
[wikidata/query/rdf@master] Extract UrisScheme interface.

https://gerrit.wikimedia.org/r/529323

Change 529351 had a related patch set uploaded (by Gehel; owner: Gehel):
[wikidata/query/rdf@master] Refactor the various URIs scheme to be more symetric.

https://gerrit.wikimedia.org/r/529351

Change 528293 merged by jenkins-bot:
[wikidata/query/rdf@master] Implement SDC URI scheme

https://gerrit.wikimedia.org/r/528293

Smalyshev moved this task from Doing to Done on the User-Smalyshev board.

Change 530984 had a related patch set uploaded (by Smalyshev; owner: Smalyshev):
[wikidata/query/rdf@master] Add support for SDC URIs to Updater

https://gerrit.wikimedia.org/r/530984

Change 531024 had a related patch set uploaded (by Smalyshev; owner: Smalyshev):
[wikidata/query/gui@master] Allow adding more prefixes to RdfNamespaces

https://gerrit.wikimedia.org/r/531024

Change 530984 merged by jenkins-bot:
[wikidata/query/rdf@master] Add support for SDC URIs to Updater

https://gerrit.wikimedia.org/r/530984

Smalyshev renamed this task from Allow WDQS default prefixes to work with federated data to Support SDC URIs in WDQS URI schemes.Aug 21 2019, 7:28 AM
Smalyshev updated the task description. (Show Details)
Smalyshev moved this task from Done to In review on the User-Smalyshev board.

Change 529323 merged by jenkins-bot:
[wikidata/query/rdf@master] Extract UrisScheme interface.

https://gerrit.wikimedia.org/r/529323

Change 529351 merged by jenkins-bot:
[wikidata/query/rdf@master] Refactor the various URIs scheme to be more symetric.

https://gerrit.wikimedia.org/r/529351

@Multichill eventually yes, but since they are not being used anywhere yet it's too early to document them. Once RDF export is properly set up to use these prefixes then we can document them officially.

Change 531024 merged by jenkins-bot:
[wikidata/query/gui@master] Allow adding more prefixes to RdfNamespaces via custom config.

https://gerrit.wikimedia.org/r/531024

Change 618924 had a related patch set uploaded (by ZPapierski; owner: ZPapierski):
[wikidata/query/gui-deploy@production] Merging from c62e77e80bc4b3ddb780a5409dfe8aa408fd4f11:

https://gerrit.wikimedia.org/r/618924

Change 618967 had a related patch set uploaded (by ZPapierski; owner: ZPapierski):
[wikidata/query/gui-deploy@production] Merging from c62e77e80bc4b3ddb780a5409dfe8aa408fd4f11:

https://gerrit.wikimedia.org/r/618967

Change 618924 abandoned by ZPapierski:
[wikidata/query/gui-deploy@production] Merging from c62e77e80bc4b3ddb780a5409dfe8aa408fd4f11:

Reason:
Correct patch - https://gerrit.wikimedia.org/r/c/wikidata/query/gui-deploy/ /618967

https://gerrit.wikimedia.org/r/618924

Change 618967 merged by Lucas Werkmeister (WMDE):
[wikidata/query/gui-deploy@production] Merging from c62e77e80bc4b3ddb780a5409dfe8aa408fd4f11:

https://gerrit.wikimedia.org/r/618967