Page MenuHomePhabricator

Adapt EntityRevisionMapGenerator for wcqs
Closed, ResolvedPublic

Description

This spark job is required for building the initial state of the streaming updater, it must be adapted for commons.

AC:

  • add new arguments to build the proper UriScheme for commons
  • adapt the import_commons_ttl dag to run it after every import

Event Timeline

Change 751850 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):

[wikidata/query/rdf@master] Provide override options for uri schemes in EntityRevisionMapGenerator

https://gerrit.wikimedia.org/r/751850

Change 751850 merged by jenkins-bot:

[wikidata/query/rdf@master] Provide override options for uri schemes in EntityRevisionMapGenerator

https://gerrit.wikimedia.org/r/751850

Change 751978 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):

[wikimedia/discovery/analytics@master] Generate entity revision maps for commons

https://gerrit.wikimedia.org/r/751978

Change 751978 merged by jenkins-bot:

[wikimedia/discovery/analytics@master] Generate entity revision maps for commons

https://gerrit.wikimedia.org/r/751978