Page MenuHomePhabricator

The streaming updater should produce its events to kafka
Closed, ResolvedPublic

Description

AC:

  • the streaming updater should produce its events to kafka
  • the events should remain ordered (do not write from multiple tasks to a single partition)
  • we should provide a json schema for these events

Event Timeline

dcausse created this task.Apr 28 2020, 1:42 PM
Restricted Application added a project: Wikidata. · View Herald TranscriptApr 28 2020, 1:42 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Change 593470 had a related patch set uploaded (by DCausse; owner: DCausse):
[wikidata/query/rdf@master] Send streaming updater events to kafka

https://gerrit.wikimedia.org/r/593470

Change 593528 had a related patch set uploaded (by DCausse; owner: DCausse):
[mediawiki/event-schemas@master] Add wikibase/rdf/update_stream/1.0.0

https://gerrit.wikimedia.org/r/593528

Change 593528 abandoned by DCausse:
Add wikibase/rdf/update_stream/1.0.0

https://gerrit.wikimedia.org/r/593528

Change 594098 had a related patch set uploaded (by DCausse; owner: DCausse):
[schemas/event/primary@master] Add wikibase/rdf/update_stream/1.0.0

https://gerrit.wikimedia.org/r/594098

Change 593470 merged by jenkins-bot:
[wikidata/query/rdf@master] Send streaming updater events to kafka

https://gerrit.wikimedia.org/r/593470

Gehel closed this task as Resolved.Jul 13 2020, 12:53 PM