This project was created before any of the utilities function were available, we should adapt the WDQS Streaming Updater flink to use these so that it better integrates with the event-platform.
AC:
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Duplicate | Feature | None | T330521 Make WDQS update stream public | ||
| Open | None | T294133 [EPIC] Expose rdf-streaming-updater.mutation content through EventStreams | |||
| Open | • dcausse | T374919 Adapt the rdf-streaming-updater flink job to use wikimedia-eventutilities-flink |
Change #1078991 had a related patch set uploaded (by DCausse; author: DCausse):
[wikidata/query/rdf@master] Add support for EventDataStreamFactory for input streams
Change #1079538 had a related patch set uploaded (by DCausse; author: DCausse):
[wikidata/query/rdf@master] Add support for setting a start timestamp
Change #1081221 had a related patch set uploaded (by DCausse; author: DCausse):
[wikidata/query/rdf@master] Add support for event platform in output streams
Change #1078991 merged by jenkins-bot:
[wikidata/query/rdf@master] Add support for EventDataStreamFactory for input streams
Change #1079538 merged by jenkins-bot:
[wikidata/query/rdf@master] Add support for setting a start timestamp
Change #1081221 merged by jenkins-bot:
[wikidata/query/rdf@master] Add support for EventDataStreamFactory for output streams
Change #1091290 had a related patch set uploaded (by DCausse; author: DCausse):
[wikidata/query/deploy@master] deploy version 0.3.150
dcausse opened https://gitlab.wikimedia.org/repos/search-platform/flink-rdf-streaming-updater/-/merge_requests/22
Bump to 0.3.150
dcausse merged https://gitlab.wikimedia.org/repos/search-platform/flink-rdf-streaming-updater/-/merge_requests/22
Bump to 0.3.150
Change #1091306 had a related patch set uploaded (by DCausse; author: DCausse):
[operations/deployment-charts@master] rdf-streaming-updater: bump to 0.3.150
Change #1092191 had a related patch set uploaded (by DCausse; author: DCausse):
[operations/deployment-charts@master] rdf-streaming-updater: produce rdf_change v2 events
Change #1091290 merged by Bking:
[wikidata/query/deploy@master] deploy version 0.3.150
Change #1092191 merged by jenkins-bot:
[operations/deployment-charts@master] rdf-streaming-updater: produce rdf_change v2 events
Change #1099656 had a related patch set uploaded (by DCausse; author: DCausse):
[wikidata/query/rdf@master] Add canary event filtering for the streaming-updater-consumer
Change #1099727 had a related patch set uploaded (by DCausse; author: DCausse):
[operations/mediawiki-config@master] rdf-streaming-updater: add wdqs udpater streams in event stream config
Change #1102319 had a related patch set uploaded (by DCausse; author: DCausse):
[wikidata/query/rdf@master] Add support for versioned streams
Change #1099727 merged by jenkins-bot:
[operations/mediawiki-config@master] rdf-streaming-updater: add wdqs udpater streams in event stream config
Mentioned in SAL (#wikimedia-operations) [2024-12-17T14:05:33Z] <dcausse@deploy2002> Started scap sync-world: Backport for [[gerrit:1099727|rdf-streaming-updater: add wdqs udpater streams in event stream config (T374919)]], [[gerrit:1104598|cirrussearch: increase shard count for cebwiki_content (T379002)]]
Mentioned in SAL (#wikimedia-operations) [2024-12-17T14:14:55Z] <dcausse@deploy2002> dcausse: Backport for [[gerrit:1099727|rdf-streaming-updater: add wdqs udpater streams in event stream config (T374919)]], [[gerrit:1104598|cirrussearch: increase shard count for cebwiki_content (T379002)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)
Mentioned in SAL (#wikimedia-operations) [2024-12-17T14:25:41Z] <dcausse@deploy2002> Finished scap sync-world: Backport for [[gerrit:1099727|rdf-streaming-updater: add wdqs udpater streams in event stream config (T374919)]], [[gerrit:1104598|cirrussearch: increase shard count for cebwiki_content (T379002)]] (duration: 20m 07s)