Page MenuHomePhabricator

wdqs: integrate with eventgate
Closed, ResolvedPublic3 Estimated Story Points

Description

We need to set up the Event Platform to understand our events and send them along to Kafka.

There are a few parts:

  • Update EventStreamConfig to add a stream with the new schema from T427787
  • Perform a mediawiki-config backport deployment to pick up the change
  • Do a rolling restart of the eventgate cluster to actually deploy the change

After this is done, we should be able to POST events from the proxy to the right eventgate URI and have them processed and eventually available in the event tables.

AC:

  • EventStreamConfig includes our new stream
  • Backport deployment of mediawiki-config is complete
  • eventgate cluster has been restarted; stream is available for posting

Some documentation exists here: https://wikitech.wikimedia.org/wiki/Event_Platform/Stream_Configuration

Event Timeline

Change #1302923 had a related patch set uploaded (by Lerickson; author: Lerickson):

[operations/mediawiki-config@master] EventStreamConfig: add stream for WDQS V2 external queries.

https://gerrit.wikimedia.org/r/1302923

Change #1302923 merged by jenkins-bot:

[operations/mediawiki-config@master] EventStreamConfig: add stream for WDQS V2 external/internal queries.

https://gerrit.wikimedia.org/r/1302923

Mentioned in SAL (#wikimedia-operations) [2026-06-18T13:08:19Z] <ladsgroup@deploy1003> Started scap sync-world: Backport for [[gerrit:1302923|EventStreamConfig: add stream for WDQS V2 external/internal queries. (T429380)]]

Mentioned in SAL (#wikimedia-operations) [2026-06-18T13:10:18Z] <ladsgroup@deploy1003> ladsgroup, lerickson: Backport for [[gerrit:1302923|EventStreamConfig: add stream for WDQS V2 external/internal queries. (T429380)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Mentioned in SAL (#wikimedia-operations) [2026-06-18T13:19:14Z] <ladsgroup@deploy1003> Finished scap sync-world: Backport for [[gerrit:1302923|EventStreamConfig: add stream for WDQS V2 external/internal queries. (T429380)]] (duration: 10m 55s)

Last Thursday, the backport deployment of the config update was successful.

I wasn't in the deployers group at the time, so I couldn't restart EventGate. @gmodena
and I had planned to do this on Monday, but @Ottomata noticed that waiting to restart broke the event canary tasks, so he restarted the servers to pick up the change.

I confirmed the new schema is available in the EventGate server: https://schema.wikimedia.org/repositories//secondary/jsonschema/development/sparql/query/2.0.1.yaml

Thank you @Ottomata for filing the follow up task, that's great!