Currently, WDQS is being updated with streaming updater, using a topic that connects streaming updater producer with consumers. It was decided that WCQS will get a seperate topic, which means that we need to:
AC:
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | Ladsgroup | T271851 Clean up gui from the wdqs deploy repo and puppet | |||
| Resolved | None | T260568 [EPIC] Productionize WCQS | |||
| Resolved | EBernhardson | T262265 Provide real-time updates for WCQS | |||
| Resolved | EBernhardson | T293638 Create and update the process for separate WCQS mutation topic |
Change 743053 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):
[operations/puppet@production] rdf-streaming-updater: Add configuration for wcqs
Change 743053 merged by Ryan Kemper:
[operations/puppet@production] rdf-streaming-updater: Add configuration for wcqs
Create the topic (proposed name mediainfo-streaming-updater-mutation, up for debate)
It seems like we don't particularly create the topic unless we need special settings, sending messages to the new topic should create it. To that end I suppose we could consider this resolved once the updater is started.
The topic used in the configuration (not yet merged, may change): <dc>.mediainfo-streaming-updater.mutation
Verify if WCQS streaming updater producer and consumers have a correct topic configured
Neither producer or consumer were configured. Patches are up to configure both as above.
Provide a way to either configure or autodetect correct mutation topics in cookbooks.
Started looking into it, should be able to auto-magic the right topic into place based on the cluster things belong to.
Provide a way to either configure or autodetect correct mutation topics in cookbooks.
While not strictly called out in this ticket, while looking into this i saw that having the correct mutation topics is not nearly enough to allow the cookbooks to work on the wcqs instances. It didn't seem worthwhile to hack this one detail into place, so i've started working out how the cookbooks can be less specific to wdqs.
Change 745629 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):
[operations/cookbooks@master] Integrate wcqs with wdqs cookbooks
Change 745629 merged by Gehel:
[operations/cookbooks@master] sre.wdqs: Integrate wcqs with wdqs cookbooks