wdqs-categories , a separate blazegraph instance which powers on-wiki deep category search , is currently deployed alongside the primary blazegraph instance on all older "full graph" WDQS hosts. These older "full graph" hosts are going away (ref T337013 ), so we need to find a new home for wdqs-categories.
Creating this epic to cover all actions related to the wdqs-categories migration.
See also: T292404: [DSE Hackathon 2021] Move the categories graph out of blazegraph
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T375520 EPIC: WDQS categories migration | |||
| Resolved | bking | T375443 categories migration: determine size of new WDQS categories dump | |||
| Resolved | bking | T374016 Consider separating wdqs-categories from the rest of the wdqs stack | |||
| Resolved | bking | T375687 Test categories performance under Ganeti | |||
| Resolved | bking | T376079 eqiad: request 1 VM for wdqs-categories | |||
| Resolved | bking | T374009 Investigate EQIAD WDQS graph split host alerts/separate out categories in the puppet code | |||
| Declined | None | T380608 Address categories migration for internal graph split endpoints | |||
| Resolved | bking | T385896 Deploy wdqs-categories on wdqs-main/wdqs-internal-main hosts | |||
| Open | None | T384937 Stress-test wdqs-categories | |||
| Declined | None | T385551 Roll out wdqs-categories reload job to dse-k8s |
Change #1122151 had a related patch set uploaded (by Bking; author: Bking):
[operations/mediawiki-config@master] wdqs-categories: use new split graph hosts (wdqs-main) for categories
Change #1124535 had a related patch set uploaded (by Ryan Kemper; author: Ryan Kemper):
[operations/mediawiki-config@master] wdqs categories: switch to internal-main
Change #1122151 merged by Ryan Kemper:
[operations/mediawiki-config@master] wdqs-categories: remove extraneous wgCirrusSearchCategoryEndpoint value
Change #1124535 merged by jenkins-bot:
[operations/mediawiki-config@master] wdqs categories: switch to internal-main
Mentioned in SAL (#wikimedia-operations) [2025-03-25T20:26:26Z] <ryankemper@deploy1003> Started scap sync-world: Backport for [[gerrit:1124535|wdqs categories: switch to internal-main (T375520 T385896 T337013)]]
Mentioned in SAL (#wikimedia-operations) [2025-03-25T20:33:11Z] <ryankemper@deploy1003> ryankemper: Backport for [[gerrit:1124535|wdqs categories: switch to internal-main (T375520 T385896 T337013)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)
Mentioned in SAL (#wikimedia-operations) [2025-03-25T20:48:06Z] <ryankemper@deploy1003> Finished scap sync-world: Backport for [[gerrit:1124535|wdqs categories: switch to internal-main (T375520 T385896 T337013)]] (duration: 21m 40s)