“Currently term store is reaching 340GB in wikidata and slowly reaching the wb_terms era”, so @Ladsgroup wants to “[split] s8 into a core cluster and a dedicated cluster for term store (tentatively called x3)”.
This is the general task to achieve that; T351802: WPP: Make term store database configurable covers the necessary code changes in Wikibase; the Wikimedia production / operations / DBA side can happen either in this task or in additional subtasks. (Feel free to edit this task as needed.)
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T351820 Move Wikidata term store to separate database cluster | |||
| Open | None | T351802 WPP: Make term store database configurable |
For further clarification, it would be good to hear from @Ladsgroup about the urgency of this on their side. This will also help @WMDE-leszek asses the priorities of the respective code changes in T351802: WPP: Make term store database configurable. Regardless as I take it, there isn't much we should be doing on the Wikidata team side of things, or am I mistaken?
Clarification, we will not do anything until at least start of next US FY (as we need to budget a couple more dbs for extra headroom) so we have at least six months. It is not urgent but I don't want us to do it in an emergency/rushed manner either. It's more of an "early alarm". Hope that clears things.
Nope, this is for now an Epic, we need to add cloud replicas, backups, etc.
Clarification, we will not do anything until at least start of next US FY (as we need to budget a couple more dbs for extra headroom) so we have at least six months.
100% thank you! I'll copy it over to the task the wmde teams are discussing in.