Prepare new WDQS hosts for graph splitting
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	bking
	Sep 27 2023, 3:34 PM

Description

wdqs1017-1024 are newly-deployed WDQS hosts.

Let's claim 1022-1024 for the graph splitting experiment. These will be a new tier of WDQS hosts.

Creating this ticket to:

Create and deploy Puppet code for this new tier, which is defined by:
- Mounting the dumps server so we can copy over the TTL files.
- Stopping/masking wdqs-updater so we don't get updates from the production app.
Create/confirm dashboards and alerting are correct.

Details

Subject	Repo	Branch	Lines +/-
wdqs: fix graph split cyclical dependency	operations/puppet	production	+5 -2
wdqs: bring graph split hosts into service	operations/puppet	production	+5 -1
wdqs: Set up graph_split hosts	operations/puppet	production	+22 -6

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Open	None	T335067 Epic: Wikidata Query Service stabilization
Open	None	T337013 [Epic] Splitting the graph in WDQS
Resolved	Gehel	T350464 Expose SPARQL endpoints with full wikidata data set and with split graph to enable experimentation on federation with a split graph
Resolved	bking	T347505 Prepare new WDQS hosts for graph splitting

Event Timeline

bking created this task.Sep 27 2023, 3:34 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 27 2023, 3:34 PM

bking added a parent task: T347504: WDQS graph split: load data from dumps into new hosts.Sep 27 2023, 3:35 PM

bking mentioned this in T337013: [Epic] Splitting the graph in WDQS.Sep 27 2023, 3:37 PM

bking removed a parent task: T347504: WDQS graph split: load data from dumps into new hosts.

bking added a subtask: T347504: WDQS graph split: load data from dumps into new hosts.

bking added a parent task: T337013: [Epic] Splitting the graph in WDQS.

Maintenance_bot added a project: Wikidata.Sep 27 2023, 3:46 PM

bking added a subscriber: • dcausse.Sep 27 2023, 3:47 PM

bking updated the task description. (Show Details)Sep 27 2023, 3:49 PM

Gehel moved this task from Incoming to Operations/SRE on the Wikidata-Query-Service board.Oct 2 2023, 3:43 PM

bking updated the task description. (Show Details)Oct 4 2023, 5:06 PM

Change 963404 had a related patch set uploaded (by Bking; author: Bking):

[operations/puppet@production] wdqs: Set up graph_split hosts

https://gerrit.wikimedia.org/r/963404

gerritbot added a project: Patch-For-Review.Oct 4 2023, 7:58 PM

bking updated the task description. (Show Details)Oct 4 2023, 8:26 PM

Change 963777 had a related patch set uploaded (by Bking; author: Bking):

[operations/puppet@production] wdqs: bring graph split hosts into service

https://gerrit.wikimedia.org/r/963777

dr0ptp4kt subscribed.Oct 6 2023, 2:10 PM

Gehel triaged this task as High priority.Oct 11 2023, 8:38 AM

Gehel moved this task from Incoming to Quarterly Goals on the Data-Platform-SRE board.

Mentioned in SAL (#wikimedia-operations) [2023-10-12T19:01:47Z] <ryankemper@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on wdqs[1022-1024].eqiad.wmnet with reason: new graph split hosts T347505

Mentioned in SAL (#wikimedia-operations) [2023-10-12T19:02:02Z] <ryankemper@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on wdqs[1022-1024].eqiad.wmnet with reason: new graph split hosts T347505