Upgrade and restart s4 (commonswiki) primary database master: Tue 12th May
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Marostegui
	Apr 30 2020, 9:15 AM

Description

The following wikis will go read-only:

s4:

commonswiki

Impact: That wikis will go read-only for around 15 minutes (hopefully a lot less). Reads will not be impacted
When: Tue 12th May at 05:00 AM UTC

s4 primary db master: db1138

The read only window request is at: T251501

Status	Assigned	Task
Resolved	jbond	T236277 Extend Puppet CA Expiry date
Resolved	jbond	T237259 Document all uses of the puppetCA certificate
Resolved	RLazarus	T237362 Rolling restart of etcd to pick up the renewed CA public certificate.
Resolved	Marostegui	T239791 DB: perform rolling restart of mariadb daemons to pick up CA changes
Resolved	Marostegui	T251502 Upgrade and restart s4 (commonswiki) primary database master: Tue 12th May
Resolved	Trizek-WMF	T251501 Read only time window needed for Commonswiki
Resolved	jbond	T240330 Check if traffic servers need restarting/reloading post CA change

Marostegui triaged this task as Medium priority.Apr 30 2020, 9:15 AM

Marostegui updated the task description. (Show Details)

Marostegui moved this task from Triage to Pending comment on the DBA board.

Mentioned in SAL (#wikimedia-operations) [2020-05-11T13:20:32Z] <marostegui> Upgrade mysql package on s4 master in preparation for tomorrow's maintenance T251502

Package has been upgraded on db1138

Maintenance day:

dbctl --scope eqiad section s4 ro "Maintenance on s4 T251502" && dbctl config commit -m "Set s4 as read-only for maintenance T251502"

dbctl --scope eqiad section s4 rw && dbctl config commit -m "Set s4 as read-only=off for maintenance T251502"

Window reserved on the Deployment's calendar

Mentioned in SAL (#wikimedia-operations) [2020-05-12T05:00:54Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Set s4 as read-only for maintenance T251502', diff saved to https://phabricator.wikimedia.org/P11179 and previous config saved to /var/cache/conftool/dbconfig/20200512-050054-marostegui.json

Mentioned in SAL (#wikimedia-operations) [2020-05-12T05:03:40Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Set s4 as read-only=off for maintenance T251502', diff saved to https://phabricator.wikimedia.org/P11180 and previous config saved to /var/cache/conftool/dbconfig/20200512-050339-marostegui.json

This has been done.
RO starts: 05:00:54
RO stops: 05:03:40