Upgrade and restart s1 (enwiki) primary database master: Thu 21th May
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• Marostegui
	May 6 2020, 7:34 AM

Description

We need to upgrade and restart s1 (enwiki) primary database masters as part of: T239791

The following wikis will go read-only:

enwiki

Impact: enwiki will go read-only for around 30 minutes (hopefully a lot less). Reads will not be impacted
When: Thu 21th May at 05:00 AM UTC

s1 primary db master: db1083

The read only window request is at: T251985

Status	Assigned	Task
Resolved	jbond	T236277 Extend Puppet CA Expiry date
Resolved	jbond	T237259 Document all uses of the puppetCA certificate
Resolved	RLazarus	T237362 Rolling restart of etcd to pick up the renewed CA public certificate.
Resolved	• Marostegui	T239791 DB: perform rolling restart of mariadb daemons to pick up CA changes
Resolved	• Marostegui	T251982 Upgrade and restart s1 (enwiki) primary database master: Thu 21th May
Resolved	Trizek-WMF	T251985 Read only time window needed for enwiki
Resolved	jbond	T240330 Check if traffic servers need restarting/reloading post CA change

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 6 2020, 7:34 AM

• Marostegui triaged this task as Medium priority.May 6 2020, 7:35 AM

• Marostegui moved this task from Triage to Pending comment on the DBA board.

• Marostegui updated the task description. (Show Details)

Mentioned in SAL (#wikimedia-operations) [2020-05-20T09:26:16Z] <marostegui> Upgrade db1083 (s1 master) to 10.1.43-2 without restarting T251982

Package upgraded on db1083 to 10.1.43-2 in preparation for tomorrow's maintenance.

Maintenance day:

dbctl --scope eqiad section s1 ro "Maintenance on enwiki T251982" && dbctl config commit -m "Set enwiki as read-only for maintenance T251982"

dbctl --scope eqiad section s1 rw && dbctl config commit -m "Set enwiki as read-only=off after maintenance T251982"

Mentioned in SAL (#wikimedia-operations) [2020-05-21T05:00:30Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Set enwiki as read-only for maintenance T251982', diff saved to https://phabricator.wikimedia.org/P11257 and previous config saved to /var/cache/conftool/dbconfig/20200521-050029-marostegui.json

Mentioned in SAL (#wikimedia-operations) [2020-05-21T05:03:28Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Set enwiki as read-only=off after maintenance T251982', diff saved to https://phabricator.wikimedia.org/P11258 and previous config saved to /var/cache/conftool/dbconfig/20200521-050328-marostegui.json

This was done.
RO starts: 05:00:30
RO stops: 05:03:28