Page MenuHomePhabricator

Upgrade x2 to 10.4.21
Closed, ResolvedPublic

Description

x2 needs upgrading to 10.4.21

  • db1151
  • db1152
  • db1153
  • db2142
  • db2143
  • db2144

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript
Marostegui moved this task from Triage to Ready on the DBA board.

Mentioned in SAL (#wikimedia-operations) [2021-11-04T12:25:04Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db2144 for mysql upgrade T295026', diff saved to https://phabricator.wikimedia.org/P17689 and previous config saved to /var/cache/conftool/dbconfig/20211104-122504-ladsgroup.json

Mentioned in SAL (#wikimedia-operations) [2021-11-04T12:44:45Z] <Amir1> Upgrade db2144 (kernel and mariadb) T295026

Mentioned in SAL (#wikimedia-operations) [2021-11-04T13:04:13Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'db2144 (re)pooling @ 50%: After upgrade T295026', diff saved to https://phabricator.wikimedia.org/P17690 and previous config saved to /var/cache/conftool/dbconfig/20211104-130412-root.json

Ladsgroup moved this task from Ready to In progress on the DBA board.

Mentioned in SAL (#wikimedia-operations) [2021-11-04T13:19:16Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'db2144 (re)pooling @ 100%: After upgrade T295026', diff saved to https://phabricator.wikimedia.org/P17691 and previous config saved to /var/cache/conftool/dbconfig/20211104-131916-root.json

Mentioned in SAL (#wikimedia-operations) [2021-11-04T15:29:19Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db2143 for mysql upgrade T295026', diff saved to https://phabricator.wikimedia.org/P17694 and previous config saved to /var/cache/conftool/dbconfig/20211104-152919-ladsgroup.json

Mentioned in SAL (#wikimedia-operations) [2021-11-04T15:31:44Z] <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db2143.codfw.wmnet with reason: Maintenance T295026

Mentioned in SAL (#wikimedia-operations) [2021-11-04T15:31:47Z] <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2143.codfw.wmnet with reason: Maintenance T295026

Mentioned in SAL (#wikimedia-operations) [2021-11-04T15:45:44Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'db2143 (re)pooling @ 50%: After upgrade T295026', diff saved to https://phabricator.wikimedia.org/P17695 and previous config saved to /var/cache/conftool/dbconfig/20211104-154543-root.json

Mentioned in SAL (#wikimedia-operations) [2021-11-04T16:00:47Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'db2143 (re)pooling @ 100%: After upgrade T295026', diff saved to https://phabricator.wikimedia.org/P17696 and previous config saved to /var/cache/conftool/dbconfig/20211104-160047-root.json

Mentioned in SAL (#wikimedia-operations) [2021-11-04T17:29:50Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1152 for mysql upgrade T295026', diff saved to https://phabricator.wikimedia.org/P17697 and previous config saved to /var/cache/conftool/dbconfig/20211104-172950-ladsgroup.json

Mentioned in SAL (#wikimedia-operations) [2021-11-04T17:30:20Z] <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db1152.eqiad.wmnet with reason: Maintenance T295026

Mentioned in SAL (#wikimedia-operations) [2021-11-04T17:30:22Z] <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1152.eqiad.wmnet with reason: Maintenance T295026

Mentioned in SAL (#wikimedia-operations) [2021-11-04T17:39:26Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1152 (re)pooling @ 50%: After upgrade T295026', diff saved to https://phabricator.wikimedia.org/P17698 and previous config saved to /var/cache/conftool/dbconfig/20211104-173926-root.json

Mentioned in SAL (#wikimedia-operations) [2021-11-04T17:54:30Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1152 (re)pooling @ 100%: After upgrade T295026', diff saved to https://phabricator.wikimedia.org/P17699 and previous config saved to /var/cache/conftool/dbconfig/20211104-175429-root.json

Mentioned in SAL (#wikimedia-operations) [2021-11-04T17:56:07Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1153 for mysql upgrade T295026', diff saved to https://phabricator.wikimedia.org/P17700 and previous config saved to /var/cache/conftool/dbconfig/20211104-175606-ladsgroup.json

Mentioned in SAL (#wikimedia-operations) [2021-11-04T17:57:38Z] <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db1153.eqiad.wmnet with reason: Maintenance T295026

Mentioned in SAL (#wikimedia-operations) [2021-11-04T17:57:46Z] <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1153.eqiad.wmnet with reason: Maintenance T295026

Mentioned in SAL (#wikimedia-operations) [2021-11-04T18:11:51Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1153 (re)pooling @ 50%: After upgrade T295026', diff saved to https://phabricator.wikimedia.org/P17701 and previous config saved to /var/cache/conftool/dbconfig/20211104-181151-root.json

Mentioned in SAL (#wikimedia-operations) [2021-11-04T18:26:55Z] <ladsgroup@cumin1001> dbctl commit (dc=all): 'db1153 (re)pooling @ 100%: After upgrade T295026', diff saved to https://phabricator.wikimedia.org/P17703 and previous config saved to /var/cache/conftool/dbconfig/20211104-182655-root.json

Replicas done, primaries will be done later.

Mentioned in SAL (#wikimedia-operations) [2021-11-04T20:01:01Z] <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1153.eqiad.wmnet with reason: Maintenance T295026

Mentioned in SAL (#wikimedia-operations) [2021-11-04T20:01:06Z] <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1153.eqiad.wmnet with reason: Maintenance T295026

Mentioned in SAL (#wikimedia-operations) [2021-11-05T08:34:19Z] <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on 6 hosts with reason: Upgrade x2 masters T295026

Mentioned in SAL (#wikimedia-operations) [2021-11-05T08:34:24Z] <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 6 hosts with reason: Upgrade x2 masters T295026

Mentioned in SAL (#wikimedia-operations) [2021-11-05T08:34:34Z] <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 3:00:00 on 6 hosts with reason: Upgrade x2 masters T295026

Mentioned in SAL (#wikimedia-operations) [2021-11-05T08:34:39Z] <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on 6 hosts with reason: Upgrade x2 masters T295026

Ladsgroup moved this task from In progress to Done on the DBA board.