Page MenuHomePhabricator

Upgrade 10.6.10 hosts to 10.6.12
Closed, ResolvedPublic

Description

There seems to be a bug on 10.6.10 with our query killer which is fixed on 10.6.12 (see T330422#8648488)

We need to upgrade our hosts from 10.6.10 to 10.6.12 (high higher priority to those that use query killers) which are:

  • db1200
  • db1137
  • db1111
  • db1168
  • db1143
  • db2178
  • db2102
  • db2146
  • db2180
  • db2122
  • db2175
  • es2022
  • es1022

Less priority:

  • pc1011
  • pc1014
  • pc2011

Event Timeline

Mentioned in SAL (#wikimedia-operations) [2023-02-27T12:28:04Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1200 db1111 db1168 db1143 T330653', diff saved to https://phabricator.wikimedia.org/P44766 and previous config saved to /var/cache/conftool/dbconfig/20230227-122804-root.json

Mentioned in SAL (#wikimedia-operations) [2023-02-27T12:35:14Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1137 T330653', diff saved to https://phabricator.wikimedia.org/P44770 and previous config saved to /var/cache/conftool/dbconfig/20230227-123514-root.json

Mentioned in SAL (#wikimedia-operations) [2023-02-27T12:38:15Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool es1022 es2022 T330653', diff saved to https://phabricator.wikimedia.org/P44774 and previous config saved to /var/cache/conftool/dbconfig/20230227-123814-root.json

Ladsgroup subscribed.

Thanks for finding the bug <3

Mentioned in SAL (#wikimedia-operations) [2023-02-27T13:32:32Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2175 T330653', diff saved to https://phabricator.wikimedia.org/P44805 and previous config saved to /var/cache/conftool/dbconfig/20230227-133231-root.json

Tests hosts also upgraded (db1133, db1124, db1125)

Mentioned in SAL (#wikimedia-operations) [2023-02-27T13:40:19Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2122 T330653', diff saved to https://phabricator.wikimedia.org/P44817 and previous config saved to /var/cache/conftool/dbconfig/20230227-134018-root.json

Mentioned in SAL (#wikimedia-operations) [2023-02-27T13:58:57Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2178 db2146 db2180 T330653', diff saved to https://phabricator.wikimedia.org/P44835 and previous config saved to /var/cache/conftool/dbconfig/20230227-135856-root.json

Marostegui updated the task description. (Show Details)

All the urgent hosts have been done - pending only pc1011 which I will do after the DC switchover (as it requires deploying MW changes)

Change 892478 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/mediawiki-config@master] ProductionServices.php: Promote pc1014 to pc1 master

https://gerrit.wikimedia.org/r/892478

Change 892478 merged by jenkins-bot:

[operations/mediawiki-config@master] ProductionServices.php: Promote pc1014 to pc1 master

https://gerrit.wikimedia.org/r/892478

Mentioned in SAL (#wikimedia-operations) [2023-02-28T06:33:55Z] <marostegui@deploy1002> Started scap: Backport for [[gerrit:892478|ProductionServices.php: Promote pc1014 to pc1 master (T330653)]]

Mentioned in SAL (#wikimedia-operations) [2023-02-28T06:35:46Z] <marostegui@deploy1002> marostegui: Backport for [[gerrit:892478|ProductionServices.php: Promote pc1014 to pc1 master (T330653)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet

Mentioned in SAL (#wikimedia-operations) [2023-02-28T06:41:49Z] <marostegui@deploy1002> Finished scap: Backport for [[gerrit:892478|ProductionServices.php: Promote pc1014 to pc1 master (T330653)]] (duration: 07m 54s)

Marostegui updated the task description. (Show Details)

This is all done