Page MenuHomePhabricator
Create Task
Maniphest T258361

Productionize db1155-db1175 and refresh and decommission db1074-db1095 (22 servers)
Open, MediumPublic
Actions

Description

The following hosts are scheduled to be decommissioned in Q2 and need to be refreshed:
db1074-db1095 (22 servers)

We have started to see issues on them, especially BBU related: T258360 T258360

Replacement plan:

  • db1124 B1 (old sanitarium host, currently in use) to replace db1077
  • db1125 D1 (old sanitarium host, currently in use) to be placed on s7
  • db1156 A1 to replace db1074 (sanitarium master)
  • db1157 A5 to replace db1075
  • db1158 A5 to replace db1079 (sanitarium master)
  • db1159 A6 to replace db1080 (m1 master)
  • db1160 A6 to replace db1081
  • db1161 A8 to replace db1082 (sanitarium master)
  • db1162 B1 to replace db1076 (candidate master)
  • db1163 B3 to replace db1083 (s1 master) CURRENTLY pooled on s1 as stretch to substitute db1134 T274472
  • db1164 B5 to replace db1084
  • db1165 B6 to replace db1085 (sanitarium master)
  • db1166 C3 to replace db1078
  • db1167 C3 to replace db1087 (sanitarium master)
  • db1168 C5 to replace db1088
  • db1169 C5 to replace db1089
  • db1170 C6 to replace db1090 (multi-instance)
  • db1171 C6 to replace db1095
  • db1172 D1 to replace db1092
  • db1173 D3 to replace db1093 (candidate master)
  • db1174 D6 to replace db1094
  • db1175 D3 to be placed on s3

Decommissioning progress

Details

ProjectBranchLines +/-Subject
operations/puppetproduction+1 -0instances.yaml: Add db1168 to dbctl
operations/puppetproduction+0 -1db1168: Enable notifications
operations/puppetproduction+3 -2mariadb: Productionize db1168
operations/puppetproduction+1 -0instances.yaml: Add db1172 to dbctl
operations/puppetproduction+0 -1db1172: Disable notifications
operations/puppetproduction+3 -2mariadb: Productionize db1172
operations/puppetproduction+1 -0instances.yaml: Add db1162 to dbctl
operations/puppetproduction+0 -1db1162: Enable notifications
operations/puppetproduction+2 -2mariadb: Reenable notifications for db1163 once it has been pooled
operations/puppetproduction+1 -0instances.yaml: Add db1163 to dbctl
operations/puppetproduction+5 -2db1163: Reimage to stretch to potentially become s1 candidate master
operations/puppetproduction+1 -1install_server: Do not reimage db1157
operations/puppetproduction+5 -2mariadb: Productionize db1162
operations/puppetproduction+2 -0instances.yaml: Add db1170 to dbctl
operations/puppetproduction+0 -1db1170: Enable notifications
operations/puppetproduction+1 -0install_server: Reimage db1162 to Stretch
operations/puppetproduction+0 -1db1157: Disable notifications
operations/puppetproduction+1 -0instances: Add db1157
operations/puppetproduction+8 -4mariadb: Productionize db1170
operations/puppetproduction+2 -2install_server: Disable disk format for db1171
operations/puppetproduction+5 -2mariadb: Productionize db1157
operations/puppetproduction+1 -0install_server: Reimage db1157 as stretch
operations/puppetproduction+1 -0instances.yaml: Add db1173 to dbctl
operations/puppetproduction+0 -1db1173: Enable notifications
operations/puppetproduction+5 -2mariadb: Productionize db1173
operations/puppetproduction+1 -0install_server: Reimage db1173 as stretch
operations/puppetproduction+1 -0instances.yaml: Add db1174.
operations/puppetproduction+3 -2mariadb: Productionize db1174
operations/puppetproduction+3 -2mariadb: Productionize db1174
operations/puppetproduction+9 -2backup-sources: Productionize db1171 to substitute db1095
operations/puppetproduction+1 -0install_server: Reimage db1171 into stretch so we still have 10.1 backups
operations/puppetproduction+1 -1mariadb: db1166 added to dbctl and notifications enabled
operations/puppetproduction+1 -0db1175: Add it to dbctl
operations/puppetproduction+0 -1db1175: Enable notifications
operations/puppetproduction+4 -2mariadb: Productionize db1166
operations/puppetproduction+4 -2mariadb: Productionize db1175
operations/puppetproduction+0 -1db1169: Enable notifications
operations/puppetproduction+1 -0instances.yaml: Add db1169
operations/puppetproduction+3 -2mariadb: Productionize db1169 in s1
operations/puppetproduction+1 -1install_server: Do not reimage db1160
operations/puppetproduction+0 -1db1160: Disable notifications
operations/puppetproduction+1 -0instances.yaml: Add db1160
operations/puppetproduction+5 -2mariadb: Productionize db1160
operations/puppetproduction+1 -0db1081: Disable notifications
operations/puppetproduction+1 -0db1160: Install stretch
Show related patches Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
Unknown Object (Task)
 OpenMarosteguiT258361 Productionize db1155-db1175 and refresh and decommission db1074-db1095 (22 servers)
 DeclinedNoneT258386 db1080-95 batch possibly suffering BBU issues
 ResolvedMarosteguiT258336 db1082 crashed
 ResolvedJclark-ctrT258910 Remove db1082's BBU on-site
 ResolvedMarosteguiT258360 db1085 crashed
 ResolvedMarosteguiT264755 db1076 crashed - BBU failure
 ResolvedRequestwiki_willyT267088 decommission db1091.eqiad.wmnet
 ResolvedMarosteguiT271427 Switchover s4 (commonswiki) from db1081 to db1138
 ResolvedTrizek-WMFT271791 Database primary master failover on s4 (commonswiki)
 OpenKormatT272954 Fix db-switchover update zarcillo part
 OpenNoneT274336 Switchover s7 from db1086 to db1136
 ResolvedCmjohnsonT262901 Physically move db1131 from B5 to C8
 ResolvedRobHT267043 (Need By: 2020-11-29) rack/setup/install db11[51-76]
 ResolvedMarosteguiT268742 Test upgrading sanitarium hosts to Buster + 10.4
 StalledMarosteguiT272008 Move wikireplicas under the new sanitarium hosts (db1154, db1155)
 ResolvedCmjohnsonT272125 Memory errors on clouddb1019
 ResolveddcaroT272127 2021-01-15: ** PROBLEM alert - labstore1004/Ensure mysql credential creation for tools users is running is CRITICAL **
Restricted Task
 OpenRequestCmjohnsonT273040 decommission db1081.eqiad.wmnet
 ResolvedRequestCmjohnsonT273417 decommission db1089.eqiad.wmnet
 OpenRequestCmjohnsonT273597 decommission db1078.eqiad.wmnet
 OpenRequestCmjohnsonT273710 decommission db1094.eqiad.wmnet
 OpenRequestCmjohnsonT273732 decommission db1095
 OpenRequestCmjohnsonT273955 decommission db1093.eqiad.wmnet
 OpenRequestCmjohnsonT274333 decommission db1090.eqiad.wmnet
 StalledRequestMarosteguiT274752 decommission db1076.eqiad.wmnet
 OpenCmjohnsonT275309 db1162 crashed
 OpenRequestMarosteguiT276025 decommission db1088.eqiad.wmnet

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Stashbot added a comment.Wed, Feb 10, 6:35 AM

Mentioned in SAL (#wikimedia-operations) [2021-02-10T06:35:35Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Give more weight to db1170:3312, db1170:3317 T258361', diff saved to https://phabricator.wikimedia.org/P14281 and previous config saved to /var/cache/conftool/dbconfig/20210210-063534-marostegui.json

gerritbot added a comment.Wed, Feb 10, 6:41 AM

Change 663107 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] mariadb: Productionize db1162

https://gerrit.wikimedia.org/r/663107

gerritbot added a comment.Wed, Feb 10, 6:42 AM

Change 663107 merged by Marostegui:
[operations/puppet@production] mariadb: Productionize db1162

https://gerrit.wikimedia.org/r/663107

Stashbot added a comment.Wed, Feb 10, 6:43 AM

Mentioned in SAL (#wikimedia-operations) [2021-02-10T06:43:30Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Fully pool db1170:3312, db1170:3317 T258361', diff saved to https://phabricator.wikimedia.org/P14282 and previous config saved to /var/cache/conftool/dbconfig/20210210-064330-marostegui.json

Marostegui added a comment.Wed, Feb 10, 6:43 AM

Fully pooled:
db1170:3312
db1170:3317

Marostegui updated the task description. (Show Details)Wed, Feb 10, 6:44 AM
Marostegui added a subtask: T274333: decommission db1090.eqiad.wmnet.
Marostegui updated the task description. (Show Details)
Marostegui added a comment.Wed, Feb 10, 8:57 AM

db1162 is now replicating, but I won't pool it until I'm back next week.

Marostegui updated the task description. (Show Details)Wed, Feb 10, 10:16 AM
gerritbot added a comment.Wed, Feb 10, 12:07 PM

Change 663181 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] install_server: Do not reimage db1157

https://gerrit.wikimedia.org/r/663181

gerritbot added a comment.Wed, Feb 10, 12:08 PM

Change 663181 merged by Marostegui:
[operations/puppet@production] install_server: Do not reimage db1157

https://gerrit.wikimedia.org/r/663181

jcrespo claimed this task.Thu, Feb 11, 10:25 AM

I am taking db1163 to, at least temporarily, substitute db1134 due to T274472.

gerritbot added a comment.Thu, Feb 11, 11:00 AM

Change 663549 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] db1163: Reimage to stretch to potentially become s1 candidate master

https://gerrit.wikimedia.org/r/663549

gerritbot added a comment.Thu, Feb 11, 11:21 AM

Change 663549 merged by Jcrespo:
[operations/puppet@production] db1163: Reimage to stretch to potentially become s1 candidate master

https://gerrit.wikimedia.org/r/663549

gerritbot added a comment.Thu, Feb 11, 1:27 PM

Change 663570 had a related patch set uploaded (by LSobanski; owner: LSobanski):
[operations/puppet@production] instances.yaml: Add db1163 to dbctl

https://gerrit.wikimedia.org/r/663570

gerritbot added a comment.Thu, Feb 11, 1:52 PM

Change 663570 merged by LSobanski:
[operations/puppet@production] instances.yaml: Add db1163 to dbctl

https://gerrit.wikimedia.org/r/663570

Stashbot added a comment.Thu, Feb 11, 2:44 PM

Mentioned in SAL (#wikimedia-operations) [2021-02-11T14:44:46Z] <kormat@cumin1001> dbctl commit (dc=all): 'Add db1163 to s1 T258361', diff saved to https://phabricator.wikimedia.org/P14318 and previous config saved to /var/cache/conftool/dbconfig/20210211-144445-kormat.json

Stashbot added a comment.Thu, Feb 11, 3:45 PM

Mentioned in SAL (#wikimedia-operations) [2021-02-11T15:45:01Z] <kormat@cumin1001> dbctl commit (dc=all): 'Pool db1163 at 1% T258361', diff saved to https://phabricator.wikimedia.org/P14320 and previous config saved to /var/cache/conftool/dbconfig/20210211-154501-kormat.json

Stashbot added a comment.Thu, Feb 11, 4:13 PM

Mentioned in SAL (#wikimedia-operations) [2021-02-11T16:13:08Z] <kormat@cumin1001> dbctl commit (dc=all): 'Pool db1163 at 1%, again T258361', diff saved to https://phabricator.wikimedia.org/P14323 and previous config saved to /var/cache/conftool/dbconfig/20210211-161308-kormat.json

jcrespo reassigned this task from jcrespo to Marostegui.Thu, Feb 11, 4:22 PM
jcrespo updated the task description. (Show Details)
gerritbot added a comment.Thu, Feb 11, 4:32 PM

Change 663608 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb: Reenable notifications for db1163 once it has been pooled

https://gerrit.wikimedia.org/r/663608

gerritbot added a comment.Thu, Feb 11, 4:59 PM

Change 663608 merged by Jcrespo:
[operations/puppet@production] mariadb: Reenable notifications for db1163 once it has been pooled

https://gerrit.wikimedia.org/r/663608

Marostegui added a comment.Mon, Feb 15, 6:17 AM
In T258361#6822070, @jcrespo wrote:

I am taking db1163 to, at least temporarily, substitute db1134 due to T274472.

Thanks. I am going to leave db1163 in s1 as it needed to replace db1083 (s1) as well anyways. Going to do a compare data between db1163 and db1083 and if it is fine, I will just use db1163 as future master and re-image db1134 as buster.
Once db1083 is no longer master (to be scheduled for this Q), I will reimage db1118 to Stretch and make it candidate master (for real)

gerritbot added a comment.Mon, Feb 15, 6:19 AM

Change 664087 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1162: Enable notifications

https://gerrit.wikimedia.org/r/664087

gerritbot added a comment.Mon, Feb 15, 6:20 AM

Change 664087 merged by Marostegui:
[operations/puppet@production] db1162: Enable notifications

https://gerrit.wikimedia.org/r/664087

gerritbot added a comment.Mon, Feb 15, 6:36 AM

Change 664088 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] instances.yaml: Add db1162 to dbctl

https://gerrit.wikimedia.org/r/664088

gerritbot added a comment.Mon, Feb 15, 6:37 AM

Change 664088 merged by Marostegui:
[operations/puppet@production] instances.yaml: Add db1162 to dbctl

https://gerrit.wikimedia.org/r/664088

Stashbot added a comment.Mon, Feb 15, 6:40 AM

Mentioned in SAL (#wikimedia-operations) [2021-02-15T06:40:02Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1162 to dbctl - depooled T258361', diff saved to https://phabricator.wikimedia.org/P14339 and previous config saved to /var/cache/conftool/dbconfig/20210215-064001-marostegui.json

Stashbot added a comment.Mon, Feb 15, 6:46 AM

Mentioned in SAL (#wikimedia-operations) [2021-02-15T06:46:28Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db1162 with minimal weight T258361', diff saved to https://phabricator.wikimedia.org/P14340 and previous config saved to /var/cache/conftool/dbconfig/20210215-064628-marostegui.json

Stashbot added a comment.Mon, Feb 15, 7:02 AM

Mentioned in SAL (#wikimedia-operations) [2021-02-15T07:02:06Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db1162 with minimal weight T258361', diff saved to https://phabricator.wikimedia.org/P14341 and previous config saved to /var/cache/conftool/dbconfig/20210215-070206-marostegui.json

Marostegui updated the task description. (Show Details)Mon, Feb 15, 8:26 AM
Marostegui updated the task description. (Show Details)Mon, Feb 15, 9:01 AM
Marostegui added a subtask: T274752: decommission db1076.eqiad.wmnet.
Marostegui added a comment.Mon, Feb 15, 1:02 PM

db1162 is fully pooled

Marostegui added a comment.Tue, Feb 16, 6:12 AM
In T258361#6829557, @Marostegui wrote:
In T258361#6822070, @jcrespo wrote:

I am taking db1163 to, at least temporarily, substitute db1134 due to T274472.

Thanks. I am going to leave db1163 in s1 as it needed to replace db1083 (s1) as well anyways. Going to do a compare data between db1163 and db1083 and if it is fine, I will just use db1163 as future master and re-image db1134 as buster.
Once db1083 is no longer master (to be scheduled for this Q), I will reimage db1118 to Stretch and make it candidate master (for real)

db1163 was compared against current master (db1083) and it is ok. So db1163 will be the new s1 master, db1134 will be reimaged to buster and will be a slave, and db1118 will be reimaged to stretch and will be the candidate master.

Marostegui updated the task description. (Show Details)Tue, Feb 16, 6:45 AM
Stashbot added a comment.Tue, Feb 16, 6:46 AM

Mentioned in SAL (#wikimedia-operations) [2021-02-16T06:46:03Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1092 to clone db1172 T258361', diff saved to https://phabricator.wikimedia.org/P14365 and previous config saved to /var/cache/conftool/dbconfig/20210216-064602-marostegui.json

gerritbot added a comment.Tue, Feb 16, 7:39 AM

Change 664483 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] mariadb: Productionize db1172

https://gerrit.wikimedia.org/r/664483

gerritbot added a comment.Tue, Feb 16, 7:57 AM

Change 664483 merged by Marostegui:
[operations/puppet@production] mariadb: Productionize db1172

https://gerrit.wikimedia.org/r/664483

Marostegui added a comment.Tue, Feb 16, 9:21 AM

db1172 is now replicating on s8, will start pooling tomorrow

gerritbot added a comment.Wed, Feb 17, 6:18 AM

Change 664710 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1172: Disable notifications

https://gerrit.wikimedia.org/r/664710

gerritbot added a comment.Wed, Feb 17, 6:20 AM

Change 664710 merged by Marostegui:
[operations/puppet@production] db1172: Disable notifications

https://gerrit.wikimedia.org/r/664710

gerritbot added a comment.Wed, Feb 17, 6:35 AM

Change 664723 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] instances.yaml: Add db1172 to dbctl

https://gerrit.wikimedia.org/r/664723

gerritbot added a comment.Wed, Feb 17, 6:36 AM

Change 664723 merged by Marostegui:
[operations/puppet@production] instances.yaml: Add db1172 to dbctl

https://gerrit.wikimedia.org/r/664723

Stashbot added a comment.Wed, Feb 17, 6:39 AM

Mentioned in SAL (#wikimedia-operations) [2021-02-17T06:39:16Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1172 to dbctl, but not pooled yet T258361', diff saved to https://phabricator.wikimedia.org/P14385 and previous config saved to /var/cache/conftool/dbconfig/20210217-063915-marostegui.json

Stashbot added a comment.Wed, Feb 17, 7:21 AM

Mentioned in SAL (#wikimedia-operations) [2021-02-17T07:21:32Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db1172 in s8 for the first time - T258361', diff saved to https://phabricator.wikimedia.org/P14386 and previous config saved to /var/cache/conftool/dbconfig/20210217-072131-marostegui.json

Stashbot added a comment.Wed, Feb 17, 7:41 AM

Mentioned in SAL (#wikimedia-operations) [2021-02-17T07:41:08Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly pool db1172 in s8 - T258361', diff saved to https://phabricator.wikimedia.org/P14387 and previous config saved to /var/cache/conftool/dbconfig/20210217-074107-marostegui.json

Stashbot added a comment.Wed, Feb 17, 8:41 AM

Mentioned in SAL (#wikimedia-operations) [2021-02-17T08:41:21Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly pool db1172 in s8 - T258361', diff saved to https://phabricator.wikimedia.org/P14388 and previous config saved to /var/cache/conftool/dbconfig/20210217-084120-marostegui.json

Stashbot added a comment.Wed, Feb 17, 11:24 AM

Mentioned in SAL (#wikimedia-operations) [2021-02-17T11:24:22Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly pool db1172 in s8 - T258361', diff saved to https://phabricator.wikimedia.org/P14389 and previous config saved to /var/cache/conftool/dbconfig/20210217-112422-marostegui.json

Marostegui updated the task description. (Show Details)Wed, Feb 17, 12:40 PM

db1172 is now being automatically pooled into s8

Marostegui updated the task description. (Show Details)Wed, Feb 17, 12:43 PM
Marostegui updated the task description. (Show Details)Thu, Feb 18, 6:30 AM
Marostegui mentioned this in T275112: Migrate codfw sanitarium hosts (db2094/db2095) to Buster and 10.4.Thu, Feb 18, 9:10 AM
RhinosF1 updated the task description. (Show Details)Sun, Feb 21, 3:55 PM
RhinosF1 added a comment.Sun, Feb 21, 3:57 PM
In T258361#6830518, @Marostegui wrote:

db1162 is fully pooled

This just went down.

Marostegui added a subtask: T275309: db1162 crashed.Sun, Feb 21, 4:08 PM
Marostegui changed the status of subtask T274752: decommission db1076.eqiad.wmnet from Open to Stalled.Sun, Feb 21, 4:15 PM
Marostegui updated the task description. (Show Details)Wed, Feb 24, 6:31 AM
gerritbot added a comment.Thu, Feb 25, 6:50 AM

Change 666786 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] mariadb: Productionize db1168

https://gerrit.wikimedia.org/r/666786

Stashbot added a comment.Thu, Feb 25, 6:50 AM

Mentioned in SAL (#wikimedia-operations) [2021-02-25T06:50:19Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1088 to clone db1168 T258361', diff saved to https://phabricator.wikimedia.org/P14474 and previous config saved to /var/cache/conftool/dbconfig/20210225-065018-marostegui.json

Marostegui added a comment.Thu, Feb 25, 6:53 AM

Transfer on-going from db1088 to db1168. I will also install 10.4.18 on db1168

gerritbot added a comment.Thu, Feb 25, 7:54 AM

Change 666786 merged by Marostegui:
[operations/puppet@production] mariadb: Productionize db1168

https://gerrit.wikimedia.org/r/666786

Marostegui added a comment.Thu, Feb 25, 9:37 AM

db1168 is now replicating.

Marostegui updated the task description. (Show Details)Mon, Mar 1, 6:35 AM
gerritbot added a comment.Mon, Mar 1, 6:40 AM

Change 667428 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] db1168: Enable notifications

https://gerrit.wikimedia.org/r/667428

gerritbot added a comment.Mon, Mar 1, 6:41 AM

Change 667428 merged by Marostegui:
[operations/puppet@production] db1168: Enable notifications

https://gerrit.wikimedia.org/r/667428

gerritbot added a comment.Mon, Mar 1, 6:43 AM

Change 667429 had a related patch set uploaded (by Marostegui; owner: Marostegui):
[operations/puppet@production] instances.yaml: Add db1168 to dbctl

https://gerrit.wikimedia.org/r/667429

gerritbot added a comment.Mon, Mar 1, 6:43 AM

Change 667429 merged by Marostegui:
[operations/puppet@production] instances.yaml: Add db1168 to dbctl

https://gerrit.wikimedia.org/r/667429

Stashbot added a comment.Mon, Mar 1, 6:46 AM

Mentioned in SAL (#wikimedia-operations) [2021-03-01T06:46:04Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1168 to dbctl T258361!', diff saved to https://phabricator.wikimedia.org/P14519 and previous config saved to /var/cache/conftool/dbconfig/20210301-064603-marostegui.json

Stashbot added a comment.Mon, Mar 1, 6:47 AM

Mentioned in SAL (#wikimedia-operations) [2021-03-01T06:47:05Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db1168 with minimal weight T258361', diff saved to https://phabricator.wikimedia.org/P14520 and previous config saved to /var/cache/conftool/dbconfig/20210301-064704-marostegui.json

Marostegui added a comment.Mon, Mar 1, 7:48 AM

db1168 is now slowly being pooled into s6 running 10.4.18

Marostegui updated the task description. (Show Details)Mon, Mar 1, 7:48 AM
Marostegui updated the task description. (Show Details)Mon, Mar 1, 7:51 AM
Marostegui added a subtask: T276025: decommission db1088.eqiad.wmnet.
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL