Page MenuHomePhabricator
Create Task
Maniphest T326683

Decommission db1106-db1125
Closed, ResolvedPublic
Actions

Description

db1206-db1225 are host that will refresh db1106-db1125 (T319443 T325209)

We need to decommission the following hosts once the above have been productionized (T326669)

Details

SubjectRepoBranchLines +/-
instances.yaml: Remove db1118 from dbctloperations/puppetproduction+0 -1
db1110: Disable notificationsoperations/puppetproduction+1 -0
site.pp: Add db1213 to s5 and s6operations/puppetproduction+3 -3
db1109: Disable notificationsoperations/puppetproduction+2 -2
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
Unknown Object (Task)
 ResolvedPapaulT326661 Q3:rack/setup/install db1207-db1225
 ResolvedMarosteguiT326669 Productionize db1206-db1225
 ResolvedMarosteguiT326683 Decommission db1106-db1125
 ResolvedRequestVRiley-WMFT327616 decommission db1106.eqiad.wmnet
 ResolvedRequestVRiley-WMFT334388 decommission db1124.eqiad.wmnet
 ResolvedRequestJclark-ctrT334447 decommission db1107.eqiad.wmnet
 ResolvedMarosteguiT334455 Failover all db1115 services to db1215
 ResolvedMarosteguiT335014 Switchover db1115 -> db1215
 ResolvedLadsgroupT336166 Tests failing for wmfmariadbpy/cli_admin/switchover.py
 ResolvedLadsgroupT336174 Release a new version of wmfmariadbpy
ResolvedLadsgroupT336240 Tests failing for wmfdb/cli_admin/db_mysql.py
 ResolvedRequestJclark-ctrT334580 decommission db1120.eqiad.wmnet
 ResolvedRequestJclark-ctrT334820 decommission db1109.eqiad.wmnet
 ResolvedRequestJclark-ctrT334910 decommission db1123.eqiad.wmnet
 ResolvedRequestJclark-ctrT334926 decommission db1116
 ResolvedRequestJclark-ctrT335011 decommission db1110.eqiad.wmnet
 ResolvedRequestJclark-ctrT335017 decommission db1117.eqiad.wmnet
 ResolvedMarosteguiT335092 Move db1110 to m3
 ResolvedRequestJclark-ctrT335836 decommission db1111.eqiad.wmnet
 ResolvedRequestwiki_willyT335837 decommission db1114.eqiad.wmnet
 ResolvedRequestJclark-ctrT336029 decommission db1113.eqiad.wmnet
 ResolvedMarosteguiT336252 Failover s3 sanitarium master
 ResolvedRequestJclark-ctrT336253 decommission db1115.eqiad.wmnet
 ResolvedRequestJclark-ctrT336254 decommission db1108.eqiad.wmnet
 ResolvedRequestJclark-ctrT336332 decommission db1112.eqiad.wmnet
 ResolvedMarosteguiT336337 Failover s4 sanitarium master
 ResolvedRequestJclark-ctrT336725 decommission db1121.eqiad.wmnet
 ResolvedRequestJclark-ctrT336833 decommission db1122.eqiad.wmnet
 ResolvedRequestVRiley-WMFT337206 decommission db1119.eqiad.wmnet
 ResolvedRequestVRiley-WMFT356474 decommission db1118.eqiad.wmnet
 OpenRequestMarosteguiT357092 decommission db1125.eqiad.wmnet

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Maintenance_bot removed a project: Patch-For-Review.Apr 19 2023, 7:13 AM
gerritbot added a comment.Apr 19 2023, 7:18 AM

Change 909947 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] site.pp: Add db1213 to s5 and s6

https://gerrit.wikimedia.org/r/909947

gerritbot added a project: Patch-For-Review.Apr 19 2023, 7:18 AM
gerritbot added a comment.Apr 19 2023, 7:50 AM

Change 909947 merged by Marostegui:

[operations/puppet@production] site.pp: Add db1213 to s5 and s6

https://gerrit.wikimedia.org/r/909947

Maintenance_bot removed a project: Patch-For-Review.Apr 19 2023, 8:11 AM
Marostegui updated the task description. (Show Details)Apr 19 2023, 9:25 AM
Marostegui added a subtask: T335017: decommission db1117.eqiad.wmnet.
Jclark-ctr closed subtask T334447: decommission db1107.eqiad.wmnet as Resolved.Apr 20 2023, 3:14 PM
Jclark-ctr closed subtask T334926: decommission db1116 as Resolved.
Jclark-ctr closed subtask T334580: decommission db1120.eqiad.wmnet as Resolved.
Jclark-ctr closed subtask T334820: decommission db1109.eqiad.wmnet as Resolved.Apr 20 2023, 3:18 PM
Marostegui updated the task description. (Show Details)May 3 2023, 7:03 AM
Marostegui changed the status of subtask T335011: decommission db1110.eqiad.wmnet from Open to Stalled.May 3 2023, 7:43 AM
Marostegui updated the task description. (Show Details)May 3 2023, 8:43 AM
Marostegui added a subtask: T335836: decommission db1111.eqiad.wmnet.
Marostegui added a subtask: T335837: decommission db1114.eqiad.wmnet.May 3 2023, 8:46 AM
Marostegui updated the task description. (Show Details)
Marostegui closed subtask T335092: Move db1110 to m3 as Resolved.May 3 2023, 11:46 AM
Marostegui updated the task description. (Show Details)May 5 2023, 8:19 AM
Marostegui updated the task description. (Show Details)
Marostegui added a subtask: T336029: decommission db1113.eqiad.wmnet.May 5 2023, 8:21 AM
Marostegui updated the task description. (Show Details)
Jclark-ctr closed subtask T335837: decommission db1114.eqiad.wmnet as Resolved.May 5 2023, 5:56 PM
Jclark-ctr reopened subtask T335837: decommission db1114.eqiad.wmnet as Open.
Jclark-ctr closed subtask T335836: decommission db1111.eqiad.wmnet as Resolved.May 5 2023, 5:59 PM
Jclark-ctr closed subtask T335017: decommission db1117.eqiad.wmnet as Resolved.
Marostegui updated the task description. (Show Details)May 8 2023, 5:09 AM
Marostegui updated the task description. (Show Details)
Marostegui added a subtask: T336253: decommission db1115.eqiad.wmnet.May 9 2023, 11:44 AM
Marostegui updated the task description. (Show Details)
Marostegui added a subtask: T336254: decommission db1108.eqiad.wmnet.May 9 2023, 11:46 AM
Marostegui updated the task description. (Show Details)
Marostegui updated the task description. (Show Details)May 10 2023, 6:48 AM
Marostegui added a subtask: T336332: decommission db1112.eqiad.wmnet.
Marostegui closed subtask T336252: Failover s3 sanitarium master as Resolved.
Marostegui updated the task description. (Show Details)May 12 2023, 10:56 AM
Jclark-ctr closed subtask T335011: decommission db1110.eqiad.wmnet as Resolved.May 15 2023, 2:06 PM
Ladsgroup updated the task description. (Show Details)May 15 2023, 2:52 PM
Marostegui closed subtask T336337: Failover s4 sanitarium master as Resolved.May 16 2023, 5:49 AM
Marostegui updated the task description. (Show Details)
Marostegui added a subtask: T336725: decommission db1121.eqiad.wmnet.
Marostegui changed the status of subtask T336253: decommission db1115.eqiad.wmnet from Stalled to Open.May 17 2023, 5:50 AM
Marostegui updated the task description. (Show Details)
Marostegui added a subtask: T336833: decommission db1122.eqiad.wmnet.May 17 2023, 7:27 AM
Marostegui updated the task description. (Show Details)
Jclark-ctr closed subtask T336253: decommission db1115.eqiad.wmnet as Resolved.May 17 2023, 2:50 PM
Jclark-ctr closed subtask T334910: decommission db1123.eqiad.wmnet as Resolved.May 17 2023, 3:02 PM
Jclark-ctr closed subtask T335837: decommission db1114.eqiad.wmnet as Resolved.
Jclark-ctr closed subtask T336029: decommission db1113.eqiad.wmnet as Resolved.
Ladsgroup closed subtask T334455: Failover all db1115 services to db1215 as Resolved.May 17 2023, 6:28 PM
Ladsgroup updated the task description. (Show Details)May 17 2023, 7:03 PM
Jclark-ctr closed subtask T336332: decommission db1112.eqiad.wmnet as Resolved.May 18 2023, 6:44 PM
Marostegui updated the task description. (Show Details)May 22 2023, 6:42 AM
Marostegui updated the task description. (Show Details)May 22 2023, 6:46 AM
Marostegui added a subtask: T337206: decommission db1119.eqiad.wmnet.
Marostegui updated the task description. (Show Details)May 23 2023, 8:37 AM
Jclark-ctr closed subtask T336833: decommission db1122.eqiad.wmnet as Resolved.May 24 2023, 1:36 PM
Jclark-ctr closed subtask T336725: decommission db1121.eqiad.wmnet as Resolved.
Marostegui reopened subtask T335092: Move db1110 to m3 as Open.Jun 23 2023, 4:56 AM
gerritbot added a comment.Jun 26 2023, 6:19 AM

Change 932685 had a related patch set uploaded (by Marostegui; author: Marostegui):

[operations/puppet@production] instances.yaml: Remove db1118 from dbctl

https://gerrit.wikimedia.org/r/932685

gerritbot added a project: Patch-For-Review.Jun 26 2023, 6:19 AM

Change 932685 merged by Marostegui:

[operations/puppet@production] instances.yaml: Remove db1118 from dbctl

https://gerrit.wikimedia.org/r/932685

Stashbot added a comment.Jun 26 2023, 6:20 AM

Mentioned in SAL (#wikimedia-operations) [2023-06-26T06:20:37Z] <marostegui@cumin1001> dbctl commit (dc=all): 'Remove db1118 from dbctl T326683', diff saved to https://phabricator.wikimedia.org/P49477 and previous config saved to /var/cache/conftool/dbconfig/20230626-062036-marostegui.json

Maintenance_bot removed a project: Patch-For-Review.Jun 26 2023, 6:30 AM
Marostegui closed subtask T335092: Move db1110 to m3 as Resolved.Jun 26 2023, 7:01 AM
BTullis changed the status of subtask T336254: decommission db1108.eqiad.wmnet from Stalled to Open.Jul 19 2023, 4:53 PM
Jclark-ctr closed subtask T336254: decommission db1108.eqiad.wmnet as Resolved.Aug 23 2023, 2:07 PM
Marostegui updated the task description. (Show Details)Nov 7 2023, 3:57 PM
Marostegui added a comment.Nov 8 2023, 8:08 PM

Just removed db1108 from zarcillo as it was still erroring on grafana.

Marostegui updated the task description. (Show Details)Dec 7 2023, 7:03 AM
VRiley-WMF closed subtask T337206: decommission db1119.eqiad.wmnet as Resolved.Dec 12 2023, 3:50 PM
Marostegui changed the status of subtask T327616: decommission db1106.eqiad.wmnet from Stalled to Open.Feb 1 2024, 3:49 PM
Marostegui updated the task description. (Show Details)Feb 2 2024, 6:16 AM
Marostegui updated the task description. (Show Details)
Marostegui added a subtask: T356474: decommission db1118.eqiad.wmnet.
Marostegui changed the status of subtask T356474: decommission db1118.eqiad.wmnet from Open to Stalled.Feb 2 2024, 6:18 AM
VRiley-WMF closed subtask T327616: decommission db1106.eqiad.wmnet as Resolved.Feb 2 2024, 7:36 PM
Marostegui updated the task description. (Show Details)Feb 9 2024, 6:40 AM
Marostegui updated the task description. (Show Details)Feb 9 2024, 6:43 AM
Marostegui added a subtask: T357092: decommission db1125.eqiad.wmnet.
VRiley-WMF closed subtask T334388: decommission db1124.eqiad.wmnet as Resolved.Feb 9 2024, 6:25 PM
Marostegui changed the status of subtask T356474: decommission db1118.eqiad.wmnet from Stalled to Open.Mar 1 2024, 6:11 AM
Marostegui updated the task description. (Show Details)Mar 1 2024, 6:39 AM
VRiley-WMF closed subtask T356474: decommission db1118.eqiad.wmnet as Resolved.Mar 1 2024, 4:29 PM
Marostegui closed this task as Resolved.May 14 2024, 6:47 AM

Closing this as the only pending host has its own tracking task T357092

Maintenance_bot moved this task from In progress to Done on the DBA board.May 14 2024, 7:29 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits