Page MenuHomePhabricator
Create Task
Maniphest T376916

Upgrade backup hosts to Debian Bookworm 12.X
Closed, ResolvedPublic
Actions

Description

  • backupmon1001
  • backup hosts (progress-24/24 + 4/4 hosts to decom):
    • bacula director and storages (12/12)
    • hosts to decom (4/4)
    • media backup stores (12/12)
  • ms-backup (media backup workers)
  • dbprov hosts
  • db hosts:
    • backup sources
    • media backup databases

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
dbbackups: Update grants for x1 dump sections toooperations/puppetproduction+32 -34
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedjcrespoT376916 Upgrade backup hosts to Debian Bookworm 12.X
 ResolvedjcrespoT376921 Upgrade dbprov hosts to Debian Bookworm
 ResolvedjcrespoT362509 Setup new dbprov hosts and decommission the old ones
 ResolvedRequestPapaulT383871 decommission dbprov1001, dbprov1002
 ResolvedJhancock.wmT383894 decommission dbprov2001, dbprov2002
 ResolvedjcrespoT383902 Upgrade backup source or mediabackup database host os to Debian bookworm or decommission them
 ResolvedjcrespoT366092 Upgrade eqiad mediabackups database hosts to Debian Bookworm
 Resolved• MarosteguiT373579 Productionize db22[21-40]
 Resolved• MarosteguiT374951 find a viable replication source on codfw
DeclinedABran-WMFT374088 Switchover s4 master (db2140 -> db2179)
 ResolvedABran-WMFT372893 Testing environment for mysql cookbooks
 ResolvedABran-WMFT374086 Switchover s5 master (db2123 -> db2213)
 ResolvedLadsgroupT374087 Switchover s6 master (db2129 -> db2214)
 Resolved• MarosteguiT374623 Decommission db21[21-40]
 Resolved• MarosteguiT368874 Productionize dbproxy102[89]
 ResolvedRequestJclark-ctrT383025 decommission dbproxy1020.eqiad.wmnet
 ResolvedRequestJclark-ctrT383033 decommission dbproxy1021.eqiad.wmnet
 Resolved• MarosteguiT367380 Productionize dbproxy200[5-8]
 Resolved• MarosteguiT381962 Decommission dbproxy200[1-4]
 ResolvedRequestJhancock.wmT382867 decommission dbproxy2001.codfw.wmnet
 ResolvedRequestJhancock.wmT382868 decommission dbproxy2002.codfw.wmnet
 ResolvedRequestJhancock.wmT382875 decommission dbproxy2003.codfw.wmnet
 ResolvedRequestJhancock.wmT382877 decommission dbproxy2004.codfw.wmnet
 ResolvedRequestJhancock.wmT383388 decommission db2123.codfw.wmnet
 ResolvedRequestJhancock.wmT383395 decommission db2126.codfw.wmnet
 ResolvedRequestJhancock.wmT383426 decommission db2135.codfw.wmnet
 ResolvedRequestJhancock.wmT383572 decommission db2128.codfw.wmnet
 ResolvedRequestJhancock.wmT383697 decommission db2132.codfw.wmnet
 ResolvedRequestJhancock.wmT383766 decommission db2130.codfw.wmnet
 ResolvedJhancock.wmT383971 decommission db2139
 ResolvedRequestJhancock.wmT384001 decommission db2131.codfw.wmnet
 ResolvedRequestJhancock.wmT384343 decommission db2133.codfw.wmnet
 ResolvedRequestJhancock.wmT384476 decommission db2134.codfw.wmnet
 ResolvedRequestJhancock.wmT384479 decommission db2136.codfw.wmnet
 ResolvedRequestJhancock.wmT384480 decommission db2140.codfw.wmnet
 ResolvedABran-WMFT378503 mariadb::binlog_format: 'ROW' not effective on m5/db1175
 ResolvedjcrespoT387892 Decommission backup1001, backup1002, backup2001, backup2002 (and their arrays)
 ResolvedRequestJclark-ctrT398185 decommission backup1001 and its 2 disk arrays
 ResolvedRequestJhancock.wmT398188 decommission backup2001 and its 2 disk arrays
 ResolvedRequestJclark-ctrT398210 decommission backup1002 and its disk array
 ResolvedRequestJhancock.wmT398212 decommission backup2002 and its disk array

Event Timeline

jcrespo created this task.Oct 10 2024, 3:47 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 10 2024, 3:47 PM
jcrespo triaged this task as High priority.Oct 10 2024, 3:47 PM
jcrespo added a project: Epic.
jcrespo moved this task from Triage to In Progress on the Data-Persistence-Backup board.
jcrespo added a subtask: T366092: Upgrade eqiad mediabackups database hosts to Debian Bookworm.Oct 10 2024, 3:51 PM
jcrespo removed jcrespo as the assignee of this task.Nov 25 2024, 11:36 AM
jcrespo changed the status of subtask T376921: Upgrade dbprov hosts to Debian Bookworm from Open to In Progress.Jan 15 2025, 5:04 PM
jcrespo closed subtask T376921: Upgrade dbprov hosts to Debian Bookworm as Resolved.Jan 16 2025, 2:37 PM
jcrespo updated the task description. (Show Details)Jan 16 2025, 3:20 PM
jcrespo removed a subtask: T366092: Upgrade eqiad mediabackups database hosts to Debian Bookworm.Jan 16 2025, 3:55 PM
jcrespo changed the status of subtask T383902: Upgrade backup source or mediabackup database host os to Debian bookworm or decommission them from Open to In Progress.
jcrespo updated the task description. (Show Details)Feb 3 2025, 2:20 PM
gerritbot added a comment.Feb 3 2025, 4:12 PM

Change #1116831 had a related patch set uploaded (by Jcrespo; author: Jcrespo):

[operations/puppet@production] dbbackups: Update grants for x1 dump sections too

https://gerrit.wikimedia.org/r/1116831

gerritbot added a project: Patch-For-Review.Feb 3 2025, 4:12 PM
gerritbot added a comment.Feb 3 2025, 5:44 PM

Change #1116831 merged by Jcrespo:

[operations/puppet@production] dbbackups: Update grants for x1 dump sections too

https://gerrit.wikimedia.org/r/1116831

Maintenance_bot removed a project: Patch-For-Review.Feb 3 2025, 6:30 PM
jcrespo closed subtask T383902: Upgrade backup source or mediabackup database host os to Debian bookworm or decommission them as Resolved.Feb 4 2025, 1:15 PM
jcrespo changed the status of subtask T387892: Decommission backup1001, backup1002, backup2001, backup2002 (and their arrays) from Open to In Progress.Mar 4 2025, 4:47 PM
ops-monitoring-bot added a comment.Jun 13 2025, 9:12 AM

Icinga downtime and Alertmanager silence (ID=493da83e-0408-4bfd-a460-3d2a2aaad3bf) set by jynus@cumin1002 for 4:00:00 on 1 host(s) and their services with reason: Maintenance and reboot

ms-backup1002.eqiad.wmnet
ops-monitoring-bot added a comment.Jun 13 2025, 9:47 AM

Icinga downtime and Alertmanager silence (ID=ed206b65-dd8a-4f4d-a989-e6a86b3d3887) set by jynus@cumin1002 for 4:00:00 on 1 host(s) and their services with reason: Maintenance and reboot

ms-backup1001.eqiad.wmnet
ops-monitoring-bot added a comment.Jun 16 2025, 11:14 AM

Icinga downtime and Alertmanager silence (ID=10f40619-3a56-4e29-a8da-746731dbd212) set by jynus@cumin1002 for 4:00:00 on 1 host(s) and their services with reason: Maintenance and reboot

ms-backup2002.codfw.wmnet
ops-monitoring-bot added a comment.Jun 16 2025, 1:52 PM

Icinga downtime and Alertmanager silence (ID=df680574-af14-4955-9937-5d1914444d22) set by jynus@cumin1002 for 4:00:00 on 1 host(s) and their services with reason: Maintenance and reboot

ms-backup2001.codfw.wmnet
ops-monitoring-bot added a comment.Jun 17 2025, 3:28 PM

Icinga downtime and Alertmanager silence (ID=845754b0-673b-41d7-8126-96470a2c0d2e) set by jynus@cumin1002 for 4:00:00 on 1 host(s) and their services with reason: Maintenance and reboot

ms-backup2001.codfw.wmnet
jcrespo updated the task description. (Show Details)Jun 17 2025, 4:26 PM

ms-backup hosts done.

ops-monitoring-bot added a comment.Jun 20 2025, 9:24 AM

Icinga downtime and Alertmanager silence (ID=e7cc4f24-75a7-400a-acc8-ff707cd469d0) set by jynus@cumin1002 for 4:00:00 on 1 host(s) and their services with reason: Maintenance and reboot

backup2009.codfw.wmnet
jcrespo updated the task description. (Show Details)Jun 20 2025, 9:58 AM
jcrespo updated the task description. (Show Details)
jcrespo added a comment.Jun 20 2025, 10:01 AM

backup2009 upgraded, 11/24 backup hosts have been upgraded; plus 4 will be decommed soon (T387892).

I just added to the list backupmon1001, a VM that also has to be upgraded.

ops-monitoring-bot added a comment.Jun 25 2025, 9:53 AM

Icinga downtime and Alertmanager silence (ID=010e024e-fe7e-4445-b38a-8c2cadcb50bd) set by jynus@cumin1002 for 4:00:00 on 1 host(s) and their services with reason: Maintenance and reboot

backup2008.codfw.wmnet
ops-monitoring-bot added a comment.Jun 25 2025, 11:38 AM

Icinga downtime and Alertmanager silence (ID=d145ffe3-8ff7-43a5-8fce-e6e5cd963182) set by jynus@cumin1002 for 4:00:00 on 1 host(s) and their services with reason: Maintenance and reboot

backup1008.eqiad.wmnet
jcrespo added a comment.Jun 25 2025, 12:53 PM

backup1008 and backup2008 upgraded, too.

ops-monitoring-bot added a comment.Jun 26 2025, 7:43 AM

Icinga downtime and Alertmanager silence (ID=3109da04-78e8-461e-89f2-1f353f539daf) set by jynus@cumin1002 for 4:00:00 on 1 host(s) and their services with reason: Maintenance and reboot

backup1009.eqiad.wmnet
jcrespo added a comment.Jun 26 2025, 8:06 AM

With the upgrade of backup1009, all non-media backup hosts have been upgraded, with the exception of those about to be decommissioned and backup[12]003, which is in active use. That will be upgraded as soon as the es ro backups finish.

jcrespo updated the task description. (Show Details)Jun 26 2025, 8:10 AM
ops-monitoring-bot added a comment.Jun 30 2025, 10:11 AM

Icinga downtime and Alertmanager silence (ID=580ea459-b022-41a0-b2e3-f26f38703675) set by jynus@cumin1003 for 4:00:00 on 1 host(s) and their services with reason: Maintenance and reboot

backup1003.eqiad.wmnet
jcrespo updated the task description. (Show Details)Jun 30 2025, 10:38 AM

backup1003 done, only backup2003 pending, which has to wait the ongoing es-rw backups from backup1013.

ops-monitoring-bot added a comment.Jun 30 2025, 2:19 PM

Icinga downtime and Alertmanager silence (ID=a969525e-9eb7-4582-8ae8-17b8cdd5058c) set by jynus@cumin1003 for 4:00:00 on 1 host(s) and their services with reason: Maintenance and reboot

backup2003.codfw.wmnet
jcrespo updated the task description. (Show Details)Jun 30 2025, 3:10 PM

backup2003 done, only media backup hosts pending to upgrade.

ops-monitoring-bot added a comment.Jul 1 2025, 7:43 AM

Icinga downtime and Alertmanager silence (ID=08772b21-3872-44e8-8f06-e23fa995033c) set by jynus@cumin1002 for 4:00:00 on 1 host(s) and their services with reason: Maintenance and reboot

backup2004.codfw.wmnet
ops-monitoring-bot added a comment.Jul 1 2025, 8:44 AM

Icinga downtime and Alertmanager silence (ID=0f261daa-cd8e-4444-a4ad-982760deb79e) set by jynus@cumin1002 for 4:00:00 on 1 host(s) and their services with reason: Maintenance and reboot

backup2005.codfw.wmnet
ops-monitoring-bot added a comment.Jul 1 2025, 9:21 AM

Icinga downtime and Alertmanager silence (ID=3c23cb22-fc3e-4ca0-8dea-8708e9402a3f) set by jynus@cumin1002 for 4:00:00 on 1 host(s) and their services with reason: Maintenance and reboot

backup2006.codfw.wmnet
ops-monitoring-bot added a comment.Jul 1 2025, 9:59 AM

Icinga downtime and Alertmanager silence (ID=80a33647-b307-4563-8fc8-c5bea57096ab) set by jynus@cumin1002 for 4:00:00 on 1 host(s) and their services with reason: Maintenance and reboot

backup2007.codfw.wmnet
jcrespo updated the task description. (Show Details)Jul 1 2025, 10:48 AM
jcrespo closed subtask T387892: Decommission backup1001, backup1002, backup2001, backup2002 (and their arrays) as Resolved.Jul 2 2025, 10:13 AM
jcrespo updated the task description. (Show Details)
ops-monitoring-bot added a comment.Jul 3 2025, 9:21 AM

Icinga downtime and Alertmanager silence (ID=193b6e89-71e3-4f46-b0a6-d7a0247c1152) set by jynus@cumin1002 for 4:00:00 on 1 host(s) and their services with reason: Maintenance and reboot

backup1004.eqiad.wmnet
ops-monitoring-bot added a comment.Jul 3 2025, 10:23 AM

Icinga downtime and Alertmanager silence (ID=6e1853f2-65a8-4259-a21a-b7d8a7f2ad94) set by jynus@cumin1002 for 4:00:00 on 1 host(s) and their services with reason: Maintenance and reboot

backup1005.eqiad.wmnet
jcrespo updated the task description. (Show Details)Jul 3 2025, 11:35 AM
jcrespo updated the task description. (Show Details)
ops-monitoring-bot added a comment.Jul 3 2025, 2:08 PM

Icinga downtime and Alertmanager silence (ID=fe02c9a5-dd15-4b95-b6de-e1f5eeaa93e4) set by jynus@cumin1002 for 4:00:00 on 1 host(s) and their services with reason: Maintenance and reboot

backup1006.eqiad.wmnet
ops-monitoring-bot added a comment.Jul 3 2025, 2:09 PM

Icinga downtime and Alertmanager silence (ID=f2d97d5a-efbb-4ab4-b7fe-d7e0bc6f78fa) set by jynus@cumin1002 for 4:00:00 on 1 host(s) and their services with reason: Maintenance and reboot

backup1007.eqiad.wmnet
jcrespo updated the task description. (Show Details)Jul 3 2025, 2:57 PM
ops-monitoring-bot added a comment.Jul 4 2025, 9:07 AM

Icinga downtime and Alertmanager silence (ID=060a436e-1017-4cc9-a834-e14a0867ca51) set by jynus@cumin1002 for 4:00:00 on 1 host(s) and their services with reason: Maintenance and reboot

backupmon1001.eqiad.wmnet
jcrespo updated the task description. (Show Details)Jul 4 2025, 10:00 AM
jcrespo closed this task as Resolved.Jul 4 2025, 10:07 AM
jcrespo claimed this task.

This is now done, all active backup-related hosts are on Debian 12 "Bookworm":

root@cumin1003:~$ cumin -o txt A:backup 'cat /etc/debian_version; uname -a'
34 hosts will be targeted:
backup[2003-2011,2013].codfw.wmnet,backup[1003-1011,1013-1014].eqiad.wmnet,backupmon1001.eqiad.wmnet,dbprov[2003-2006].codfw.wmnet,dbprov[1003-1006].eqiad.wmnet,ms-backup[2001-2002].codfw.wmnet,ms-backup[1001-1002].eqiad.wmnet
OK to proceed on 34 hosts? Enter the number of affected hosts to confirm or "q" to quit: 34
PASS |██████████████████████████████████████████████████████████████████████████████████████████████████████| 100% (34/34) [00:01<00:00, 28.78hosts/s]
FAIL |                                                                                                               |   0% (0/34) [00:01<?, ?hosts/s]
100.0% (34/34) success ratio (>= 100.0% threshold) for command: 'cat /etc/debian_version; uname -a'.
100.0% (34/34) success ratio (>= 100.0% threshold) of nodes successfully executed all commands.
_____FORMATTED_OUTPUT_____
backup1003.eqiad.wmnet: 12.11
backup1003.eqiad.wmnet: Linux backup1003 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
backup1004.eqiad.wmnet: 12.11
backup1004.eqiad.wmnet: Linux backup1004 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
backup1005.eqiad.wmnet: 12.11
backup1005.eqiad.wmnet: Linux backup1005 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
backup1006.eqiad.wmnet: 12.11
backup1006.eqiad.wmnet: Linux backup1006 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
backup1007.eqiad.wmnet: 12.11
backup1007.eqiad.wmnet: Linux backup1007 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
backup1008.eqiad.wmnet: 12.11
backup1008.eqiad.wmnet: Linux backup1008 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
backup1009.eqiad.wmnet: 12.11
backup1009.eqiad.wmnet: Linux backup1009 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
backup1010.eqiad.wmnet: 12.11
backup1010.eqiad.wmnet: Linux backup1010 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
backup1011.eqiad.wmnet: 12.11
backup1011.eqiad.wmnet: Linux backup1011 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
backup1013.eqiad.wmnet: 12.11
backup1013.eqiad.wmnet: Linux backup1013 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
backup1014.eqiad.wmnet: 12.11
backup1014.eqiad.wmnet: Linux backup1014 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
backup2003.codfw.wmnet: 12.11
backup2003.codfw.wmnet: Linux backup2003 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
backup2004.codfw.wmnet: 12.11
backup2004.codfw.wmnet: Linux backup2004 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
backup2005.codfw.wmnet: 12.11
backup2005.codfw.wmnet: Linux backup2005 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
backup2006.codfw.wmnet: 12.11
backup2006.codfw.wmnet: Linux backup2006 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
backup2007.codfw.wmnet: 12.11
backup2007.codfw.wmnet: Linux backup2007 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
backup2008.codfw.wmnet: 12.11
backup2008.codfw.wmnet: Linux backup2008 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
backup2009.codfw.wmnet: 12.11
backup2009.codfw.wmnet: Linux backup2009 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
backup2010.codfw.wmnet: 12.11
backup2010.codfw.wmnet: Linux backup2010 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
backup2011.codfw.wmnet: 12.11
backup2011.codfw.wmnet: Linux backup2011 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
backup2013.codfw.wmnet: 12.11
backup2013.codfw.wmnet: Linux backup2013 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
backupmon1001.eqiad.wmnet: 12.11
backupmon1001.eqiad.wmnet: Linux backupmon1001 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
dbprov1003.eqiad.wmnet: 12.11
dbprov1003.eqiad.wmnet: Linux dbprov1003 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
dbprov1004.eqiad.wmnet: 12.11
dbprov1004.eqiad.wmnet: Linux dbprov1004 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
dbprov1005.eqiad.wmnet: 12.11
dbprov1005.eqiad.wmnet: Linux dbprov1005 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
dbprov1006.eqiad.wmnet: 12.11
dbprov1006.eqiad.wmnet: Linux dbprov1006 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
dbprov2003.codfw.wmnet: 12.11
dbprov2003.codfw.wmnet: Linux dbprov2003 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
dbprov2004.codfw.wmnet: 12.11
dbprov2004.codfw.wmnet: Linux dbprov2004 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
dbprov2005.codfw.wmnet: 12.11
dbprov2005.codfw.wmnet: Linux dbprov2005 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
dbprov2006.codfw.wmnet: 12.11
dbprov2006.codfw.wmnet: Linux dbprov2006 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
ms-backup1001.eqiad.wmnet: 12.11
ms-backup1001.eqiad.wmnet: Linux ms-backup1001 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
ms-backup1002.eqiad.wmnet: 12.11
ms-backup1002.eqiad.wmnet: Linux ms-backup1002 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
ms-backup2001.codfw.wmnet: 12.11
ms-backup2001.codfw.wmnet: Linux ms-backup2001 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
ms-backup2002.codfw.wmnet: 12.11
ms-backup2002.codfw.wmnet: Linux ms-backup2002 6.1.0-37-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.140-1 (2025-05-22) x86_64 GNU/Linux
root@cumin1003:~$ cumin -o txt A:db-backup-source 'cat /etc/debian_version'
14 hosts will be targeted:
db[2141,2197-2201,2239].codfw.wmnet,db[1150,1171,1216,1225,1239-1240,1245].eqiad.wmnet
OK to proceed on 14 hosts? Enter the number of affected hosts to confirm or "q" to quit: 14
PASS |██████████████████████████████████████████████████████████████████████████████████████████████████████| 100% (14/14) [00:01<00:00, 13.83hosts/s]
FAIL |                                                                                                               |   0% (0/14) [00:01<?, ?hosts/s]
100.0% (14/14) success ratio (>= 100.0% threshold) for command: 'cat /etc/debian_version'.
100.0% (14/14) success ratio (>= 100.0% threshold) of nodes successfully executed all commands.
_____FORMATTED_OUTPUT_____
db1150.eqiad.wmnet: 12.10
db1171.eqiad.wmnet: 12.10
db1216.eqiad.wmnet: 12.11
db1225.eqiad.wmnet: 12.11
db1239.eqiad.wmnet: 12.10
db1240.eqiad.wmnet: 12.10
db1245.eqiad.wmnet: 12.10
db2141.codfw.wmnet: 12.10
db2197.codfw.wmnet: 12.11
db2198.codfw.wmnet: 12.10
db2199.codfw.wmnet: 12.10
db2200.codfw.wmnet: 12.11
db2201.codfw.wmnet: 12.10
db2239.codfw.wmnet: 12.10
jcrespo mentioned this in T394371: Migrate to MariaDB 10.11.Oct 16 2025, 8:13 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits