| jcrespo | |
| Mar 4 2025, 4:46 PM |
| F58618382: image.png | |
| Mar 6 2025, 10:16 AM |
Rather than upgrading these hosts, we will decommission by setting up different hosts and upgrade those (or set them up already upgraded for the first time):
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T376916 Upgrade backup hosts to Debian Bookworm 12.X | |||
| In Progress | jcrespo | T387892 Decommission backup1001, backup1002, backup2001, backup2002 (and their arrays) |
Change #1124487 had a related patch set uploaded (by Jcrespo; author: Jcrespo):
[operations/puppet@production] dbbackups: Prepare backup1013 to take over eqiad backups of es* dbs
Change #1124487 merged by Jcrespo:
[operations/puppet@production] dbbackups: Prepare backup1013 to take over eqiad backups of es* dbs
Change #1124720 had a related patch set uploaded (by Jcrespo; author: Jcrespo):
[operations/puppet@production] dbbackups: Prepare backup2013 to take over codfw backups of es* dbs
Change #1124720 merged by Jcrespo:
[operations/puppet@production] dbbackups: Prepare backup2013 to take over codfw backups of es* dbs
Mentioned in SAL (#wikimedia-operations) [2025-03-05T09:18:53Z] <jynus> deploy new backup grants for es1036,es1040 T387892
Mentioned in SAL (#wikimedia-operations) [2025-03-05T09:23:07Z] <jynus> deploy new backup grants for es2036,es2040 T387892
Change #1124738 had a related patch set uploaded (by Jcrespo; author: Jcrespo):
[operations/puppet@production] dbbackups: Migrate es backups from backup[12]02 to backup[12]13
Change #1124738 merged by Jcrespo:
[operations/puppet@production] dbbackups: Migrate es backups from backup[12]02 to backup[12]13
Mentioned in SAL (#wikimedia-operations) [2025-03-05T15:40:35Z] <jynus> starting es backups on new hosts backup1013, backup2013 T387892
I made a mistake, and it was that I didn't add the new hosts into the production grants of m1 (for backup state tracking). No fatal issue (metadata gathering is optional and won't be a hard failure), but it will mean we will have to fix that tomorrow and test it again.
Change #1124834 had a related patch set uploaded (by Jcrespo; author: Jcrespo):
[operations/puppet@production] dbbackups: Add additional m1 grants for backup[12]013 stats user
Mentioned in SAL (#wikimedia-operations) [2025-03-06T09:28:35Z] <jynus> deploy additional grants to m1 T387892
Change #1124834 merged by Jcrespo:
[operations/puppet@production] dbbackups: Add additional m1 grants for backup[12]013 stats user
Change #1125114 had a related patch set uploaded (by Jcrespo; author: Jcrespo):
[operations/puppet@production] dbbackups: Prepare backup1002, backup2002 for decommissioning
Mentioned in SAL (#wikimedia-operations) [2025-03-12T10:14:28Z] <jynus> removing backup1002, backup2002 dump user on es6,es7 T387892
Mentioned in SAL (#wikimedia-operations) [2025-03-12T10:42:21Z] <jynus> removing backup1002, backup2002 dbbackups user @ m1 T387892
Change #1125114 merged by Jcrespo:
[operations/puppet@production] dbbackups: Prepare backup1002, backup2002 for decommissioning
