Page MenuHomePhabricator
Create Task
Maniphest T361237

[infra] Upgrade Toolforge K8s etcd nodes to Bookworm
Closed, ResolvedPublic
Actions

Description

Upgrade K8s etcd. Please also document this process at https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes#Upgrade_etcd.

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
toolforge etcdctl: update handling of 'member list' outputoperations/software/spicerackmaster+92 -96
toolforge etcdctl: update cert flag namesoperations/software/spicerackmaster+8 -6
Customize query in gerrit

Related Objects
Search...

Event Timeline

taavi created this task.Mar 28 2024, 2:30 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 28 2024, 2:30 PM
taavi added a subtask: T349207: [infra] Upgrade Toolforge K8s etcd nodes to Bullseye.Mar 28 2024, 2:30 PM
Andrew closed subtask T349207: [infra] Upgrade Toolforge K8s etcd nodes to Bullseye as Resolved.Apr 12 2024, 4:03 PM
• joanna_borun triaged this task as Medium priority.Aug 21 2024, 2:30 PM
Raymond_Ndibe added a project: User-Raymond_Ndibe.Aug 21 2024, 2:38 PM
Raymond_Ndibe subscribed.
taavi added a parent task: T387005: [infra] Toolforge: migrate to Debian Bookworm or later.Feb 21 2025, 10:24 AM
fnegri raised the priority of this task from Medium to High.Mar 10 2025, 3:30 PM
fnegri subscribed.

This will upgrade etcd from 3.3.25 to 3.4.23, which is inside the range currently approved by Kubernetes.

taavi updated the task description. (Show Details)Oct 22 2025, 4:15 PM
Andrew subscribed.Dec 4 2025, 3:40 PM

I'm partway into this process but everyone is about to travel so I'm rolling things back to Bullseye everywhere.

Stashbot added a comment.Dec 4 2025, 3:41 PM

Mentioned in SAL (#wikimedia-cloud) [2025-12-04T15:41:07Z] <andrewbogott> deleting toolsbeta-test-k8s-etcd-27 and replacing with a Bullseye node for cluster consistency T361237

Stashbot added a comment.Dec 4 2025, 3:42 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2025-12-04T15:42:09Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.etcd.depool_and_remove_node (T361237)

Stashbot added a comment.Dec 4 2025, 5:13 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2025-12-04T17:13:32Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.etcd.depool_and_remove_node (T361237)

Stashbot added a comment.Dec 4 2025, 6:36 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2025-12-04T18:36:27Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.etcd.depool_and_remove_node (T361237)

Stashbot added a comment.Dec 4 2025, 6:45 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2025-12-04T18:45:49Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.etcd.depool_and_remove_node (T361237)

Stashbot added a comment.Dec 4 2025, 7:06 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2025-12-04T19:06:45Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.etcd.depool_and_remove_node (T361237)

Stashbot added a comment.Dec 4 2025, 7:28 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2025-12-04T19:28:34Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.etcd.depool_and_remove_node (T361237)

Stashbot added a comment.Dec 4 2025, 7:56 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2025-12-04T19:56:53Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.etcd.depool_and_remove_node (T361237)

Stashbot added a comment.Dec 4 2025, 8:03 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2025-12-04T20:03:36Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.etcd.depool_and_remove_node (T361237)

Stashbot added a comment.Dec 4 2025, 8:45 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2025-12-04T20:45:49Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.etcd.depool_and_remove_node (T361237)

Stashbot added a comment.Dec 4 2025, 9:02 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2025-12-04T21:02:51Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.etcd.depool_and_remove_node (T361237)

dcaro assigned this task to Andrew.Mar 3 2026, 3:44 PM
dcaro edited projects, added Toolforge (Toolforge iteration 25); removed Toolforge.
dcaro edited projects, added Toolforge (Toolforge iteration 26); removed Toolforge (Toolforge iteration 25).Mar 5 2026, 9:36 AM
gerritbot added a comment.Mar 5 2026, 2:29 PM

Change #1248027 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/software/spicerack@master] toolforge etcdctl: update cert flag names

https://gerrit.wikimedia.org/r/1248027

gerritbot added a project: Patch-For-Review.Mar 5 2026, 2:29 PM

Change #1248047 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/software/spicerack@master] toolforge etcd: update handling of 'member list' output

https://gerrit.wikimedia.org/r/1248047

gerritbot added a comment.Thu, Mar 26, 12:44 PM

Change #1248027 merged by jenkins-bot:

[operations/software/spicerack@master] toolforge etcdctl: update cert flag names

https://gerrit.wikimedia.org/r/1248027

gerritbot added a comment.Thu, Mar 26, 12:45 PM

Change #1248047 merged by jenkins-bot:

[operations/software/spicerack@master] toolforge etcdctl: update handling of 'member list' output

https://gerrit.wikimedia.org/r/1248047

Maintenance_bot removed a project: Patch-For-Review.Thu, Mar 26, 1:32 PM
Stashbot added a comment.Tue, Apr 7, 2:46 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2026-04-07T14:46:38Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.add_k8s_etcd_node (T361237)

Stashbot added a comment.Tue, Apr 7, 4:02 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2026-04-07T16:02:48Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.add_k8s_etcd_node (T361237)

Stashbot added a comment.Tue, Apr 7, 4:31 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2026-04-07T16:31:14Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_etcd_node (T361237)

Stashbot added a comment.Tue, Apr 7, 4:50 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2026-04-07T16:50:45Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_etcd_node (T361237)

Stashbot added a comment.Tue, Apr 7, 4:57 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2026-04-07T16:57:21Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_etcd_node (T361237)

Stashbot added a comment.Tue, Apr 7, 4:59 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2026-04-07T16:59:01Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_etcd_node (T361237)

Stashbot added a comment.Tue, Apr 7, 4:59 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2026-04-07T16:59:23Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_etcd_node (T361237)

Stashbot added a comment.Tue, Apr 7, 5:01 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2026-04-07T17:01:23Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_etcd_node (T361237)

Stashbot added a comment.Tue, Apr 7, 5:02 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2026-04-07T17:02:44Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_etcd_node (T361237)

Stashbot added a comment.Tue, Apr 7, 5:04 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2026-04-07T17:04:13Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_etcd_node (T361237)

Stashbot added a comment.Tue, Apr 7, 5:20 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2026-04-07T17:20:31Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_etcd_node (T361237)

Stashbot added a comment.Tue, Apr 7, 5:41 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2026-04-07T17:41:48Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_etcd_node (T361237)

Stashbot added a comment.Tue, Apr 7, 5:53 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2026-04-07T17:53:41Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_etcd_node (T361237)

Stashbot added a comment.Tue, Apr 7, 6:07 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2026-04-07T18:07:48Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.add_k8s_etcd_node (T361237)

Stashbot added a comment.Tue, Apr 7, 6:31 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2026-04-07T18:31:06Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_etcd_node (T361237)

Stashbot added a comment.Tue, Apr 7, 6:47 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2026-04-07T18:47:30Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_etcd_node (T361237)

Stashbot added a comment.Tue, Apr 7, 7:00 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2026-04-07T19:00:22Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_etcd_node (T361237)

Stashbot added a comment.Tue, Apr 7, 7:09 PM

Mentioned in SAL (#wikimedia-cloud-feed) [2026-04-07T19:09:53Z] <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_etcd_node (T361237)

Andrew closed this task as Resolved.Tue, Apr 7, 8:40 PM
dcaro moved this task from Next Up to Done on the Toolforge (Toolforge iteration 26) board.Wed, Apr 8, 2:58 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits