Maniphest T372697

[infra,k8s] Upgrade Toolforge Kubernetes to version 1.31
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	taavi
	Aug 17 2024, 5:51 AM

Tags

Referenced Files

None

Subscribers

Description

https://kubernetes.io/blog/2024/08/13/kubernetes-v1-31-release/

Workgroup page: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Upgrade_Workgroup/Upgrades_Overview

Upgrade procedure: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes

Refer to the link above for the detailed procedure, and update the checkboxes as you complete them.

Before upgrading

Check Kubernetes changelog
~~Announce user-facing changes~~
Prepare the new APT packages
Upgrade Toolforge components
Test new k8s version in lima-kilo

Upgrade toolsbeta cluster

T413796: Upgrade toolsbeta cluster to Kubernetes 1.31

Upgrade tools cluster

T413797: Upgrade tools cluster to Kubernetes 1.31

After upgrading

Upgrade lima-kilo
Upgrade Toolforge components (optional)

Details

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	aptrepo: Drop packages for Kubeadm/1.30	operations/puppet	production	+1 -13
	aptrepo: Import Kubeadm/1.31 packages	operations/puppet	production	+13 -1

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		None	T414596 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.35
		Open		None	T414595 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.34
		Open		None	T408785 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.33
		Open		fnegri	T379047 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.32
		Resolved		taavi	T372697 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.31
		Resolved		dcaro	T362869 [k8s,infra] Upgrade Toolforge to Uwubernetes (1.30)
		Resolved		fnegri	T362868 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.29
		Resolved		Slst2020	T373866 [infra, k8s, webservice] remove deprecated kubectl --wait flag before k8s 1.29 upgrade
		Resolved		fnegri	T388797 Some toolforge components are running an old version
		Resolved		fnegri	T390212 Upgrade "toolsbeta" cluster to k8s 1.29.15
		Resolved		fnegri	T390214 Upgrade "tools" cluster to k8s 1.29.15
		Resolved		dcaro	T394787 [kyverno] Upgrade to `3.3.9` chart (`1.13` app) for k8s 1.30 support
		Resolved		dcaro	T401681 [kyverno] policy countres stopped showing correctly in grafana
		Resolved		dcaro	T401684 [kyverno] upgrade to 3.3.9 in tools failed leaving a half-upgraded system
		Resolved		dcaro	T402377 [k8s,infra] Upgrade toolsbeta to Uwubernetes 1.30
		Resolved		dcaro	T402378 [k8s,infra] Upgrade tools to Uwubernetes 1.30
		Resolved		taavi	T383516 [infra,k8s] Upgrade ingress-nginx to v1.12.1+
		Resolved	BUG REPORT	• bd808	T408570 IW ingress config does not work with nginx-ingress-controller:v1.13.3
		Open	BUG REPORT	None	T409493 Toolforge interwiki link handling no longer strips URL-encoding before redirecting when it previously did, breaking existing on-wiki links
		Resolved		taavi	T409474 Reduce tool breakage over new ingress-nginx annotation validation rules
		Resolved		taavi	T408669 Upgrade Calico to 3.29
		Resolved		taavi	T413796 Upgrade toolsbeta cluster to Kubernetes 1.31
		Resolved		taavi	T413797 Upgrade tools cluster to Kubernetes 1.31

Event Timeline

taavi created this task.Aug 17 2024, 5:51 AM

Restricted Application edited subscribers, added: Aklapper; removed: taavi. · View Herald TranscriptAug 17 2024, 5:51 AM

taavi added a subtask: T362869: [k8s,infra] Upgrade Toolforge to Uwubernetes (1.30).Aug 17 2024, 5:51 AM

Slst2020 claimed this task.Sep 3 2024, 12:07 PM

Slst2020 updated the task description. (Show Details)

dcaro triaged this task as High priority.Nov 5 2024, 9:14 AM

Restricted Application added a project: cloud-services-team. · View Herald TranscriptNov 5 2024, 9:14 AM

dcaro moved this task from Backlog to Ready to be worked on on the Toolforge board.Nov 5 2024, 9:16 AM

taavi added a parent task: T379047: [infra,k8s] Upgrade Toolforge Kubernetes to version 1.32.Jan 12 2025, 10:25 AM

Slst2020 removed Slst2020 as the assignee of this task.Jan 13 2025, 7:54 AM

Slst2020 subscribed.

dcaro changed the status of subtask T362869: [k8s,infra] Upgrade Toolforge to Uwubernetes (1.30) from Open to In Progress.May 7 2025, 12:13 PM

dcaro closed subtask T362869: [k8s,infra] Upgrade Toolforge to Uwubernetes (1.30) as Resolved.Sep 18 2025, 1:44 PM

akosiaris subscribed.Sep 22 2025, 2:24 PM

taavi updated the task description. (Show Details)Oct 22 2025, 3:40 PM

taavi closed subtask T383516: [infra,k8s] Upgrade ingress-nginx to v1.12.1+ as Resolved.Oct 28 2025, 9:37 AM

taavi claimed this task.Oct 28 2025, 9:41 AM

Change #1199241 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] aptrepo: Import Kubeadm/1.31 packages

https://gerrit.wikimedia.org/r/1199241

gerritbot added a project: Patch-For-Review.Oct 28 2025, 9:41 AM

taavi reopened subtask T383516: [infra,k8s] Upgrade ingress-nginx to v1.12.1+ as Open.Oct 28 2025, 2:38 PM

taavi closed subtask T408669: Upgrade Calico to 3.29 as Resolved.Oct 29 2025, 5:00 PM

Change #1199241 merged by Majavah:

[operations/puppet@production] aptrepo: Import Kubeadm/1.31 packages

https://gerrit.wikimedia.org/r/1199241

taavi updated the task description. (Show Details)Oct 30 2025, 9:55 AM

Maintenance_bot removed a project: Patch-For-Review.Oct 30 2025, 10:31 AM

taavi closed subtask T383516: [infra,k8s] Upgrade ingress-nginx to v1.12.1+ as Resolved.Nov 19 2025, 12:05 PM

taavi opened https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/302

kind: Update Kubernetes to 1.31

taavi updated the task description. (Show Details)Jan 5 2026, 4:33 PM

taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/302

kind: Update Kubernetes to 1.31

taavi created subtask T413796: Upgrade toolsbeta cluster to Kubernetes 1.31.Jan 5 2026, 5:12 PM

taavi created subtask T413797: Upgrade tools cluster to Kubernetes 1.31.

Maintenance_bot removed a project: Patch-For-Review.Jan 5 2026, 5:30 PM

taavi closed subtask T413796: Upgrade toolsbeta cluster to Kubernetes 1.31 as Resolved.Jan 6 2026, 1:49 PM

taavi updated the task description. (Show Details)

fnegri moved this task from Inbox to FY2025/2026-Q3-Q4 on the cloud-services-team board.Jan 13 2026, 5:58 PM

fnegri edited projects, added cloud-services-team (FY2025/2026-Q3-Q4); removed cloud-services-team.

taavi closed this task as Resolved.Jan 14 2026, 3:33 PM

taavi closed subtask T413797: Upgrade tools cluster to Kubernetes 1.31 as Resolved.

taavi updated the task description. (Show Details)

Change #1226878 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] aptrepo: Drop packages for Kubeadm/1.30

https://gerrit.wikimedia.org/r/1226878

gerritbot added a project: Patch-For-Review.Jan 14 2026, 3:45 PM

fnegri moved this task from Backlog to Done on the cloud-services-team (FY2025/2026-Q3-Q4) board.Jan 19 2026, 4:13 PM

Change #1226878 merged by Majavah:

[operations/puppet@production] aptrepo: Drop packages for Kubeadm/1.30

https://gerrit.wikimedia.org/r/1226878

Maintenance_bot removed a project: Patch-For-Review.Feb 4 2026, 10:31 PM