Maniphest T408785

[infra,k8s] Upgrade Toolforge Kubernetes to version 1.33
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	taavi
	Oct 30 2025, 9:53 AM

Project Tags

Referenced Files

None

Subscribers

Description

https://kubernetes.io/blog/2025/04/23/kubernetes-v1-33-release/

Workgroup page: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Upgrade_Workgroup/Upgrades_Overview

Upgrade procedure: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes

Refer to the link above for the detailed procedure, and update the checkboxes as you complete them.

Before upgrading

Check Kubernetes changelog
Announce user-facing changes
Prepare the new APT packages
Upgrade Toolforge components
Test new k8s version in lima-kilo

Upgrade toolsbeta cluster

T433131: Upgrade toolsbeta to Kubernetes version 1.33

Upgrade tools cluster

T433132: Upgrade tools to Kubernetes version 1.33

After upgrading

Upgrade lima-kilo
Upgrade Toolforge components (optional)

Details

Related Changes in Gerrit:

	Subject	Author	Repo	Branch	Lines +/-
	aptrepo: Add k8s v1.33, remove k8s v1.31	Andrew Bogott	operations/puppet	production	+13 -13

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		None	T414596 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.35
		Open		Andrew	T414595 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.34
		Resolved		Andrew	T408785 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.33
		Resolved		taavi	T379047 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.32
		Resolved		taavi	T372697 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.31
		Resolved		dcaro	T362869 [k8s,infra] Upgrade Toolforge to Uwubernetes (1.30)
		Resolved		fnegri	T362868 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.29
		Resolved		Slst2020	T373866 [infra, k8s, webservice] remove deprecated kubectl --wait flag before k8s 1.29 upgrade
		Resolved		fnegri	T388797 Some toolforge components are running an old version
		Resolved		fnegri	T390212 Upgrade "toolsbeta" cluster to k8s 1.29.15
		Resolved		fnegri	T390214 Upgrade "tools" cluster to k8s 1.29.15
		Resolved		dcaro	T394787 [kyverno] Upgrade to `3.3.9` chart (`1.13` app) for k8s 1.30 support
		Resolved		dcaro	T401681 [kyverno] policy countres stopped showing correctly in grafana
		Resolved		dcaro	T401684 [kyverno] upgrade to 3.3.9 in tools failed leaving a half-upgraded system
		Resolved		dcaro	T402377 [k8s,infra] Upgrade toolsbeta to Uwubernetes 1.30
		Resolved		dcaro	T402378 [k8s,infra] Upgrade tools to Uwubernetes 1.30
		Resolved		taavi	T383516 [infra,k8s] Upgrade ingress-nginx to v1.12.1+
		Resolved	BUG REPORT	• bd808	T408570 IW ingress config does not work with nginx-ingress-controller:v1.13.3
		Open	BUG REPORT	None	T409493 Toolforge interwiki link handling no longer strips URL-encoding before redirecting when it previously did, breaking existing on-wiki links
		Resolved		taavi	T409474 Reduce tool breakage over new ingress-nginx annotation validation rules
		Resolved		taavi	T408669 Upgrade Calico to 3.29
		Resolved		taavi	T413796 Upgrade toolsbeta cluster to Kubernetes 1.31
		Resolved		taavi	T413797 Upgrade tools cluster to Kubernetes 1.31
		Resolved		taavi	T427918 Upgrade toolsbeta cluster to Kubernetes 1.32
		Resolved		taavi	T427919 Upgrade tools cluster to Kubernetes 1.32
		Resolved		taavi	T427928 Upgrade Kyverno to 1.16 series
		Resolved		Andrew	T408786 Upgrade cert-manager past 1.15
		Resolved		Andrew	T433131 Upgrade toolsbeta to Kubernetes version 1.33
		Resolved		Andrew	T433132 Upgrade tools to Kubernetes version 1.33
		Open		None	T436126 Surprise harbor failure in wmcs.toolforge.k8s.prepare_upgrade

Event Timeline

taavi created this task.Oct 30 2025, 9:53 AM

taavi triaged this task as Medium priority.

Restricted Application added a project: cloud-services-team. · View Herald TranscriptOct 30 2025, 9:53 AM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

taavi added a subtask: T379047: [infra,k8s] Upgrade Toolforge Kubernetes to version 1.32.Oct 30 2025, 9:53 AM

taavi added a parent task: T414595: [infra,k8s] Upgrade Toolforge Kubernetes to version 1.34.Jan 14 2026, 3:35 PM

taavi closed subtask T379047: [infra,k8s] Upgrade Toolforge Kubernetes to version 1.32 as Resolved.Jun 15 2026, 12:45 PM

dcaro claimed this task.Jun 30 2026, 3:35 PM

dcaro updated Other Assignee, added: fnegri.

dcaro added a project: tools-platform-team.

dcaro removed dcaro as the assignee of this task.Jul 2 2026, 4:23 PM

dcaro updated Other Assignee, removed: fnegri.

dcaro edited projects, added: tools-infrastructure-team; removed: tools-platform-team.

dcaro subscribed.

https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes

Andrew updated the task description. (Show Details)Jul 22 2026, 8:35 PM

Andrew updated the task description. (Show Details)

Andrew created subtask T433131: Upgrade toolsbeta to Kubernetes version 1.33.Jul 24 2026, 8:12 PM

Andrew added a subtask: T433132: Upgrade tools to Kubernetes version 1.33.Jul 24 2026, 8:24 PM

Andrew added a comment.Aug 5 2026, 4:35 PM

This comment was removed by Andrew.

Andrew closed subtask T408786: Upgrade cert-manager past 1.15 as Resolved.Aug 6 2026, 1:56 PM

Change #1324360 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] aptrepo: Add k8s v1.33, remove k8s v1.31

https://gerrit.wikimedia.org/r/1324360

gerritbot added a project: Patch-For-Review.Aug 11 2026, 4:58 PM

Change #1324360 merged by Andrew Bogott:

[operations/puppet@production] aptrepo: Add k8s v1.33, remove k8s v1.31

https://gerrit.wikimedia.org/r/1324360

Maintenance_bot removed a project: Patch-For-Review.Aug 12 2026, 2:30 PM

Andrew closed subtask T433131: Upgrade toolsbeta to Kubernetes version 1.33 as Resolved.Aug 26 2026, 1:43 PM

Andrew updated the task description. (Show Details)Aug 26 2026, 1:48 PM

Andrew closed this task as Resolved.Aug 26 2026, 5:25 PM

Andrew claimed this task.

Andrew closed subtask T433132: Upgrade tools to Kubernetes version 1.33 as Resolved.

fnegri updated the task description. (Show Details)Aug 28 2026, 2:40 PM