Page MenuHomePhabricator

[k8s,infra] Upgrade Toolforge to Uwubernetes (1.30)
Closed, ResolvedPublic

Description

Also known as Kubernetes 1.30. https://kubernetes.io/blog/2024/04/17/kubernetes-v1-30-release/
Workgroup page: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Ongoing_Efforts/Toolforge_Upgrade_Workgroup/Upgrades_Overview

Upgrade procedure: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes

Refer to the link above for the detailed procedure, and update the checkboxes as you complete them.

Before upgrading

  • Check Kubernetes changelog - nothing we use gets deprecated, some things become stable (like VAPs)
  • Announce user-facing changes - no user-facing changes
  • Prepare the new APT packages
  • Upgrade Toolforge components
  • Test new k8s version in lima-kilo
    • just upgrading the nodes to 1.30 and deploying all the components "as they are" seems to work (passed all the functional tests)
    • have to retest after upgrading some of the components

Upgrade toolsbeta cluster

T402377: [k8s,infra] Upgrade toolsbeta to Uwubernetes 1.30

Upgrade tools cluster

T402378: [k8s,infra] Upgrade tools to Uwubernetes 1.30

After upgrading

  • Upgrade lima-kilo
  • Upgrade Toolforge components (optional)

Details

Other Assignee
dcaro
Related Changes in Gerrit:
Related Changes in GitLab:
TitleReferenceAuthorSource BranchDest Branch
ingress-admission: bump to 0.0.65-20250918081214-08a03872repos/cloud/toolforge/toolforge-deploy!973group_203_bot_f4d95069bb2675e4ce1fff090c1c1620bump_ingress-admissionmain
builds-api: bump to 0.0.199-20250916142147-5e8adc0frepos/cloud/toolforge/toolforge-deploy!972group_203_bot_f4d95069bb2675e4ce1fff090c1c1620bump_builds-apimain
registry-admission: bump to 0.0.66-20250916142141-810024bfrepos/cloud/toolforge/toolforge-deploy!971group_203_bot_f4d95069bb2675e4ce1fff090c1c1620bump_registry-admissionmain
volume-admission: bump to 0.0.73-20250916142135-79fa734crepos/cloud/toolforge/toolforge-deploy!970group_203_bot_f4d95069bb2675e4ce1fff090c1c1620bump_volume-admissionmain
envvars-api: bump to 0.0.75-20250916125754-a88de155repos/cloud/toolforge/toolforge-deploy!969group_203_bot_f4d95069bb2675e4ce1fff090c1c1620bump_envvars-apimain
package: upgrade dependenciesrepos/cloud/toolforge/ingress-admission!25dcaroupdate_depsmain
package: upgrade dependenciesrepos/cloud/toolforge/registry-admission!29dcaroupdate_depsmain
package: upgrade depsrepos/cloud/toolforge/volume-admission!35dcaroupgrade_depsmain
pacakage: bump dependenciesrepos/cloud/toolforge/builds-api!141dcaroupgrade_depsmain
package: upgrade all depsrepos/cloud/toolforge/envvars-api!64dcaroupgrade_depsmain
wmcs-k8s-metrics: update to support k8s v1.30repos/cloud/toolforge/toolforge-deploy!929dcaroupgrade_wmcs_k8s_metricsmain
k8s: upgrade to 1.30repos/cloud/toolforge/lima-kilo!241dcaroupgrade_k8s_1.30main
Show related patches Customize query in GitLab

Related Objects

Event Timeline

taavi triaged this task as Medium priority.
dcaro renamed this task from Upgrade Toolforge to Uwubernetes to [k8s,infra] Upgrade Toolforge to Uwubernetes (1.30).May 6 2024, 9:17 AM
dcaro updated Other Assignee, added: dcaro.
dcaro changed the task status from Open to In Progress.May 7 2025, 12:13 PM
dcaro moved this task from Next Up to In Progress on the Toolforge (Toolforge iteration 19) board.

I uploaded the newer kyverno 1.13 version images

Mentioned in SAL (#wikimedia-cloud-feed) [2025-08-18T17:48:14Z] <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (T362869)

Mentioned in SAL (#wikimedia-cloud-feed) [2025-08-18T17:48:19Z] <dcaro@cloudcumin1001> Updating container image docker-registry.svc.toolforge.org/metrics-server:v0.7.2 (T362869)

Mentioned in SAL (#wikimedia-cloud-feed) [2025-08-18T17:48:22Z] <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=0) (T362869)

Mentioned in SAL (#wikimedia-cloud-feed) [2025-08-18T17:49:19Z] <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (T362869)

Mentioned in SAL (#wikimedia-cloud-feed) [2025-08-18T17:49:22Z] <dcaro@cloudcumin1001> Updating container image docker-registry.svc.toolforge.org/kube-state-metrics:v2.16.0 (T362869)

Mentioned in SAL (#wikimedia-cloud-feed) [2025-08-18T17:49:34Z] <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=0) (T362869)

Mentioned in SAL (#wikimedia-cloud) [2025-08-19T12:39:05Z] <dcaro> deploy wmcs-k8s-metrics upgrade (T362869)

Mentioned in SAL (#wikimedia-cloud) [2025-08-20T08:09:19Z] <dcaro> deploy wmcs-k8s-metrics upgrade (T362869)

Change #1180502 had a related patch set uploaded (by David Caro; author: David Caro):

[operations/puppet@production] aptrepo: add k8s 1.30 packages and remove unused 1.28

https://gerrit.wikimedia.org/r/1180502

Change #1180502 merged by David Caro:

[operations/puppet@production] aptrepo: add k8s 1.30 packages and remove unused 1.28

https://gerrit.wikimedia.org/r/1180502

Change #1180584 had a related patch set uploaded (by David Caro; author: David Caro):

[operations/puppet@production] aptrepo: add k8s 1.30 to trixie-wikimedia repo

https://gerrit.wikimedia.org/r/1180584

Change #1180584 merged by David Caro:

[operations/puppet@production] aptrepo: add k8s 1.30 and helm to trixie-wikimedia repo

https://gerrit.wikimedia.org/r/1180584

dcaro changed the status of subtask T402377: [k8s,infra] Upgrade toolsbeta to Uwubernetes 1.30 from Open to In Progress.

group_203_bot_f4d95069bb2675e4ce1fff090c1c1620 opened https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/969

envvars-api: bump to 0.0.75-20250916125754-a88de155

group_203_bot_f4d95069bb2675e4ce1fff090c1c1620 opened https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/970

volume-admission: bump to 0.0.73-20250916142135-79fa734c

group_203_bot_f4d95069bb2675e4ce1fff090c1c1620 opened https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/971

registry-admission: bump to 0.0.66-20250916142141-810024bf

group_203_bot_f4d95069bb2675e4ce1fff090c1c1620 opened https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/972

builds-api: bump to 0.0.199-20250916142147-5e8adc0f

group_203_bot_f4d95069bb2675e4ce1fff090c1c1620 opened https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/973

ingress-admission: bump to 0.0.65-20250918081214-08a03872

dcaro updated the task description. (Show Details)
dcaro moved this task from In progress to Done on the cloud-services-team (FY2025/26-Q1-Q2) board.
dcaro moved this task from In Progress to Done on the Toolforge (Toolforge iteration 24) board.