Page MenuHomePhabricator
Create Task
Maniphest T280340

Upgrade Toolforge Kubernetes to latest 1.19
Closed, ResolvedPublic
Actions

Description

After the 1.18 update is complete (see subtask), update to 1.19 as soon as feasible.

Our notes: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Kubernetes/Upgrading_Kubernetes
Relelase notes: https://v1-19.docs.kubernetes.io/docs/setup/release/notes/#urgent-upgrade-notes I already reviewed those and did not find anything that would be breaking our setup.

Details

SubjectRepoBranchLines +/-
aptrepo: Init thirdparty/kubeadm-k8s-1-19operations/puppetproduction+14 -3
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 OpenNoneT362869 [k8s,infra] Upgrade Toolforge to Uwubernetes (1.30)
 OpenNoneT362868 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.29
 OpenNoneT362867 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.28
 OpenNoneT359641 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.27
 OpenNoneT327025 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.26
 OpenNoneT316107 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.25
 ResolvedaborreroT307651 Upgrade Toolforge Kubernetes to version 1.24
 ResolvedtaaviT298005 Upgrade Toolforge Kubernetes to version 1.23
 ResolvedtaaviT286856 Upgrade Toolforge Kubernetes to latest 1.22
 ResolvedrookT308172 Upgrade PAWS to Kubernetes 1.21
 ResolvedtaaviT282942 Upgrade Toolforge Kubernetes to latest 1.21
 ResolvedrookT291913 Upgrade PAWS kubernetes to 1.20
 ResolvedrookT280402 Upgrade Toolforge Kubernetes to latest 1.20
 ResolvedtaaviT280340 Upgrade Toolforge Kubernetes to latest 1.19
 ResolvedtaaviT280299 Upgrade Toolforge Kubernetes to latest 1.18
 ResolvedtaaviT280300 Validate that maintain-kubeusers works with k8s 1.18
 ResolvedtaaviT280301 Refresh certs that are not controlled by kubeadm
 ResolvedtaaviT280302 Upgrade PAWS Kubernetes to the latest 1.18 release
 ResolvedtaaviT264221 Upgrade the nginx ingress controller in Toolforge (and likely PAWS)
 Resolved• BstormT282087 Support cinder or expanded ephemeral disk worker nodes on Toolforge Kubernetes
 ResolvedtaaviT284353 Fix prometheus monitoring for Toolforge Ingress
 ResolvedtaaviT280342 Upgrade Calico to 3.18
 ResolvedtaaviT280360 Update ingress-admission-controller to support Ingress from networking.k8s.io/v1

Event Timeline

taavi triaged this task as Medium priority.Apr 16 2021, 10:48 AM
taavi created this task.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 16 2021, 10:48 AM
taavi added a subtask: T280299: Upgrade Toolforge Kubernetes to latest 1.18.Apr 16 2021, 10:48 AM
taavi added a comment.EditedApr 16 2021, 1:41 PM

More things from release notes:

  • Still-served features deprecated in 1.19, found from codesearch which might miss things not in operations/puppet. These will be removed in 1.22.
    • apiextensions.k8s.io/v1beta1, used by Calico and apiregistration.k8s.io/v1beta1, used by metrics-server
    • authorization.k8s.io/v1beta1: not sure, rbac.authorization.k8s.io/v1beta1 is used heavily but not sure if rbac. is deprecated when the parent domain is
  • New stable Ingress API, ingress-admission-controller needs an update, will file a separate task
  • More visibility over deprecated feature usage, kubectl will show warnings and we have prometheus metrics
taavi added a parent task: T280402: Upgrade Toolforge Kubernetes to latest 1.20.Apr 16 2021, 7:11 PM
taavi closed subtask T280299: Upgrade Toolforge Kubernetes to latest 1.18 as Resolved.Jun 29 2021, 8:10 PM
taavi closed subtask T280342: Upgrade Calico to 3.18 as Resolved.Jul 21 2021, 5:35 PM
gerritbot added a comment.Jul 21 2021, 5:51 PM

Change 705972 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] aptrepo: Init thirdparty/kubeadm-k8s-1-19

https://gerrit.wikimedia.org/r/705972

gerritbot added a project: Patch-For-Review.Jul 21 2021, 5:51 PM
taavi claimed this task.Jul 21 2021, 5:57 PM
Restricted Application added a project: User-Majavah. · View Herald TranscriptJul 21 2021, 5:57 PM
taavi moved this task from Unsorted to Working on on the User-Majavah board.Jul 21 2021, 5:57 PM
taavi moved this task from Backlog to In Progress on the Toolforge board.
gerritbot added a comment.Jul 23 2021, 10:46 AM

Change 705972 merged by Arturo Borrero Gonzalez:

[operations/puppet@production] aptrepo: Init thirdparty/kubeadm-k8s-1-19

https://gerrit.wikimedia.org/r/705972

Maintenance_bot removed a project: Patch-For-Review.Jul 23 2021, 11:10 AM
Stashbot added a comment.Jul 23 2021, 1:31 PM

Mentioned in SAL (#wikimedia-cloud) [2021-07-23T13:31:40Z] <majavah> upgrading toolsbeta to kubernetes 1.19, T280340

taavi closed subtask T280360: Update ingress-admission-controller to support Ingress from networking.k8s.io/v1 as Resolved.Jul 23 2021, 2:16 PM
taavi added a comment.Jul 23 2021, 7:55 PM

Scheduled for 2021-07-26, 15:30Z: https://lists.wikimedia.org/hyperkitty/list/cloud-announce@lists.wikimedia.org/thread/D5DL7PG4RPLLEBIJFSFXNLS4UFQ4LSCS/

Stashbot added a comment.Jul 26 2021, 4:37 PM

Mentioned in SAL (#wikimedia-cloud) [2021-07-26T16:37:43Z] <bstorm> removing tools-k8s-ingress-4 from active ingress nodes at the proxy T280340

taavi closed this task as Resolved.Jul 26 2021, 5:34 PM

Done. Notes at https://etherpad.wikimedia.org/p/WMCS-2021-07-26-tools-k8s-upgrade

Stashbot added a comment.Jul 26 2021, 5:37 PM

Mentioned in SAL (#wikimedia-cloud) [2021-07-26T17:37:54Z] <bstorm> repooled the whole set of ingress workers after upgrades T280340

• Bstorm mentioned this in T287421: Latest Toolforge docker images don't always have python2 installed at all.Jul 26 2021, 10:38 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL