Page MenuHomePhabricator

Upgrade to Kubernetes 1.2
Closed, ResolvedPublic

Description

We're currently at an early alpha from several months ago. Need to upgrade to 1.2, with our uidenforcer patch on top.

Event Timeline

With https://gerrit.wikimedia.org/r/#/c/279648/ and the 'operations/software/kubernetes' repo, I've already rebased the patch and fixed the test failures!

We still need to change the format of the ABAC files before upgrading.

The plan is:

  1. Prepare all config changes and what not needed to upgrade, stage as puppet patches that haven't been merged yet.
  2. Stop the 3 services on the master (apiserver, controller-manager, scheduler)
  3. Install new master binaries in new locations with new scripts, and document it!
  4. Merge puppet patch that moves the systemd units to start from new location (/usr/local/bin rather than the current /usr/bin)
  5. Merge puppet patch that changes the format of config that is needed to change (just ABAC right now, I think)
  6. Start the master, verify if everything seems to be working fine
  7. Stop kubelet and kubeproxy in one node, and deploy using new scripts
  8. Merge systemd path change puppet patch
  9. Start kubelet & kubeproxy, verify it all works
  10. Deploy kubeproxy on the proxy nodes
  11. Check kube2proxy on the proxy nodes to make sure they work fine.

Change 281586 had a related patch set uploaded (by Yuvipanda):
k8s: Stop using packages for master components

https://gerrit.wikimedia.org/r/281586

Change 281587 had a related patch set uploaded (by Yuvipanda):
k8s: Stop using packages for k8s workers

https://gerrit.wikimedia.org/r/281587

Change 281589 had a related patch set uploaded (by Yuvipanda):
k8s: Add simple script for deploying master

https://gerrit.wikimedia.org/r/281589

Change 281590 had a related patch set uploaded (by Yuvipanda):
k8s: Simple script to deploy worker & proxy

https://gerrit.wikimedia.org/r/281590

Change 281589 merged by Yuvipanda:
k8s: Add simple script for deploying master

https://gerrit.wikimedia.org/r/281589

Change 281590 merged by Yuvipanda:
k8s: Simple script to deploy worker & proxy

https://gerrit.wikimedia.org/r/281590

Change 281586 merged by Yuvipanda:
k8s: Stop using packages for master components

https://gerrit.wikimedia.org/r/281586

Change 281587 merged by Yuvipanda:
k8s: Stop using packages for k8s workers

https://gerrit.wikimedia.org/r/281587

More patches fixing things here and there, but we're on 1.2 no! \o/

https://etherpad.wikimedia.org/p/T130972 has more details that should be distilled out here.

Action items from this:

  1. Setup a test kubernetes cluster
  2. Setup monitoring for kubernetes core components.