We're currently at an early alpha from several months ago. Need to upgrade to 1.2, with our uidenforcer patch on top.
Description
Details
Status | Subtype | Assigned | Task | ||
---|---|---|---|---|---|
Resolved | yuvipanda | T129309 Goal: Allow using k8s instead of GridEngine as a backend for webservices | |||
Duplicate | None | T129311 Setup a proper deployment strategy for Kubernetes | |||
Resolved | yuvipanda | T130972 Upgrade to Kubernetes 1.2 |
Event Timeline
With https://gerrit.wikimedia.org/r/#/c/279648/ and the 'operations/software/kubernetes' repo, I've already rebased the patch and fixed the test failures!
We still need to change the format of the ABAC files before upgrading.
The plan is:
- Prepare all config changes and what not needed to upgrade, stage as puppet patches that haven't been merged yet.
- Stop the 3 services on the master (apiserver, controller-manager, scheduler)
- Install new master binaries in new locations with new scripts, and document it!
- Merge puppet patch that moves the systemd units to start from new location (/usr/local/bin rather than the current /usr/bin)
- Merge puppet patch that changes the format of config that is needed to change (just ABAC right now, I think)
- Start the master, verify if everything seems to be working fine
- Stop kubelet and kubeproxy in one node, and deploy using new scripts
- Merge systemd path change puppet patch
- Start kubelet & kubeproxy, verify it all works
- Deploy kubeproxy on the proxy nodes
- Check kube2proxy on the proxy nodes to make sure they work fine.
Change 281586 had a related patch set uploaded (by Yuvipanda):
k8s: Stop using packages for master components
Change 281587 had a related patch set uploaded (by Yuvipanda):
k8s: Stop using packages for k8s workers
Change 281589 had a related patch set uploaded (by Yuvipanda):
k8s: Add simple script for deploying master
Change 281590 had a related patch set uploaded (by Yuvipanda):
k8s: Simple script to deploy worker & proxy
More patches fixing things here and there, but we're on 1.2 no! \o/
https://etherpad.wikimedia.org/p/T130972 has more details that should be distilled out here.
Action items from this:
- Setup a test kubernetes cluster
- Setup monitoring for kubernetes core components.