Test PAWS on k8s 1.25
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	rook
	Jan 13 2023, 8:37 PM

Description

wget https://builds.coreos.fedoraproject.org/prod/streams/stable/builds/37.20221127.3.0/x86_64/fedora-coreos-37.20221127.3.0-openstack.x86_64.qcow2.xz
xz --decompress fedora-coreos-37.20221127.3.0-openstack.x86_64.qcow2.xz
openstack image create magnum-fcos-37-20221127-2 --file=fedora-coreos-37.20221127.3.0-openstack.x86_64.qcow2 --disk-format=qcow2 --container-format=bare --property os_distro='fedora-coreos' --public
openstack image set --property visibility=shared --project testlabs magnum-fcos-37-20221127-2
openstack image set --activate magnum-fcos-37-20221127-2

openstack coe cluster template create paws-dev-k8s25 \
--image magnum-fcos-37-20221127-2 \
--external-network wan-transport-codfw \
--fixed-subnet cloud-instances2-b-codfw \
--fixed-network lan-flat-cloudinstances2b \
--dns-nameserver 8.8.8.8 \
--network-driver flannel \
--docker-storage-driver overlay2 \
--docker-volume-size 30 \
--master-flavor g2.cores1.ram2.disk20 \
--flavor g2.cores1.ram2.disk20 \
--coe kubernetes \
--labels kube_tag=v1.25.5-rancher1-linux-amd64,hyperkube_prefix=docker.io/rancher/,cloud_provider_enabled=true \
--floating-ip-disabled

Related Objects
Search...

Status	Assigned	Task
Resolved	rook	T317788 Remove kubeval
Resolved	None	T317787 Pod Security Policies
Resolved	rook	T326985 Test PAWS on k8s 1.25

Event Timeline

rook created this task.Jan 13 2023, 8:37 PM

rook updated the task description. (Show Details)Jan 13 2023, 9:02 PM

Getting

Trying to label master node with node-role.kubernetes.io/master=""
++ kubectl get --raw=/healthz
The connection to the server 127.0.0.1:6443 was refused - did you specify the right host or port?
+ '[' ok = '' ']'
+ echo 'Trying to label master node with node-role.kubernetes.io/master=""'
+ sleep 5s

out of heat log on control system.

Podman is giving
E0119 22:01:50.343107 1 leaderelection.go:330] error retrieving resource lock kube-system/kube-controller-manager: Get "https://127.0.0.1:6443/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager?timeout=5s": dial tcp 127.0.0.1:6443: connect: connection refused
off the kube-controller-manager.
Kubelet seems to try to start occasionally, then fail quickly.

If I'm reading the git commit history for magnum correctly support for k8s 1.24+ is included after zed, so we probably won't be able to get this until the next openstack upgrade. I believe scheduled for July.

rook changed the task status from Open to Stalled.Jan 19 2023, 10:04 PM

rook merged a task: T318885: Disable PodSecurityPolicy on Magnum.Apr 14 2023, 2:31 PM

rook added a subscriber: Aklapper.

rook merged a task: T294446: containerSecurityContext.Apr 14 2023, 3:07 PM

This does not work on Antelope. Though the git log and https://docs.openstack.org/magnum/latest/user/index.html#supported-versions suggests it will work on bobcat.

rook changed the task status from Stalled to In Progress.Apr 24 2024, 3:16 PM

vivian-rook opened https://github.com/toolforge/paws/pull/404

rook mentioned this in T363504: Deploy k8s greater than 1.23.Apr 29 2024, 4:42 PM

vivian-rook closed https://github.com/toolforge/paws/pull/404

Mentioned in SAL (#wikimedia-cloud) [2024-04-29T16:50:08Z] <Rook> k8s to 1.26 T326985

rook closed this task as Resolved.Apr 29 2024, 4:50 PM

rook added a parent task: T317787: Pod Security Policies.