Puppetize PAWS k8s cluster
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Chicocvenancio
	Mar 5 2018, 1:27 PM

Description

PAWS k8s cluster was built manually with the help of a few nice scripts. I propose we Puppetize this process as much as possible.

Details

Related Changes in Gerrit:

Subject	Repo	Branch	Lines +/-
r:wmcs:paws:k8s:etcd: remove unused role	operations/puppet	production	+0 -7
paws-k8s: Adding a checkout of the paws repo	operations/puppet	production	+9 -0
kubeadm: Our template should match package versions for bootstraps	operations/puppet	production	+15 -7
paws: Add a profile to provide some special config for paws	operations/puppet	production	+15 -0
paws-kubeadm: Add option for stacked control plane	operations/puppet	production	+36 -28
paws: Introduce the role skeleton for the paws servers	operations/puppet	production	+21 -0

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
		Restricted Task
Resolved	• Bstorm	T246122 Upgrade the Toolforge Kubernetes cluster to v1.16
Resolved	• Bstorm	T211096 PAWS: Rebuild and upgrade Kubernetes
Resolved	• Bstorm	T188912 Puppetize PAWS k8s cluster

Event Timeline

Chicocvenancio created this task.Mar 5 2018, 1:27 PM

Chicocvenancio triaged this task as Medium priority.

zhuyifei1999 awarded a token.Mar 5 2018, 8:51 PM

zhuyifei1999 subscribed.

Chicocvenancio moved this task from Backlog to MVP (Most Valuable PAWS) on the PAWS board.Mar 6 2018, 7:17 PM

Chicocvenancio mentioned this in T190895: Request increased quota for toolsbeta.Apr 9 2018, 4:06 PM

Chicocvenancio moved this task from MVP (Most Valuable PAWS) to zero-to-jupyterhub-k8s 0.8.0 on the PAWS board.Mar 11 2019, 1:51 PM

Chicocvenancio edited projects, added PAWS (zero-to-jupyterhub-k8s 0.8.0); removed PAWS.

Chicocvenancio mentioned this in T218231: Update PAWS k8s cluster.Mar 13 2019, 4:15 PM

bd808 edited projects, added cloud-services-team (Kanban); removed cloud-services-team.Mar 8 2020, 5:32 AM

• Bstorm mentioned this in T211096: PAWS: Rebuild and upgrade Kubernetes.Apr 15 2020, 10:56 PM

• Bstorm added a parent task: T211096: PAWS: Rebuild and upgrade Kubernetes.Apr 15 2020, 11:14 PM

Change 596478 had a related patch set uploaded (by Bstorm; owner: Bstorm):
[operations/puppet@production] paws: Introduce the role skeleton for the paws servers

https://gerrit.wikimedia.org/r/596478

gerritbot added a project: Patch-For-Review.May 14 2020, 4:24 PM

• Bstorm subscribed.May 14 2020, 4:25 PM

Change 596478 merged by Bstorm:
[operations/puppet@production] paws: Introduce the role skeleton for the paws servers

https://gerrit.wikimedia.org/r/596478

That patch assumes an external etcd, I realized just now, which is not how paws has been built so far. I just wanted to call it out in case we decide to converge the control plane instead, which saves number of VMs. With redundant control plane servers, it's not a huge problem in any case (and we should note that PAWS currently has a single control plane and etcd node, tools-paws-master-01).

Change 597591 had a related patch set uploaded (by Bstorm; owner: Bstorm):
[operations/puppet@production] paws-kubeadm: Add option for stacked control plane

https://gerrit.wikimedia.org/r/597591

Change 597602 had a related patch set uploaded (by Bstorm; owner: Bstorm):
[operations/puppet@production] paws: Add a profile to provide some special config for paws

https://gerrit.wikimedia.org/r/597602

Change 597591 merged by Bstorm:
[operations/puppet@production] paws-kubeadm: Add option for stacked control plane

https://gerrit.wikimedia.org/r/597591

Change 597818 had a related patch set uploaded (by Bstorm; owner: Bstorm):
[operations/puppet@production] kubeadm: Our template should match package versions for bootstraps

https://gerrit.wikimedia.org/r/597818

Change 597824 had a related patch set uploaded (by Bstorm; owner: Bstorm):
[operations/puppet@production] paws-k8s: Adding a checkout of the paws repo

https://gerrit.wikimedia.org/r/597824

Change 597602 abandoned by Bstorm:
paws: Add a profile to provide some special config for paws

Reason:
Went with a different approach

https://gerrit.wikimedia.org/r/597602

Change 597818 merged by Bstorm:
[operations/puppet@production] kubeadm: Our template should match package versions for bootstraps

https://gerrit.wikimedia.org/r/597818

Change 597824 merged by Bstorm:
[operations/puppet@production] paws-k8s: Adding a checkout of the paws repo

https://gerrit.wikimedia.org/r/597824

At this point, I'm just keeping this open until we've moved over the cluster. As long as we actually use what we've built so far, this is effectively done.

Even moreso now that the new cluster is a working PoC. Still keeping this open until cutover.

bd808 reassigned this task from Chicocvenancio to • Bstorm.Jul 17 2020, 10:00 PM

bd808 moved this task from Inbox to Doing on the cloud-services-team (Kanban) board.