⚓ T374005 [ceph] install and put in the cluster the cloudcephmon100[1-3] replacements

Subject	Repo	Branch	Lines +/-
cloudceph: add coludcephmon1006 to the pool	operations/puppet	production	+24 -1
cloudceph: add missing mgr entry for cloudcephmon1005	operations/puppet	production	+8 -0
cloudceph: add cloudcephmon1005	operations/puppet	production	+10 -1

Status	Subtype	Assigned	Task
Resolved		dcaro	T374005 [ceph] install and put in the cluster the cloudcephmon100[1-3] replacements
Resolved		Jclark-ctr	T364870 Q4:rack/setup/install new cloudcephmon hosts
Resolved	Request	Papaul	T380893 decommission cloudcephmon100[1-3].eqiad.wmnet

dcaro created this task.Sep 4 2024, 12:45 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 4 2024, 12:45 PM

We should start with 1005, as we have 2 mons already on C8

dcaro mentioned this in T359641: [infra,k8s] Upgrade Toolforge Kubernetes to version 1.27.Sep 4 2024, 2:58 PM

dcaro mentioned this in T373986: cloudsw1-c8-eqiad is unstable.Sep 4 2024, 3:02 PM

Change #1070621 had a related patch set uploaded (by David Caro; author: David Caro):

[operations/puppet@production] cloudceph: add cloudcephmon1005

https://gerrit.wikimedia.org/r/1070621

gerritbot added a project: Patch-For-Review.Sep 4 2024, 3:03 PM

Change #1070621 merged by David Caro:

[operations/puppet@production] cloudceph: add cloudcephmon1005

https://gerrit.wikimedia.org/r/1070621

Maintenance_bot removed a project: Patch-For-Review.Sep 4 2024, 3:30 PM

Change #1070631 had a related patch set uploaded (by David Caro; author: David Caro):

[operations/puppet@production] cloudceph: add missing mgr entry for cloudcephmon1005

https://gerrit.wikimedia.org/r/1070631

Change #1070631 merged by David Caro:

[operations/puppet@production] cloudceph: add missing mgr entry for cloudcephmon1005

https://gerrit.wikimedia.org/r/1070631

Maintenance_bot removed a project: Patch-For-Review.Sep 4 2024, 4:30 PM

For cloudcephmon1005 I had to downgrade puppet from 5 to 7, cleanup the certs, run puppet, sign the cert on the puppetmaster1001, and create /var/lib/ceph/mon/ceph-cloudcephmon1005/keyring by hand

dcaro moved this task from Backlog to In progress on the cloud-services-team (FY2024/2025-Q1-Q2) board.Sep 4 2024, 4:42 PM

dcaro mentioned this in T374463: [cloud] Drain B row from cloud* services.Sep 10 2024, 3:04 PM

Change #1072146 had a related patch set uploaded (by David Caro; author: David Caro):

[operations/puppet@production] cloudceph: add coludcephmon1006 to the pool

https://gerrit.wikimedia.org/r/1072146

gerritbot added a project: Patch-For-Review.Sep 11 2024, 8:42 AM

Change #1072146 merged by David Caro:

[operations/puppet@production] cloudceph: add coludcephmon1006 to the pool

https://gerrit.wikimedia.org/r/1072146

Maintenance_bot removed a project: Patch-For-Review.Sep 11 2024, 9:30 AM

dcaro updated the task description. (Show Details)Sep 11 2024, 10:04 AM

dcaro triaged this task as Medium priority.Sep 18 2024, 2:15 PM