wmcs.ceph.osd.bootstrap_and_add cookbook should add fewer osds at once
Closed, ResolvedPublicBUG REPORT
Actions

Assigned To

Authored By

	Andrew
	Aug 19 2024, 7:20 PM

Description

We got the 'Primary outbound port utilisation over 80% ' page again today when I put cloudcephosd1038 online with the bootstrap cookbook.

This doesn't seem to happen with other rebalancing operations, so I suspect this issue is specific to putting new osds online; let's change the cookbook to do 2 at once rather than 4 and see if that keeps the peace.

Details

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	ceph.osd.bootstrap_and_add: default to only adding 2 osds at once	cloud/wmcs-cookbooks	main	+1 -1

Customize query in gerrit

Related Objects

Mentioned In: rCCKBbfdd7729806c: ceph.osd.bootstrap_and_add: default to only adding 2 osds at once
T372814: Put cloudcephosd10[39-41] into service

Event Timeline

Andrew created this task.Aug 19 2024, 7:20 PM

Restricted Application added a project: cloud-services-team. · View Herald TranscriptAug 19 2024, 7:20 PM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Andrew mentioned this in T372814: Put cloudcephosd10[39-41] into service.Aug 19 2024, 10:55 PM

Andrew triaged this task as High priority.Aug 21 2024, 2:24 PM

Andrew claimed this task.Aug 29 2024, 2:52 PM

Change #1068839 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[cloud/wmcs-cookbooks@main] ceph.osd.bootstrap_and_add: default to only adding 2 osds at once

https://gerrit.wikimedia.org/r/1068839

gerritbot added a project: Patch-For-Review.Aug 29 2024, 6:15 PM

Change #1068839 merged by jenkins-bot: