Page MenuHomePhabricator

Move all cloud-vps VMs to Ceph
Closed, ResolvedPublic

Description

  • toolforge worker nodes rebuilt on or moved to ceph
  • new ceph-enabled flavors added to replace existing flavors
  • move VMs from cloudvirt1001-1009 to ceph, mark cloudvirt1001-1009 for decom
  • convert remaining cloudvirts to ceph
  • cheer

Related Objects

StatusSubtypeAssignedTask
ResolvedMajavah
ResolvedAndrew
ResolvedAndrew
Resolveddcaro
ResolvedAndrew
ResolvedAndrew
ResolvedAndrew
ResolvedAndrew
Resolveddcaro
OpenNone
ResolvedAndrew
ResolvedAndrew
ResolvedCmjohnson
OpenCmjohnson
ResolvedAndrew
ResolvedAndrew
ResolvedAndrew
ResolvedAndrew
ResolvedAndrew
Opendcaro
Resolvedaborrero
Opendcaro
Resolveddcaro
Opendcaro
Opendcaro
ResolvedAndrew
ResolvedAndrew
ResolvedAndrew
ResolvedCmjohnson
ResolvedJclark-ctr
Resolvedayounsi
Resolvedaborrero

Event Timeline

Andrew triaged this task as High priority.Sep 8 2020, 4:15 PM
Andrew moved this task from Inbox to Soon! on the cloud-services-team (Kanban) board.

A few special cases:

clouddb-wikilabels-01.clouddb-services.eqiad1.wikimedia.cloud and clouddb-wikilabels-02.clouddb-services.eqiad1.wikimedia.cloud should be moved to Ceph but they'll need special flavors -- much smaller disk than currently allocated and also probably a lifted IO throttle. If possible coordinate this with the wikilabels folks.

clouddb-100[1-4] can stay on local storage for now but their hypervisors need to be rebuild with Buster.

Change 634545 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[openstack/horizon/horizon@train] WMF Hack: hide non-ceph flavors from the instance creation workflow

https://gerrit.wikimedia.org/r/634545

Change 634545 merged by Andrew Bogott:
[openstack/horizon/horizon@train] WMF Hack: hide non-ceph flavors from the instance creation workflow

https://gerrit.wikimedia.org/r/634545

Change 635893 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] wmcs: change cloudvirt1025, 26 and 29 to ceph-enabled hypervisors

https://gerrit.wikimedia.org/r/635893

Change 635893 merged by Andrew Bogott:
[operations/puppet@production] wmcs: change cloudvirt1025, 26 and 29 to ceph-enabled hypervisors

https://gerrit.wikimedia.org/r/635893

Andrew updated the task description. (Show Details)

Other than the special-case VMs in clouddb-services and wdqs VMs (which may remain with local storage for good), all VMs are now hosted on Ceph. Cloudvirt1025-30 are awaiting network upgrades before being rebuilt as Ceph-enabled hypervisors.

I'm closing this; upgrading and moving remaining hardware can be dealt with via different tasks.

Change 644621 had a related patch set uploaded (by Andrew Bogott; owner: Andrew Bogott):
[operations/puppet@production] Make clouddvirt1030 a ceph-enabled hypervisor

https://gerrit.wikimedia.org/r/644621

Change 644621 merged by Andrew Bogott:
[operations/puppet@production] Make clouddvirt1030 a ceph-enabled hypervisor

https://gerrit.wikimedia.org/r/644621