The OpenStack cinder-backup process has a good API and interface but is too slow to usefully run in our setup for large volumes.
I'm going to try replacing it with backy2 which seems to work well for the other things we're using it for.
Description
Description
Details
Details
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | • Bstorm | T216208 ToolsDB overload and cleanup | |||
| Resolved | • Bstorm | T216441 Evaluate transferring the non-replicated tables to the new toolsdb server | |||
| Resolved | fnegri | T236101 Find a way to remove non-replicated tables from ToolsDB | |||
| Resolved | dcaro | T301951 toolsdb: full disk on clouddb1001 broke clouddb1002 (secondary) replication | |||
| Open | None | T301967 toolsdb: evaluate storage usage by some tools | |||
| Open | fnegri | T291782 Migrate largest ToolsDB users to Trove | |||
| Open | None | T272395 Cloud: reduce NAT exceptions from cloud to production | |||
| Resolved | Andrew | T291405 [NFS] Reduce or eliminate bare-metal NFS servers | |||
| Resolved | Andrew | T292546 cloud NFS: figure out backups for cinder volumes | |||
| Resolved | Andrew | T344065 Replace cinder-backup process with backy2 | |||
| Resolved | Andrew | T358855 Use cloudbackup100[12]-dev for cinder backup test/dev | |||
| Resolved | Andrew | T366071 'backy2 cleanup' not getting called properly on cloudbackup hosts |
Event Timeline
Comment Actions
Change 946963 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):
[operations/puppet@production] wip Convert cloudbackup200[12] from cinder-backup nodes to backy2 nodes
Comment Actions
Change 948161 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):
[operations/puppet@production] backy2: make backup dir configurable
Comment Actions
Change 948161 merged by Andrew Bogott:
[operations/puppet@production] backy2: make backup dir configurable
Comment Actions
Change 948231 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):
[labs/private@master] Add new dummy yaml for backy2/cinder_backups
Comment Actions
Change 948231 merged by Andrew Bogott:
[labs/private@master] Add new dummy yaml for backy2/cinder_backups
Comment Actions
Change 948234 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):
[operations/puppet@production] wmcs-backup: support config-file-based volume selection
Comment Actions
Change 948234 merged by Andrew Bogott:
[operations/puppet@production] wmcs-backup: support config-file-based volume selection
Comment Actions
Change 946963 merged by Andrew Bogott:
[operations/puppet@production] Convert cloudbackup200[12] from cinder-backup nodes to backy2 nodes
Comment Actions
Change 948235 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):
[operations/puppet@production] Disable cinder backups
Comment Actions
Change 948236 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):
[operations/puppet@production] backup_cinder_volumes: Install OpenStack client packages
Comment Actions
Change 948235 merged by Andrew Bogott:
[operations/puppet@production] Disable cinder backups
Comment Actions
Change 948236 merged by Andrew Bogott:
[operations/puppet@production] backup_cinder_volumes: Install OpenStack client packages
Comment Actions
Change 948237 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):
[operations/puppet@production] backup_cinder_volumes: install the right config file!
Comment Actions
Change 948237 merged by Andrew Bogott:
[operations/puppet@production] backup_cinder_volumes: install the right config file!
Comment Actions
Change 948238 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):
[operations/puppet@production] cinder_backups: point backup hosts in codfw to the eqiad cloudceph mons
Comment Actions
Change 948238 merged by Andrew Bogott:
[operations/puppet@production] cinder_backups: point backup hosts in codfw to the eqiad cloudceph mons
Comment Actions
Change 948565 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):
[operations/puppet@production] wmcs-backup: be a little better about tracking image_id vs ceph_id
Comment Actions
Change 948565 merged by Andrew Bogott:
[operations/puppet@production] wmcs-backup: be a little better about tracking image_id vs ceph_id
Comment Actions
Change 951139 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):
[operations/puppet@production] backy2: make postgres data dir configurable.
Comment Actions
Change 951139 merged by Andrew Bogott:
[operations/puppet@production] backy2: make postgres data dir configurable.
Comment Actions
Change 1007295 had a related patch set uploaded (by Majavah; author: Majavah):
[operations/puppet@production] P:openstack: rabbitmq: remove cinder-backups term
Comment Actions
Change 1007853 had a related patch set uploaded (by Majavah; author: Majavah):
[operations/puppet@production] Remove unused eqiad1 cinder backup role
Comment Actions
Change 1007853 merged by Majavah:
[operations/puppet@production] Remove unused eqiad1 cinder backup role
Comment Actions
Change 1007295 merged by Majavah:
[operations/puppet@production] P:openstack: rabbitmq: remove cinder-backups term