Let's confirm alerting and disaster recovery are working properly with the Galera setup.
Proposed steps:
- Delete one of the databases (glance?) on cloudcontrol2001-dev
- Stop galera on cloudcontrol2001, 2003, 2004
- Confirm that some sensible alerts are showing up on icinga
- Recover!
Rudimentary docs can be found at https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Galera and on https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Troubleshooting