We have alerts for Toolforge almost running out of resources (e.g. what motivated T420565: Audit tools memory requests vs actual usage) and we should have the same for Openstack. Specifically when memory/cpu/disk allocations are getting close to full, taking into account oversubscription for cpu.