NovafullstackSustainedFailures cloudcontrol1005:9100 The automated tests were unable to create, provision and decommission a VM in the last 5h
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	phaultfinder
	Oct 7 2022, 10:07 AM

Description

dashboard: https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-nova-fullstack?orgId=1
description: The automated tests were unable to create, provision and decommission a VM in the last 5h
runbook: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedFailures
summary: Novafullstack tests have been failing for more than 5hours in eqiad

dashboard: https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-nova-fullstack?orgId=1
description: The automated tests were unable to create, provision and decommission a VM in the last 5h
runbook: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/NovafullstackSustainedFailures
summary: Novafullstack tests have been failing for more than 5hours in eqiad
alertname: NovafullstackSustainedFailures
cluster: wmcs
instance: cloudcontrol1005:9100
job: node
prometheus: ops
service: openstack,cloudvps,novafullstack
severity: task
site: eqiad
source: prometheus
team: wmcs
Source

		Status	Subtype	Assigned	Task
		Resolved		dcaro	T320235 NovafullstackSustainedFailures cloudcontrol1005:9100 The automated tests were unable to create, provision and decommission a VM in the last 5h
		Resolved		None	T320232 nova-fullstack leaking VMs: rabbitmq may have problems

Fixed (rabbitmq misbehaving)