Page MenuHomePhabricator

openstack: live migration issue: nova conductor key exception
Closed, InvalidPublic

Description

Message produced by nova-conductor @ cloudcontrol1004 when draining cloudvirt1024:

Migration of instance b44713ab-aeb6-4b40-bd61-7f861439c686 to host cloudvirt1022 unexpectedly failed.: KeyError: '9a09673b-6079-46e8-a7cd-4407991637bd'
2021-03-04 12:30:31.958 46633 ERROR nova.conductor.manager Traceback (most recent call last):
2021-03-04 12:30:31.958 46633 ERROR nova.conductor.manager   File "/usr/lib/python3/dist-packages/nova/conductor/manager.py", line 456, in _live_migrate
2021-03-04 12:30:31.958 46633 ERROR nova.conductor.manager     task.execute()
2021-03-04 12:30:31.958 46633 ERROR nova.conductor.manager   File "/usr/lib/python3/dist-packages/nova/conductor/tasks/base.py", line 27, in wrap
2021-03-04 12:30:31.958 46633 ERROR nova.conductor.manager     self.rollback()
2021-03-04 12:30:31.958 46633 ERROR nova.conductor.manager   File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2021-03-04 12:30:31.958 46633 ERROR nova.conductor.manager     self.force_reraise()
2021-03-04 12:30:31.958 46633 ERROR nova.conductor.manager   File "/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2021-03-04 12:30:31.958 46633 ERROR nova.conductor.manager     six.reraise(self.type_, self.value, self.tb)
2021-03-04 12:30:31.958 46633 ERROR nova.conductor.manager   File "/usr/lib/python3/dist-packages/six.py", line 693, in reraise
2021-03-04 12:30:31.958 46633 ERROR nova.conductor.manager     raise value
2021-03-04 12:30:31.958 46633 ERROR nova.conductor.manager   File "/usr/lib/python3/dist-packages/nova/conductor/tasks/base.py", line 24, in wrap
2021-03-04 12:30:31.958 46633 ERROR nova.conductor.manager     return original(self)
2021-03-04 12:30:31.958 46633 ERROR nova.conductor.manager   File "/usr/lib/python3/dist-packages/nova/conductor/tasks/base.py", line 42, in execute
2021-03-04 12:30:31.958 46633 ERROR nova.conductor.manager     return self._execute()
2021-03-04 12:30:31.958 46633 ERROR nova.conductor.manager   File "/usr/lib/python3/dist-packages/nova/conductor/tasks/live_migrate.py", line 131, in _execute
2021-03-04 12:30:31.958 46633 ERROR nova.conductor.manager     consumer_generation=None)
2021-03-04 12:30:31.958 46633 ERROR nova.conductor.manager   File "/usr/lib/python3/dist-packages/nova/scheduler/utils.py", line 734, in claim_resources_on_destination
2021-03-04 12:30:31.958 46633 ERROR nova.conductor.manager     source_allocations[source_node.uuid]['resources']}
2021-03-04 12:30:31.958 46633 ERROR nova.conductor.manager KeyError: '9a09673b-6079-46e8-a7cd-4407991637bd'
2021-03-04 12:30:31.958 46633 ERROR nova.conductor.manager

Event Timeline

Closing as invalid for now, see T276449#6883228