2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher [req-113aafde-3eae-4311-a89a-f068e9661763 novaadmin admin - - -] Exception during message handling: internal error: process exited while connecting to monitor: 2019-06-24T18:24:33.645499Z qemu-system-x86_64: Property '.md-clear' not found 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last): 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher incoming.message)) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher return self._do_dispatch(endpoint, method, ctxt, args) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher result = func(ctxt, **new_args) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 110, in wrapped 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher payload) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher self.force_reraise() 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 89, in wrapped 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher return f(self, context, *args, **kw) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 359, in decorated_function 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher LOG.warning(msg, e, instance=instance) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher self.force_reraise() 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 328, in decorated_function 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher return function(self, context, *args, **kwargs) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 409, in decorated_function 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher return function(self, context, *args, **kwargs) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 387, in decorated_function 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher kwargs['instance'], e, sys.exc_info()) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher self.force_reraise() 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 375, in decorated_function 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher return function(self, context, *args, **kwargs) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2606, in start_instance 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher self._power_on(context, instance) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2579, in _power_on 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher block_device_info) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2621, in power_on 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher self._hard_reboot(context, instance, network_info, block_device_info) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2512, in _hard_reboot 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher vifs_already_plugged=True) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4924, in _create_domain_and_network 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher xml, pause=pause, power_on=power_on) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4855, in _create_domain 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher guest.launch(pause=pause) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/guest.py", line 142, in launch 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher self._encoded_xml, errors='ignore') 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__ 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher self.force_reraise() 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/guest.py", line 137, in launch 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher return self._domain.createWithFlags(flags) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 186, in doit 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher result = proxy_call(self._autowrap, f, *args, **kwargs) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 144, in proxy_call 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher rv = execute(f, *args, **kwargs) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 125, in execute 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher six.reraise(c, e, tb) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 83, in tworker 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher rv = meth(*args, **kwargs) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/libvirt.py", line 1065, in createWithFlags 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self) 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher libvirtError: internal error: process exited while connecting to monitor: 2019-06-24T18:24:33.645499Z qemu-system-x86_64: Property '.md-clear' not found 2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher 2019-06-24 18:24:46.918 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Auditing locally available compute resources for node cloudvirt1015.eqiad.wmnet 2019-06-24 18:24:50.763 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Total usable vcpus: 72, total allocated vcpus: 24 2019-06-24 18:24:50.764 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Final resource view: name=cloudvirt1015.eqiad.wmnet phys_ram=515916MB used_ram=49664MB phys_disk=5864GB used_disk=480GB total_vcpus=72 used_vcpus=24 pci_stats=[] 2019-06-24 18:24:50.781 34835 WARNING nova.rpc [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] compute.metrics.update is not a versioned notification and not whitelisted. See ./doc/source/notification.rst 2019-06-24 18:24:50.849 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Compute_service record updated for cloudvirt1015:cloudvirt1015.eqiad.wmnet 2019-06-24 18:25:47.454 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Auditing locally available compute resources for node cloudvirt1015.eqiad.wmnet 2019-06-24 18:25:51.187 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Total usable vcpus: 72, total allocated vcpus: 24 2019-06-24 18:25:51.188 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Final resource view: name=cloudvirt1015.eqiad.wmnet phys_ram=515916MB used_ram=49664MB phys_disk=5864GB used_disk=480GB total_vcpus=72 used_vcpus=24 pci_stats=[] 2019-06-24 18:25:51.204 34835 WARNING nova.rpc [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] compute.metrics.update is not a versioned notification and not whitelisted. See ./doc/source/notification.rst 2019-06-24 18:25:51.274 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Compute_service record updated for cloudvirt1015:cloudvirt1015.eqiad.wmnet 2019-06-24 18:26:48.909 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Auditing locally available compute resources for node cloudvirt1015.eqiad.wmnet 2019-06-24 18:26:52.682 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Total usable vcpus: 72, total allocated vcpus: 24 2019-06-24 18:26:52.683 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Final resource view: name=cloudvirt1015.eqiad.wmnet phys_ram=515916MB used_ram=49664MB phys_disk=5864GB used_disk=480GB total_vcpus=72 used_vcpus=24 pci_stats=[] 2019-06-24 18:26:52.698 34835 WARNING nova.rpc [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] compute.metrics.update is not a versioned notification and not whitelisted. See ./doc/source/notification.rst 2019-06-24 18:26:52.765 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Compute_service record updated for cloudvirt1015:cloudvirt1015.eqiad.wmnet 2019-06-24 18:27:49.442 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Auditing locally available compute resources for node cloudvirt1015.eqiad.wmnet 2019-06-24 18:27:53.005 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Total usable vcpus: 72, total allocated vcpus: 24 2019-06-24 18:27:53.006 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Final resource view: name=cloudvirt1015.eqiad.wmnet phys_ram=515916MB used_ram=49664MB phys_disk=5864GB used_disk=480GB total_vcpus=72 used_vcpus=24 pci_stats=[] 2019-06-24 18:27:53.023 34835 WARNING nova.rpc [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] compute.metrics.update is not a versioned notification and not whitelisted. See ./doc/source/notification.rst 2019-06-24 18:27:53.090 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Compute_service record updated for cloudvirt1015:cloudvirt1015.eqiad.wmnet 2019-06-24 18:28:16.690 34835 INFO nova.compute.claims [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] Attempting claim: memory 2048 MB, disk 20 GB, vcpus 1 CPU 2019-06-24 18:28:16.691 34835 INFO nova.compute.claims [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] Total memory: 515916 MB, used: 49664.00 MB 2019-06-24 18:28:16.691 34835 INFO nova.compute.claims [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] memory limit: 515916.00 MB, free: 466252.00 MB 2019-06-24 18:28:16.692 34835 INFO nova.compute.claims [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] Total disk: 5864 GB, used: 480.00 GB 2019-06-24 18:28:16.693 34835 INFO nova.compute.claims [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] disk limit not specified, defaulting to unlimited 2019-06-24 18:28:16.694 34835 INFO nova.compute.claims [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] Total vcpu: 72 VCPU, used: 24.00 VCPU 2019-06-24 18:28:16.694 34835 INFO nova.compute.claims [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] vcpu limit not specified, defaulting to unlimited 2019-06-24 18:28:16.732 34835 INFO nova.compute.claims [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] Claim successful 2019-06-24 18:28:17.330 34835 INFO nova.virt.libvirt.driver [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] Creating image 2019-06-24 18:28:18.874 34835 ERROR nova.virt.libvirt.guest [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] Error launching a defined domain with XML: i-00009399 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7 launchtest 2019-06-24 18:28:18 2048 20 0 0 1 Novaadmin testlabs 2097152 2097152 1 1024 OpenStack Foundation OpenStack Nova 13.1.0 1e617372-39d8-419b-9e22-26d6fbe59950 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7 Virtual Machine hvm destroy restart destroy /usr/bin/kvm