Page MenuHomePhabricator
Paste P8649

libvirt failure on cloudvirt1015
ActivePublic

Authored by Andrew on Jun 24 2019, 6:32 PM.
Tags
None
Referenced Files
F29632050: raw.txt
Jun 24 2019, 6:32 PM
Subscribers
None
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher [req-113aafde-3eae-4311-a89a-f068e9661763 novaadmin admin - - -] Exception during message handling: internal error: process exited while connecting to monitor: 2019-06-24T18:24:33.645499Z qemu-system-x86_64: Property '.md-clear' not found
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last):
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher incoming.message))
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher return self._do_dispatch(endpoint, method, ctxt, args)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher result = func(ctxt, **new_args)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 110, in wrapped
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher payload)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher self.force_reraise()
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 89, in wrapped
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher return f(self, context, *args, **kw)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 359, in decorated_function
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher LOG.warning(msg, e, instance=instance)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher self.force_reraise()
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 328, in decorated_function
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 409, in decorated_function
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 387, in decorated_function
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher kwargs['instance'], e, sys.exc_info())
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher self.force_reraise()
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 375, in decorated_function
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2606, in start_instance
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher self._power_on(context, instance)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2579, in _power_on
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher block_device_info)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2621, in power_on
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher self._hard_reboot(context, instance, network_info, block_device_info)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2512, in _hard_reboot
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher vifs_already_plugged=True)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4924, in _create_domain_and_network
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher xml, pause=pause, power_on=power_on)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4855, in _create_domain
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher guest.launch(pause=pause)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/guest.py", line 142, in launch
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher self._encoded_xml, errors='ignore')
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher self.force_reraise()
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/guest.py", line 137, in launch
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher return self._domain.createWithFlags(flags)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 186, in doit
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher result = proxy_call(self._autowrap, f, *args, **kwargs)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 144, in proxy_call
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher rv = execute(f, *args, **kwargs)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 125, in execute
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher six.reraise(c, e, tb)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 83, in tworker
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher rv = meth(*args, **kwargs)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/libvirt.py", line 1065, in createWithFlags
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self)
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher libvirtError: internal error: process exited while connecting to monitor: 2019-06-24T18:24:33.645499Z qemu-system-x86_64: Property '.md-clear' not found
2019-06-24 18:24:33.972 34835 ERROR oslo_messaging.rpc.dispatcher
2019-06-24 18:24:46.918 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Auditing locally available compute resources for node cloudvirt1015.eqiad.wmnet
2019-06-24 18:24:50.763 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Total usable vcpus: 72, total allocated vcpus: 24
2019-06-24 18:24:50.764 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Final resource view: name=cloudvirt1015.eqiad.wmnet phys_ram=515916MB used_ram=49664MB phys_disk=5864GB used_disk=480GB total_vcpus=72 used_vcpus=24 pci_stats=[]
2019-06-24 18:24:50.781 34835 WARNING nova.rpc [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] compute.metrics.update is not a versioned notification and not whitelisted. See ./doc/source/notification.rst
2019-06-24 18:24:50.849 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Compute_service record updated for cloudvirt1015:cloudvirt1015.eqiad.wmnet
2019-06-24 18:25:47.454 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Auditing locally available compute resources for node cloudvirt1015.eqiad.wmnet
2019-06-24 18:25:51.187 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Total usable vcpus: 72, total allocated vcpus: 24
2019-06-24 18:25:51.188 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Final resource view: name=cloudvirt1015.eqiad.wmnet phys_ram=515916MB used_ram=49664MB phys_disk=5864GB used_disk=480GB total_vcpus=72 used_vcpus=24 pci_stats=[]
2019-06-24 18:25:51.204 34835 WARNING nova.rpc [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] compute.metrics.update is not a versioned notification and not whitelisted. See ./doc/source/notification.rst
2019-06-24 18:25:51.274 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Compute_service record updated for cloudvirt1015:cloudvirt1015.eqiad.wmnet
2019-06-24 18:26:48.909 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Auditing locally available compute resources for node cloudvirt1015.eqiad.wmnet
2019-06-24 18:26:52.682 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Total usable vcpus: 72, total allocated vcpus: 24
2019-06-24 18:26:52.683 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Final resource view: name=cloudvirt1015.eqiad.wmnet phys_ram=515916MB used_ram=49664MB phys_disk=5864GB used_disk=480GB total_vcpus=72 used_vcpus=24 pci_stats=[]
2019-06-24 18:26:52.698 34835 WARNING nova.rpc [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] compute.metrics.update is not a versioned notification and not whitelisted. See ./doc/source/notification.rst
2019-06-24 18:26:52.765 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Compute_service record updated for cloudvirt1015:cloudvirt1015.eqiad.wmnet
2019-06-24 18:27:49.442 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Auditing locally available compute resources for node cloudvirt1015.eqiad.wmnet
2019-06-24 18:27:53.005 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Total usable vcpus: 72, total allocated vcpus: 24
2019-06-24 18:27:53.006 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Final resource view: name=cloudvirt1015.eqiad.wmnet phys_ram=515916MB used_ram=49664MB phys_disk=5864GB used_disk=480GB total_vcpus=72 used_vcpus=24 pci_stats=[]
2019-06-24 18:27:53.023 34835 WARNING nova.rpc [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] compute.metrics.update is not a versioned notification and not whitelisted. See ./doc/source/notification.rst
2019-06-24 18:27:53.090 34835 INFO nova.compute.resource_tracker [req-fa3e153c-a142-4dd1-9116-31a0886e912f - - - - -] Compute_service record updated for cloudvirt1015:cloudvirt1015.eqiad.wmnet
2019-06-24 18:28:16.690 34835 INFO nova.compute.claims [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] Attempting claim: memory 2048 MB, disk 20 GB, vcpus 1 CPU
2019-06-24 18:28:16.691 34835 INFO nova.compute.claims [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] Total memory: 515916 MB, used: 49664.00 MB
2019-06-24 18:28:16.691 34835 INFO nova.compute.claims [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] memory limit: 515916.00 MB, free: 466252.00 MB
2019-06-24 18:28:16.692 34835 INFO nova.compute.claims [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] Total disk: 5864 GB, used: 480.00 GB
2019-06-24 18:28:16.693 34835 INFO nova.compute.claims [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] disk limit not specified, defaulting to unlimited
2019-06-24 18:28:16.694 34835 INFO nova.compute.claims [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] Total vcpu: 72 VCPU, used: 24.00 VCPU
2019-06-24 18:28:16.694 34835 INFO nova.compute.claims [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] vcpu limit not specified, defaulting to unlimited
2019-06-24 18:28:16.732 34835 INFO nova.compute.claims [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] Claim successful
2019-06-24 18:28:17.330 34835 INFO nova.virt.libvirt.driver [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] Creating image
2019-06-24 18:28:18.874 34835 ERROR nova.virt.libvirt.guest [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] Error launching a defined domain with XML: <domain type='kvm'>
<name>i-00009399</name>
<uuid>8d4afad9-0f6e-42b7-b9a3-7e195efebeb7</uuid>
<metadata>
<nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.0">
<nova:package version="13.1.0"/>
<nova:name>launchtest</nova:name>
<nova:creationTime>2019-06-24 18:28:18</nova:creationTime>
<nova:flavor name="m1.small">
<nova:memory>2048</nova:memory>
<nova:disk>20</nova:disk>
<nova:swap>0</nova:swap>
<nova:ephemeral>0</nova:ephemeral>
<nova:vcpus>1</nova:vcpus>
</nova:flavor>
<nova:owner>
<nova:user uuid="novaadmin">Novaadmin</nova:user>
<nova:project uuid="testlabs">testlabs</nova:project>
</nova:owner>
<nova:root type="image" uuid="10783e59-b30e-4426-b509-2fbef7d3103c"/>
</nova:instance>
</metadata>
<memory unit='KiB'>2097152</memory>
<currentMemory unit='KiB'>2097152</currentMemory>
<vcpu placement='static'>1</vcpu>
<cputune>
<shares>1024</shares>
</cputune>
<sysinfo type='smbios'>
<system>
<entry name='manufacturer'>OpenStack Foundation</entry>
<entry name='product'>OpenStack Nova</entry>
<entry name='version'>13.1.0</entry>
<entry name='serial'>1e617372-39d8-419b-9e22-26d6fbe59950</entry>
<entry name='uuid'>8d4afad9-0f6e-42b7-b9a3-7e195efebeb7</entry>
<entry name='family'>Virtual Machine</entry>
</system>
</sysinfo>
<os>
<type arch='x86_64' machine='pc-i440fx-2.8'>hvm</type>
<boot dev='hd'/>
<smbios mode='sysinfo'/>
</os>
<features>
<acpi/>
<apic/>
</features>
<cpu mode='host-model'>
<model fallback='allow'/>
<topology sockets='1' cores='1' threads='1'/>
</cpu>
<clock offset='utc'>
<timer name='pit' tickpolicy='delay'/>
<timer name='rtc' tickpolicy='catchup'/>
<timer name='hpet' present='no'/>
</clock>
<on_poweroff>destroy</on_poweroff>
<on_reboot>restart</on_reboot>
<on_crash>destroy</on_crash>
<devices>
<emulator>/usr/bin/kvm</emulator>
<disk type='file' device='disk'>
<driver name='qemu' type='qcow2' cache='none'/>
<source file='/var/lib/nova/instances/8d4afad9-0f6e-42b7-b9a3-7e195efebeb7/disk'/>
<target dev='vda' bus='virtio'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
</disk>
<controller type='usb' index='0' model='piix3-uhci'>
<address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/>
</controller>
<controller type='pci' index='0' model='pci-root'/>
<controller type='virtio-serial' index='0'>
<address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
</controller>
<interface type='bridge'>
<mac address='fa:16:3e:43:5c:1e'/>
<source bridge='brq7425e328-56'/>
<target dev='tap8dab785b-22'/>
<model type='virtio'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
</interface>
<serial type='file'>
<source path='/var/lib/nova/instances/8d4afad9-0f6e-42b7-b9a3-7e195efebeb7/console.log'/>
<target port='0'/>
</serial>
<serial type='pty'>
<target port='1'/>
</serial>
<console type='file'>
<source path='/var/lib/nova/instances/8d4afad9-0f6e-42b7-b9a3-7e195efebeb7/console.log'/>
<target type='serial' port='0'/>
</console>
<channel type='pty'>
<target type='virtio' name='com.redhat.spice.0'/>
<address type='virtio-serial' controller='0' bus='0' port='1'/>
</channel>
<input type='mouse' bus='ps2'/>
<input type='keyboard' bus='ps2'/>
<graphics type='spice' autoport='yes' listen='0.0.0.0' keymap='en-us'>
<listen type='address' address='0.0.0.0'/>
</graphics>
<video>
<model type='qxl' ram='65536' vram='65536' vgamem='16384' heads='1' primary='yes'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
</video>
<memballoon model='virtio'>
<stats period='10'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
</memballoon>
</devices>
</domain>
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] Instance failed to spawn
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] Traceback (most recent call last):
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2218, in _build_resources
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] yield resources
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2064, in _build_and_run_instance
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] block_device_info=block_device_info)
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2780, in spawn
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] block_device_info=block_device_info)
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4924, in _create_domain_and_network
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] xml, pause=pause, power_on=power_on)
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4855, in _create_domain
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] guest.launch(pause=pause)
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/guest.py", line 142, in launch
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] self._encoded_xml, errors='ignore')
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] self.force_reraise()
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] six.reraise(self.type_, self.value, self.tb)
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/guest.py", line 137, in launch
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] return self._domain.createWithFlags(flags)
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 186, in doit
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] result = proxy_call(self._autowrap, f, *args, **kwargs)
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 144, in proxy_call
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] rv = execute(f, *args, **kwargs)
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 125, in execute
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] six.reraise(c, e, tb)
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 83, in tworker
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] rv = meth(*args, **kwargs)
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] File "/usr/lib/python2.7/dist-packages/libvirt.py", line 1065, in createWithFlags
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self)
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] libvirtError: internal error: process exited while connecting to monitor: w -global kvm-pit.lost_tick_policy=delay -no-hpet -no-shutdown -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device virtio-serial-pci,id=virtio-serial0,bus=pci.0,addr=0x4 -drive file=/var/lib/nova/instances/8d4afad9-0f6e-42b7-b9a3-7e195efebeb7/disk,format=qcow2,if=none,id=drive-virtio-disk0,cache=none -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x5,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -netdev tap,fd=36,id=hostnet0,vhost=on,vhostfd=38 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=fa:16:3e:43:5c:1e,bus=pci.0,addr=0x3 -add-fd set=2,fd=40 -chardev file,id=charserial0,path=/dev/fdset/2,append=on -device isa-serial,chardev=charserial0,id=serial0 -chardev pty,id=charserial1 -device isa-serial,chardev=charserial1,id=serial1 -chardev pty,id=charchannel0 -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.spice.0 -spice port=5911,addr=0.0.0.0,disable-ticketing,seamless-migration=on
2019-06-24 18:28:18.876 34835 ERROR nova.compute.manager [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7]
2019-06-24 18:28:18.878 34835 INFO nova.compute.manager [req-d8024b95-3772-4aa8-b81d-d585ff700abd novaadmin testlabs - - -] [instance: 8d4afad9-0f6e-42b7-b9a3-7e195efebeb7] Terminating instance