It turns out the waiting for waiting for conductor is when the conductor is being upgraded.
The real bug was file injection was enabled by default in havana. It would silently error out when libguestfs isn't installed (as its not in in havana). but when we upgrade libguestfs get installed and nova dynamically loads it.
It turns out the waiting for waiting for conductor is when the conductor is being upgraded.
The real bug was file injection was enabled by default in havana. It would silently error out when libguestfs isn't installed (as its not in in havana). but when we upgrade libguestfs get installed and nova dynamically loads it.
2014-03-03 18:41:39.708 ERROR nova.virt. libvirt. driver [req-fc92fbbf- acd4-40a5- 8d74-a8bdd263c2 97 ServersTestManu alDisk- 834103425 ServersTestManu alDisk- 1514739295] [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] Error injecting data into image cf82ca56- 7fda-4e29- ae75-96be49f2a0 59 (Error mounting /opt/stack/ data/nova/ instances/ a9a923e6- 5748-465e- 8ad3-84077b1544 7e/disk with libguestfs (external command failed, see earlier error messages)) manager [req-fc92fbbf- acd4-40a5- 8d74-a8bdd263c2 97 ServersTestManu alDisk- 834103425 ServersTestManu alDisk- 1514739295] [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] Instance failed to spawn manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] Traceback (most recent call last): manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] File "/opt/stack/ old/nova/ nova/compute/ manager. py", line 1423, in _spawn manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] block_device_info) manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] File "/opt/stack/ old/nova/ nova/virt/ libvirt/ driver. py", line 2084, in spawn manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] admin_pass= admin_password) manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] File "/opt/stack/ old/nova/ nova/virt/ libvirt/ driver. py", line 2514, in _create_image manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] instance=instance) manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] File "/opt/stack/ old/nova/ nova/virt/ libvirt/ driver. py", line 2508, in _create_image manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] mandatory= ('files' ,)) manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] File "/opt/stack/ old/nova/ nova/virt/ disk/api. py", line 329, in inject_data manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] fs.setup() manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] File "/opt/stack/ old/nova/ nova/virt/ disk/vfs/ guestfs. py", line 129, in setup manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] {'imgfile': self.imgfile, 'e': e}) manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e] NovaException: Error mounting /opt/stack/ data/nova/ instances/ a9a923e6- 5748-465e- 8ad3-84077b1544 7e/disk with libguestfs (external command failed, see earlier error messages) manager [instance: a9a923e6- 5748-465e- 8ad3-84077b1544 7e]
2014-03-03 18:41:39.709 ERROR nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.
2014-03-03 18:41:39.709 6130 TRACE nova.compute.