[9.x][BVT] Deployment fails on execution of task openstack-network-networks
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Mirantis OpenStack |
Fix Released
|
Critical
|
Nikita Karpin |
Bug Description
9.x BVT builds currently fail with the following traceback:
2016-11-22 07:41:12 - ERROR decorators.py:126 -- Traceback (most recent call last):
File "/home/
result = func(*args, **kwargs)
File "/home/
self.
File "/home/
result = func(*args, **kwargs)
File "/home/
result = func(*args, **kwargs)
File "/home/
return func(*args, **kwargs)
File "/home/
result = func(*args, **kwargs)
File "/home/
return func(*args, **kwargs)
File "/home/
self.
File "/home/
result = func(*args, **kwargs)
File "/home/
task["name"], task['status'], 'ready', _message(task)
File "/home/
raise ASSERTION_
AssertionError: Task 'deploy' has incorrect status. error != ready, 'Deployment has failed. All nodes are finished. Failed tasks: Task[openstack-
e.g. https:/
this is due to the fact neutrona-api responds with 503:
503 Service Unavailable
The server is currently unavailable. Please try again at a later time.
Neutron server returns request_ids: ['req-bfc16ecf-
which is caused by keystone-api returning 401:
2016-11-22 07:39:14.140 6560 DEBUG keystoneauth.
2016-11-22 07:39:14.141 6560 WARNING keystonemiddlew
401, "title": "Unauthorized"}}
2016-11-22 07:39:14.142 6560 CRITICAL keystonemiddlew
2016-11-22 07:39:14.144 6560 INFO neutron.wsgi [-] 10.109.6.9 - - [22/Nov/2016 07:39:14] "GET /v2.0/subnets.json HTTP/1.1" 503 320 0.079793
which is caused by the fact domain Default does not exist:
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.648 23030 ERROR keystone.
2016-11-22 09:08:17.651 23030 WARNING keystone.
2016-11-22 09:08:23.703 23031 DEBUG keystone.
summary: |
[9.x][BVT] Deployment fails on execution of task openstack-network- - network/ + network |
summary: |
[9.x][BVT] Deployment fails on execution of task openstack-network- - network + networks |
Changed in mos: | |
assignee: | nobody → MOS Packaging Team (mos-packaging) |
Changed in mos: | |
milestone: | none → 9.2 |
Changed in mos: | |
assignee: | MOS Packaging Team (mos-packaging) → Nikita Karpin (mkarpin) |
tags: | added: swarm-blocker |
tags: | added: on-verification |
Ok, so domain actually exists, but it's id is `default` not `Default`:
http:// paste.openstack .org/show/ 590021/
When I change the case in neutron.conf and restart neutron-server it starts working correctly.
I checked my config on 9.0 environment and looks like it *used to* work with both lower case and upper case value there.
So at this point my understanding is that something changed in Keystone and now the look up is case sensitive.