[library] Neutron server is down after rollback: "Unable to load quantum from configuration file"

Bug #1364465 reported by Artem Panchenko
14
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Invalid
Medium
Unassigned
5.0.x
Won't Fix
Medium
Unassigned
5.1.x
Won't Fix
Medium
Unassigned
6.0.x
Won't Fix
Undecided
Unassigned

Bug Description

api: '1.0'
astute_sha: 78963a5415935f22e405e355d710fe92cee34331
auth_required: true
build_id: 2014-09-02_00-01-17
build_number: '492'
feature_groups:
- mirantis
fuellib_sha: 2cfa83119ae90b13a5bac6a844bdadfaf5aeb13f
fuelmain_sha: d99f32aa95f1ff4a071897eb7e7860b0b5739303
nailgun_sha: d8d2d3ced87bc1a0591989884559b8e5a5d247fe
ostf_sha: 4dcd99cc4bfa19f52d4b87ed321eb84ff03844da
production: docker
release: '5.1'

Steps to reproduce this issue:

1. Install Fuel 5.0, create new OS environment: CentOS, HA, NeutronGRE, Ceph for images, Sahara, Ceilometer
2. Add 1 controller+ceph, 1 controller+cinder, 1 controller+ceph, 2 compute+ceph, 2 compute+cinder, 1 cinder+mongo nodes
3. Deploy changes. Deployment is successful, cluster passes OSTF checks
4. Upgrade master node to 5.1 using tarball # 492
5. Update environment from 5.0 to 5.0.2. Update fails due to bug https://bugs.launchpad.net/fuel/+bug/1283062 (won't fix for 5.0.x)
6. Run rollback. Rollback to 5.0 finishes with success. Run OSTF

Expected result:

- Health checks are passed

Actual:

- most of checks (request list of networks, check network parameters or tests which create & launch new instance) fails

After investigation I found that neutron-server is down on all controllers and I can't start it manually due to the following error:

http://paste.openstack.org/show/104789/

After I restored old config file neutron-server successfully started:

http://paste.openstack.org/show/104798/

and health checks passed. Here is the content of broken api-paste.ini config file (after rollback):

http://paste.openstack.org/show/104800/

Link to the diagnostic snapshot: https://yadi.sk/d/LUo8fG3XatXR2

Changed in fuel:
status: New → Incomplete
status: Incomplete → Confirmed
importance: Undecided → High
Changed in fuel:
status: Confirmed → Incomplete
Changed in fuel:
status: Incomplete → Confirmed
assignee: Fuel Library Team (fuel-library) → Sergey Vasilenko (xenolog)
Revision history for this message
Vladimir Kuklin (vkuklin) wrote :

The problem is that 5.0.2 package does not contain api-paste.ini and it is not overwritten by puppet when doing rollback.

Revision history for this message
OSCI Robot (oscirobot) wrote :
Revision history for this message
OSCI Robot (oscirobot) wrote :
Revision history for this message
OSCI Robot (oscirobot) wrote :

Package neutron has been built from changeset: http://gerrit.mirantis.com/28136
RPM Repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1-stable-28136/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

Package neutron has been built from changeset: http://gerrit.mirantis.com/28134
RPM Repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0-stable-28134/centos

Mike Scherbakov (mihgen)
tags: added: experimental
Changed in fuel:
milestone: 5.1 → 5.1.1
Revision history for this message
Dmitry Mescheryakov (dmitrymex) wrote :

Removing 'In Progress' as Denis does not work on the fix currently

Changed in fuel:
status: In Progress → Confirmed
status: Confirmed → Triaged
Revision history for this message
Dmitry Mescheryakov (dmitrymex) wrote :

Also, lowering to medium, since the bug is in experimental feature

Changed in fuel:
importance: High → Medium
no longer affects: fuel/6.0.x
ruhe (ruhe)
Changed in fuel:
assignee: Denis Egorenko (degorenko) → nobody
assignee: nobody → Denis Egorenko (degorenko)
Revision history for this message
Denis Egorenko (degorenko) wrote :

As Vladimir Kuklin said the problem was that 5.0.2 package does not contained api-paste.ini and it was not overwritten by puppet when doing rollback. Now all packages in 6.x contain this file.

Changed in fuel:
assignee: Denis Egorenko (degorenko) → nobody
status: Triaged → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.