Deployment with Sahara fails on controller node: 'Could not evaluate: The server returned status 400'

Bug #1461852 reported by Artem Panchenko
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Committed
High
Denis Egorenko
6.1.x
Fix Committed
High
Denis Egorenko
7.0.x
Invalid
Medium
MOS Sahara

Bug Description

Fuel version info (6.1 custom build #1339): http://paste.openstack.org/show/262089/

Environment deployment failed because puppet returned errors while deploying 'sahara.pp' task:

'Deployment has failed. Method granular_deploy. Deployment failed on nodes 13.
Inspect Astute logs for the details'

http://paste.openstack.org/show/262088/

Steps to reproduce:

1. Create environment: Ubuntu, NeutronGre, Shara, Murano, Ceilometer, Classic provisioning
2. Add 3 controllers, 3 compute+cinder and 3 mongo+cinder nodes
3. Deploy changes

Expected result:

- cluster is deployed and passes health checks

Actual:

- deployment failed on 1 controller (see error from puppet logs above)

I got this error on bare-metal lab. Environment re-deployment was successful, so I believe the issue is floating and has medium priority. Diagnostic snapshot (env ID 2, nodes: 1,4,7,8,9,11,12,13,15): https://drive.google.com/file/d/0BzaZINLQ8-xkWlJNcDByeFgzTlk/view?usp=sharing

Tags: sahara
ruhe (ruhe)
no longer affects: fuel/6.0.x
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to fuel-library (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/188507

Revision history for this message
Denis Egorenko (degorenko) wrote :

I can't reproduce this bug.

Sahara logs have next errors:

./node-13.mirantis.com/sahara-all.log:2015-06-03T22:46:54.969494+00:00 debug: Validation Error occurred: error_code=400, error_message=Floating IP pool f1956e15-92f6-4b60-b831-7294f8b87632 for node group 'hdp-2-0-worker' not found, error_name=INVALID_REFERENCE

Id of external network is right. Neutron response for networks requests is 200. Actually, sahara has 8 node-group-template, but this error got 3 of them.

Also, as fix for this bug, i think, can be creating of templates only on primary controller.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/188507
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=b8c507a1a59b2b214c9004ac10ecd57acc139a17
Submitter: Jenkins
Branch: master

commit b8c507a1a59b2b214c9004ac10ecd57acc139a17
Author: Denis Egorenko <email address hidden>
Date: Thu Jun 4 19:21:18 2015 +0300

    Run creating of Sahara templates only on primary controller

    Sahara templates creating is running on every controller node - it's
    absolutely wrong. It should be run only on primary-controller node.

    Change-Id: I9f8962c2aa9af54f78330d5017c19a6e56de692e
    Related-bug: #1461852

Revision history for this message
Dmitry Mescheryakov (dmitrymex) wrote :

We think that patch above fix the issue, hence moving to fix committed.

Revision history for this message
Dmitry Mescheryakov (dmitrymex) wrote :

Also, the bug is fixed before 6.1 was branched out from master, hence it is invalid for 7.0.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.