Can't create volume after scaling of the cluster with example plugin: volume service is down. (host: node-2.test.domain.local@LVM-backend)

Bug #1591164 reported by Vladimir Khlyunev
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Committed
Critical
Kyrylo Galanov
Mitaka
Fix Released
Critical
Maksim Malchuk

Bug Description

ISO 9.0mos-465
Snapshot https://product-ci.infra.mirantis.net/job/9.0.system_test.ubuntu.plugins.fuel_plugin_example/140/artifact/logs/fail_error_deploy_neutron_example_ha_add_node-fuel-snapshot-2016-06-10_09-49-17.tar.gz

Steps to reproduce:
1. Upload plugin to the master node
2. Install plugin
3. Create cluster
4. Add 1 node with controller role
5. Add 1 nodes with compute role
6. Add 1 nodes with cinder role
7. Deploy the cluster
8. Run network verification
9. Check plugin health
10. Add 2 nodes with controller role
11. Deploy cluster
12. Check plugin health
13. Run OSTF < 2 tests failed here

Actual result:
Volume can'n be created; in cinder logs:
http://paste.openstack.org/show/510523/

Revision history for this message
Bug Checker Bot (bug-checker) wrote : Autochecker

(This check performed automatically)
Please, make sure that bug description contains the following sections filled in with the appropriate data related to the bug you are describing:

expected result

For more detailed information on the contents of each of the listed sections see https://wiki.openstack.org/wiki/Fuel/How_to_contribute#Here_is_how_you_file_a_bug

tags: added: need-info
Changed in fuel:
assignee: Fuel Sustaining (fuel-sustaining-team) → Kyrylo Galanov (kgalanov)
Changed in fuel:
status: New → Confirmed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (stable/mitaka)

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/328321

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-library (stable/mitaka)

Change abandoned by Kyrylo Galanov (<email address hidden>) on branch: stable/mitaka
Review: https://review.openstack.org/328321

Changed in fuel:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/328332

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (stable/mitaka)

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/328400

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/328332
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=abbdb05648e73c0fafa937b878d965358d3871fb
Submitter: Jenkins
Branch: master

commit abbdb05648e73c0fafa937b878d965358d3871fb
Author: Kyrylo Galanov <email address hidden>
Date: Fri Jun 10 16:53:18 2016 +0200

    Enable cinder after after it was disabled

    Cinder is disabled during (re)deployment. Adjust YAQL expression
    similarly to deployment task.

    Change-Id: Idd238f17c672fa9ec4439dda5d3f73e26b2ab313
    Closes-bug: #1591164

Changed in fuel:
status: In Progress → Fix Committed
Changed in fuel:
milestone: 9.0 → 10.0
tags: added: swarm-fail
Revision history for this message
Maksim Malchuk (mmalchuk) wrote :

I think this should be fit to RC2 (merged) because it fails the swarm, and can be reproduced on redeploy.

Revision history for this message
Sergey Shevorakov (sshevorakov) wrote :

Maksim, we merge only fixes for the Crits after HCF.
Swarm fail does not count here.
In case if we need to have it merged it should be raised to Crit, but(!) there should be a comprehensive explanation why it should be promoted to Crit.

Revision history for this message
Maksim Malchuk (mmalchuk) wrote :

@Sergey Shevorakov, I understand, also, as you can see, I moved this bug to 9.0-updates, but so many people ask me why we didn't merge this fix.

Revision history for this message
Timur Nurlygayanov (tnurlygayanov) wrote :

The importance of the issue changed to Critical accordingly to discussion in mos-dev email thread "9.0 QA blockers". Please merge the fix before we will build MOS 9.0 RC2.

Thank you!

Changed in fuel:
importance: High → Critical
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (stable/mitaka)

Reviewed: https://review.openstack.org/328400
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=66031790d5275a6d38df814860008a74d2cf46de
Submitter: Jenkins
Branch: stable/mitaka

commit 66031790d5275a6d38df814860008a74d2cf46de
Author: Kyrylo Galanov <email address hidden>
Date: Fri Jun 10 16:53:18 2016 +0200

    Enable cinder after after it was disabled

    Cinder is disabled during (re)deployment. Adjust YAQL expression
    similarly to deployment task.

    Change-Id: Idd238f17c672fa9ec4439dda5d3f73e26b2ab313
    Closes-bug: #1591164

tags: added: area-library team-bugfix
Revision history for this message
Maksim Malchuk (mmalchuk) wrote :

RCA: The regression was added after implementing the YAQL conditional in the tasks.

The first commit to move all conditionals in tasks to YAQL:
 - https://review.openstack.org/#/q/I3401e3127efc3e0c9ebc1be30f5f097575ca5890,n,z
Partially regression (for cinder) were fixed in the next commits:
 - https://review.openstack.org/#/q/I7549864ee376390412a587bea2b9c48f23ba5a88,n,z
And the latest commits wich didn't fix the regression:
 - https://review.openstack.org/#/q/I9c50339474e84faa644cfe652a4d014b1ada2101,n,z

tags: added: on-verification
Revision history for this message
Ekaterina Shutova (eshutova) wrote :

Used scenario from description.
Ostf tests for volumes are passed.

Verified on:
cat /etc/fuel_build_id:
 497
cat /etc/fuel_build_number:
 497
cat /etc/fuel_release:
 9.0
cat /etc/fuel_openstack_version:
 mitaka-9.0

tags: removed: on-verification
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.