Incorrect Cinder configuration with Ceph backend

Bug #1585115 reported by Ivan Kolodyazhny
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Committed
High
Alexey Deryugin
Mitaka
Fix Released
High
Denis Egorenko
Newton
Fix Committed
High
Alexey Deryugin

Bug Description

Steps to reproduce:
1. Deploy MOS with Ceph Cinder backend and 2+ controllers.

Expected result:
On each controller, we should have the same 'host' option in /etc/cinder/cinder.conf.

Actual result:
'host' option is not set, Cinder has different backup and volume services to manage the same backend:
+------------------+--------------------------+------+---------+-------+----------------------------+-----------------+
| Binary | Host | Zone | Status | State | Updated_at | Disabled Reason |
+------------------+--------------------------+------+---------+-------+----------------------------+-----------------+
| cinder-backup | node-1.test.domain.local | nova | enabled | up | 2016-05-23T22:29:39.000000 | - |
| cinder-backup | node-3.test.domain.local | nova | enabled | up | 2016-05-23T22:29:38.000000 | - |
| cinder-scheduler | node-1.test.domain.local | nova | enabled | up | 2016-05-23T22:29:33.000000 | - |
| cinder-scheduler | node-3.test.domain.local | nova | enabled | up | 2016-05-23T22:29:34.000000 | - |
| cinder-volume | node-1.test.domain.local | nova | enabled | up | 2016-05-23T22:29:39.000000 | - |
| cinder-volume | node-3.test.domain.local | nova | enabled | up | 2016-05-23T22:29:40.000000 | - |
+------------------+--------------------------+------+---------+-------+----------------------------+-----------------+

tags: added: area-library
Revision history for this message
Denis Egorenko (degorenko) wrote :

Ivan, we have this patch: https://review.openstack.org/#/c/231068/

Looks like this option was deprecated in Kilo. Now we need to add backend_host option.

Can you please clarify this moment?

Revision history for this message
Denis Egorenko (degorenko) wrote :

This problem is caused by this commit: https://review.openstack.org/#/c/294736/ which missed another commit https://review.openstack.org/#/c/300573

We need to re-upload 300573 to master and mitaka.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/322775

Changed in fuel:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/322775
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=1c920488e7c1c00b4df815974458cca638af7952
Submitter: Jenkins
Branch: master

commit 1c920488e7c1c00b4df815974458cca638af7952
Author: Denis Egorenko <email address hidden>
Date: Mon May 30 14:26:20 2016 +0300

    Configure Cinder backend sections for controllers

    In case when Ceph role is not on controller, we have wrong cinder
    configuration on controllers with wrong backend section name.

    Change-Id: I9532b6d235ed80e7e62b5b04c0c98c993a21706f
    Closes-bug: #1585115

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (stable/mitaka)

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/323486

Dmitry Pyzhov (dpyzhov)
tags: removed: area-library
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (stable/mitaka)

Reviewed: https://review.openstack.org/323486
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=08faa6d6f24a0d218e80334eb35ac980eff17e54
Submitter: Jenkins
Branch: stable/mitaka

commit 08faa6d6f24a0d218e80334eb35ac980eff17e54
Author: Denis Egorenko <email address hidden>
Date: Mon May 30 14:26:20 2016 +0300

    Configure Cinder backend sections for controllers

    In case when Ceph role is not on controller, we have wrong cinder
    configuration on controllers with wrong backend section name.

    Change-Id: I9532b6d235ed80e7e62b5b04c0c98c993a21706f
    Closes-bug: #1585115
    (cherry picked from commit 1c920488e7c1c00b4df815974458cca638af7952)

Revision history for this message
Denis Egorenko (degorenko) wrote :

Master commit was reverted because of outdated packages, should be fixed when MOS 10.0 packages will be updated.

tags: added: on-verification
Revision history for this message
Sofiia Andriichenko (sandriichenko) wrote :

verified on:
[root@nailgun ~]# shotgun2 short-report
cat /etc/fuel_build_id:
481
cat /etc/fuel_build_number:
481
cat /etc/fuel_release:
9.0
cat /etc/fuel_openstack_version:
mitaka-9.0
rpm -qa | egrep 'fuel|astute|network-checker|nailgun|packetary|shotgun':
fuel-release-9.0.0-1.mos6349.noarch
fuel-misc-9.0.0-1.mos8458.noarch
python-packetary-9.0.0-1.mos140.noarch
fuel-bootstrap-cli-9.0.0-1.mos285.noarch
fuel-migrate-9.0.0-1.mos8458.noarch
rubygem-astute-9.0.0-1.mos750.noarch
fuel-mirror-9.0.0-1.mos140.noarch
shotgun-9.0.0-1.mos90.noarch
fuel-openstack-metadata-9.0.0-1.mos8742.noarch
fuel-notify-9.0.0-1.mos8458.noarch
nailgun-mcagents-9.0.0-1.mos750.noarch
python-fuelclient-9.0.0-1.mos325.noarch
fuel-9.0.0-1.mos6349.noarch
fuel-utils-9.0.0-1.mos8458.noarch
fuel-setup-9.0.0-1.mos6349.noarch
fuel-provisioning-scripts-9.0.0-1.mos8742.noarch
fuel-library9.0-9.0.0-1.mos8458.noarch
network-checker-9.0.0-1.mos74.x86_64
fuel-agent-9.0.0-1.mos285.noarch
fuel-ui-9.0.0-1.mos2717.noarch
fuel-ostf-9.0.0-1.mos936.noarch
fuelmenu-9.0.0-1.mos274.noarch
fuel-nailgun-9.0.0-1.mos8742.noarch

tags: removed: on-verification
tags: added: on-verification
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/331413

Changed in fuel:
status: Confirmed → In Progress
tags: removed: on-verification
tags: added: 10.0-reviewed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/331413
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=3852d50ebcbde09614823a6cdf0b324174aeb960
Submitter: Jenkins
Branch: master

commit 3852d50ebcbde09614823a6cdf0b324174aeb960
Author: Denis Egorenko <email address hidden>
Date: Mon May 30 14:26:20 2016 +0300

    Configure Cinder backend sections for controllers

    In case when Ceph role is not on controller, we have wrong cinder
    configuration on controllers with wrong backend section name.

    Change-Id: I0968b97dd9fc58b91a8ea85a548fe9f472152279
    Closes-bug: #1585115

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/344717

Changed in fuel:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/344717
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=446c6fdf829a43ae8704b76ce8d8b3318102a371
Submitter: Jenkins
Branch: master

commit 446c6fdf829a43ae8704b76ce8d8b3318102a371
Author: Alexey Deryugin <email address hidden>
Date: Wed Jul 20 13:25:33 2016 +0300

    Configure Cinder backend sections for controllers

    In case when Ceph role is not on controller, we have wrong cinder
    configuration on controllers with wrong backend section name.

    Also we need to restart cinder-volume after Ceph keyring creation
    to prevent failures with multiple controllers.

    Change-Id: I8796935d44bd32589653893bfcc00b44cce3ab4e
    Closes-bug: #1585115
    Related-Bug: #1604342

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/fuel-library 10.0.0rc1

This issue was fixed in the openstack/fuel-library 10.0.0rc1 release candidate.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/fuel-library 10.0.0

This issue was fixed in the openstack/fuel-library 10.0.0 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.