Fuel for OpenStack

[puppet-glance] No option 'auth_address' in section: 'image_format'

Bug #1540890 reported by Michal Skalski on 2016-02-02

This bug affects 1 person

	Status	Importance	Assigned to	Milestone
Fuel for OpenStack	Fix Released	High	Denis Egorenko	Fuel for OpenStack 8.0
6.1.x	Won't Fix	High	Denis Puchkin	Fuel for OpenStack 6.1-updates
7.0.x	Fix Released	High	Denis Puchkin	Fuel for OpenStack 7.0-mu-3

Bug Description

VERSION:
  feature_groups:
    - mirantis
  production: "docker"
  release: "8.0"
  api: "1.0"
  build_number: "510"
  build_id: "510"
  fuel-nailgun_sha: "41170db11c366af5fe04c1c539c11b2e3e388ef9"
  python-fuelclient_sha: "4f234669cfe88a9406f4e438b1e1f74f1ef484a5"
  fuel-agent_sha: "658be72c4b42d3e1436b86ac4567ab914bfb451b"
  fuel-nailgun-agent_sha: "b2bb466fd5bd92da614cdbd819d6999c510ebfb1"
  astute_sha: "b81577a5b7857c4be8748492bae1dec2fa89b446"
  fuel-library_sha: "ec7e212972ead554f21b52b9e165156665f659df"
  fuel-ostf_sha: "5fe41945c2a49f26c849df1fd46329f6db1ab6b0"
  fuel-mirror_sha: "351d568fa3b3e4dd062054b91d766aa54d379867"
  fuelmenu_sha: "234cb4cbb30fbd2df00f388c28f31606d9cae15f"
  shotgun_sha: "63645dea384a37dde5c01d4f8905566978e5d906"
  network-checker_sha: "a43cf96cd9532f10794dce736350bf5bed350e9d"
  fuel-upgrade_sha: "616a7490ec7199f69759e97e42f9b97dfc87e85b"
  fuelmain_sha: "94507c5e4dad6d8cfbd8f5d41aa8389d5335990a"

Environment:
1 x Controller
3 x Compute, ceph-osd
Options enabled:
- Ceph RBD for volumes (Cinder)
- Ceph RadosGW for objects (Swift API)

Deployment failed on task:

uids:
- '2'
parameters:
  retries: 3
  cmd: ruby /etc/puppet/modules/osnailyfacter/modular/astute/upload_cirros.rb
  cwd: /
  timeout: 180
  interval: 20
priority: 1600
fail_on_error: true
type: shell
id: upload_cirros

/var/log/glance/glance-api.log:

2016-02-02 00:22:01.560 18650 ERROR glance_store._drivers.swift.utils [-] Invalid format of swift store configcfg
2016-02-02 00:22:01.560 18650 ERROR glance_store._drivers.swift.utils Traceback (most recent call last):
2016-02-02 00:22:01.560 18650 ERROR glance_store._drivers.swift.utils File "/usr/lib/python2.7/dist-packages/glance_store/_drivers/swift/utils.py", line 126, in _load_config
2016-02-02 00:22:01.560 18650 ERROR glance_store._drivers.swift.utils reference[param] = CONFIG.get(ref, param)
2016-02-02 00:22:01.560 18650 ERROR glance_store._drivers.swift.utils File "/usr/lib/python2.7/ConfigParser.py", line 618, in get
2016-02-02 00:22:01.560 18650 ERROR glance_store._drivers.swift.utils raise NoOptionError(option, section)
2016-02-02 00:22:01.560 18650 ERROR glance_store._drivers.swift.utils NoOptionError: No option 'auth_address' in section: 'matchmaker_ring'

root@node-1:~# grep ^[^#] /etc/glance/glance-api.conf
[DEFAULT]
show_image_direct_url = False
bind_host = 192.168.0.3
bind_port = 9292
workers = 2
backlog = 4096
image_cache_dir = /var/lib/glance/image-cache
registry_host = 192.168.0.2
registry_port = 9191
auth_region = RegionOne
registry_client_protocol = http
scrub_time = 43200
delayed_delete = False
debug = False
verbose = True
log_file = /var/log/glance/api.log
log_dir = /var/log/glance
use_syslog = True
use_syslog_rfc_format = True
syslog_log_facility = LOG_LOCAL2
use_stderr = False
default_log_levels = amqp=WARN,amqplib=WARN,boto=WARN,iso8601=WARN,keystonemiddleware=WARN,oslo.messaging=INFO,oslo_messaging=INFO,qpid=WARN,requests.packages.urllib3.connectionpool=WARN,requests.packages.urllib3.util.retry=WARN,routes.middleware=WARN,sqlalchemy=WARN,stevedore=WARN,suds=INFO,taskflow=WARN,urllib3.connectionpool=WARN,urllib3.util.retry=WARN,websocket=WARN
notification_driver =noop
os_region_name=RegionOne
scrubber_datadir=/var/lib/glance/scrubber
amqp_durable_queues=False
[database]
connection = mysql://glance:wxB2ZyzcQABCbv11Yc343BZw@192.168.0.2/glance?read_timeout=60
idle_timeout = 3600
max_pool_size = 10
max_retries = -1
max_overflow = 10
[glance_store]
stores = glance.store.swift.Store,glance.store.http.Store
default_store = swift
filesystem_store_datadir = /var/lib/glance/images
os_region_name = RegionOne
swift_store_region = RegionOne
swift_store_endpoint_type = internalURL
swift_store_container = glance
swift_store_large_object_size = 5120
swift_store_create_container_on_put = True
default_swift_reference = ref1
swift_store_config_file = /etc/glance/glance-api.conf
[image_format]
[keystone_authtoken]
auth_uri = http://192.168.0.2:5000/
signing_dir = /tmp/keystone-signing-glance
token_cache_time = -1
identity_uri = http://192.168.0.2:35357/
admin_user = glance
admin_password = maHJE4WJgssGSqRZiXvgouQ7
admin_tenant_name = services
[matchmaker_redis]
[matchmaker_ring]
[oslo_concurrency]
[oslo_messaging_amqp]
[oslo_messaging_qpid]
[oslo_messaging_rabbit]
rabbit_hosts = 192.168.0.3:5673
rabbit_use_ssl = False
rabbit_userid = nova
rabbit_password = dvkIaFrzNe66VuoSXhVPgSxH
rabbit_virtual_host = /
rabbit_ha_queues = True
heartbeat_timeout_threshold = 0
heartbeat_rate = 2
rabbit_notification_exchange=glance
rabbit_notification_topic=notifications
[oslo_policy]
[paste_deploy]
flavor = keystone
[store_type_location_strategy]
[task]
[taskflow_executor]
[ref1]
user=services:glance
auth_address=http://192.168.0.2:5000//v2.0/
key=maHJE4WJgssGSqRZiXvgouQ7
auth_version=2

Bug seems to be similar to this: https://bugs.launchpad.net/mos/+bug/1537038

Tags:

Revision history for this message

Michal Skalski (mskalski) wrote on 2016-02-02:

Fuel snapshot Edit (20.6 MiB, application/octet-stream)

tags:

added: glance swift

Denis Egorenko (degorenko) on 2016-02-02

Changed in mos:
status:	New → Confirmed
assignee:	Fuel Library Team (fuel-library) → MOS Puppet Team (mos-puppet)

Roman Podoliaka (rpodolyaka) on 2016-02-02

tags:	added: promoted-to-critical
tags:	added: area-puppet

Denis Egorenko (degorenko) on 2016-02-02

Changed in fuel:
status:	New → Confirmed
importance:	Undecided → High
assignee:	nobody → Denis Egorenko (degorenko)
milestone:	none → 8.0
no longer affects:	mos

Revision history for this message

Denis Egorenko (degorenko) wrote on 2016-02-02:

Upstream patch: https://review.openstack.org/#/c/275232

Denis Egorenko (degorenko) on 2016-02-02

Changed in fuel:
status:	Confirmed → In Progress

Revision history for this message

Fuel Devops McRobotson (fuel-devops-robot) wrote on 2016-02-03: Related fix proposed to puppet-modules/puppet-glance (mos-9.0)

Related fix proposed to branch: mos-9.0
Change author: Denis Egorenko <email address hidden>
Review: https://review.fuel-infra.org/16642

Revision history for this message

Fuel Devops McRobotson (fuel-devops-robot) wrote on 2016-02-03: Related fix proposed to puppet-modules/puppet-glance (mos-8.0)

Related fix proposed to branch: mos-8.0
Change author: Denis Egorenko <email address hidden>
Review: https://review.fuel-infra.org/16643

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-02-03: Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/275761

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-02-03: Fix proposed to fuel-library (stable/8.0)

Fix proposed to branch: stable/8.0
Review: https://review.openstack.org/275764

Roman Podoliaka (rpodolyaka) on 2016-02-03

tags:

added: hit-hcf
removed: promoted-to-critical

Revision history for this message

Denis Egorenko (degorenko) wrote on 2016-02-04:

Both patches on review, ready to be merged. Waiting for QA feedback. Custom ISO:

http://jenkins-product.srt.mirantis.net:8080/job/custom_8.0_iso/1785/

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-02-04: Fix merged to fuel-library (stable/8.0)

Reviewed: https://review.openstack.org/275764
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=beddd91c08787206a09573ff595fdcd98a7f7b9f
Submitter: Jenkins
Branch: stable/8.0

commit beddd91c08787206a09573ff595fdcd98a7f7b9f
Author: Denis Egorenko <email address hidden>
Date: Wed Feb 3 18:33:55 2016 +0300

Bump Glance ref on a new tag

Bump Glance on a new tag, which includes upstream patch:
I18ee8f68f7ce793d2580685e79ed636556c57ddd

    Change-Id: I93f90d05bce876e0db67d294d6c743c950f3bb01
    Closes-bug: #1540890
    (cherry picked from commit 92cd4f8c64bee2a486c64aa746f1892f3562af45)

Revision history for this message

Roman Podoliaka (rpodolyaka) wrote on 2016-02-04:

Fix merged ^

Changed in fuel:
status:	In Progress → Fix Committed

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-02-04: Fix merged to fuel-library (master)

#10

Reviewed: https://review.openstack.org/275761
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=92cd4f8c64bee2a486c64aa746f1892f3562af45
Submitter: Jenkins
Branch: master

commit 92cd4f8c64bee2a486c64aa746f1892f3562af45
Author: Denis Egorenko <email address hidden>
Date: Wed Feb 3 18:33:55 2016 +0300

Bump Glance ref on a new tag

Bump Glance on a new tag, which includes upstream patch:
I18ee8f68f7ce793d2580685e79ed636556c57ddd

Change-Id: I93f90d05bce876e0db67d294d6c743c950f3bb01
Closes-bug: #1540890

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-02-10: Related fix proposed to fuel-library (stable/7.0)

#11

Related fix proposed to branch: stable/7.0
Review: https://review.openstack.org/278489

Revision history for this message

Alexey Galkin (agalkin) wrote on 2016-02-11:

#12

VERSION:
  feature_groups:
    - mirantis
  production: "docker"
  release: "8.0"
  api: "1.0"
  build_number: "529"
  build_id: "529"
  fuel-nailgun_sha: "baec8643ca624e52b37873f2dbd511c135d236d9"
  python-fuelclient_sha: "4f234669cfe88a9406f4e438b1e1f74f1ef484a5"
  fuel-agent_sha: "658be72c4b42d3e1436b86ac4567ab914bfb451b"
  fuel-nailgun-agent_sha: "b2bb466fd5bd92da614cdbd819d6999c510ebfb1"
  astute_sha: "b81577a5b7857c4be8748492bae1dec2fa89b446"
  fuel-library_sha: "e2d79330d5d708796330fac67722c21f85569b87"
  fuel-ostf_sha: "3bc76a63a9e7d195ff34eadc29552f4235fa6c52"
  fuel-mirror_sha: "fb45b80d7bee5899d931f926e5c9512e2b442749"
  fuelmenu_sha: "e071216cb214e34b4d861478033425ee6a54a3be"
  shotgun_sha: "63645dea384a37dde5c01d4f8905566978e5d906"
  network-checker_sha: "a43cf96cd9532f10794dce736350bf5bed350e9d"
  fuel-upgrade_sha: "616a7490ec7199f69759e97e42f9b97dfc87e85b"
  fuelmain_sha: "a365f05b903368225da3fea9aa42afc1d50dc9b4"

Changed in fuel:
status:	Fix Committed → Won't Fix
status:	Won't Fix → Fix Released

Revision history for this message

Alexey Galkin (agalkin) wrote on 2016-02-11:

#13

Verficated on mos 8.0 RC1:

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-02-15: Related fix proposed to fuel-library (stable/6.1)

#14

Related fix proposed to branch: stable/6.1
Review: https://review.openstack.org/280176

Revision history for this message

Vitaly Sedelnik (vsedelnik) wrote on 2016-02-18:

#15

Retargeting to 6.1-updates and 7.0-updates as this issue is not customer found.

Revision history for this message

Denis Puchkin (dpuchkin) wrote on 2016-02-19:

#16

Patches from this bug need for https://bugs.launchpad.net/mos/+bug/1499754
please targeting to 6.1-mu5 and 7.0-mu3

Revision history for this message

Vitaly Sedelnik (vsedelnik) wrote on 2016-03-02:

#17

Targeted to 6.1-mu-6 together with https://bugs.launchpad.net/mos/+bug/1499754

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-03-22: Related fix merged to fuel-library (stable/7.0)

#18

Reviewed: https://review.openstack.org/278489
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=46e581f5d83f08ad700ab6af2679ebefc1a47904
Submitter: Jenkins
Branch: stable/7.0

commit 46e581f5d83f08ad700ab6af2679ebefc1a47904
Author: Denis Egorenko <email address hidden>
Date: Wed Feb 10 19:10:07 2016 +0300

Use glance-swift conf for swift backend

    For working with Swift backend, Glance needs authentication parameters,
    which are supplied to Swift when making calls to its storage system.
    Glance will use information from the file specified under parameter
    swift_store_config_file. When this parameter is set to the same file
    (glance-api.conf), we have lot of non-critical errors in glance-api
    log, because of 'Invalid format of swift store config'.
    The same problem, when we have RadosGW.

Change-Id: I18ee8f68f7ce793d2580685e79ed636556c57ddd
Related-bug: #1540890

Dmitry Klenov (dklenov) on 2016-03-23

tags:

added: area-mos

TatyanaGladysheva (tgladysheva) on 2016-03-25

tags:

added: on-verification

Revision history for this message

TatyanaGladysheva (tgladysheva) wrote on 2016-03-29:

#19

Verified on MOS 7.0 + mu3 updates.

tags:

removed: on-verification

Revision history for this message

Vitaly Sedelnik (vsedelnik) wrote on 2016-04-13:

#20

Won't Fix for 6.1-updates, according to feedback from core reviewer the fix introduces new feature and it's too risky to include it into MU. Also this is deployment time change but we don't expect new 6.1 deployments.

tags:

added: wontfix-feature

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-05-03: Change abandoned on fuel-library (stable/6.1)

#21

Change abandoned by Fuel DevOps Robot (<email address hidden>) on branch: stable/6.1
Review: https://review.openstack.org/280176
Reason: This review is > 4 weeks without comment and currently blocked by a core reviewer with a -2. We are abandoning this for now. Feel free to reactivate the review by pressing the restore button and contacting the reviewer with the -2 on this review to ensure you address their concerns.