ceph-osd charm does not error when all configured devices are missing

Bug #1424510 reported by Paul Gear
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
ceph-osd (Juju Charms Collection)
Fix Released
Low
Unassigned

Bug Description

On a new deploy, if ceph-osd is configured to use devices that do not exist and thus it contributes no storage to the pool, it does not report an error in juju status. This means that a cloud could be deployed without noticing that some of its storage is missing.

Revision history for this message
Paul Gear (paulgear) wrote :

Partial log of charm startup:

2015-02-20 11:11:06 INFO juju-log mon:32: Making dir /var/lib/charm/ceph-osd root:root 555
2015-02-20 11:11:06 INFO mon-relation-changed update-alternatives: using /var/lib/charm/ceph-osd/ceph.conf to provide /etc/ceph/ceph.conf (ceph.conf) in auto mode
2015-02-20 11:11:06 INFO mon-relation-changed creating /var/lib/ceph/bootstrap-osd/ceph.keyring
2015-02-20 11:11:06 INFO mon-relation-changed added entity client.bootstrap-osd auth auth(auid = 18446744073709551615 key=AQAeFOdUSOBDERAA9hbzzoKgdKlAW1ZYJQy1fQ== with 0 caps)
2015-02-20 11:11:06 INFO juju-log mon:32: Path /dev/sdd does not exist - bailing
2015-02-20 11:11:06 INFO juju-log mon:32: Path /dev/sde does not exist - bailing

Regardless of the number of devices/directories configured, if > 0 locations fail due to problems, the charm should report an error.

tags: added: canonical-bootstrap
James Page (james-page)
Changed in ceph (Juju Charms Collection):
importance: Undecided → Wishlist
importance: Wishlist → Low
status: New → Triaged
milestone: none → 15.07
tags: added: openstack
James Page (james-page)
Changed in ceph (Juju Charms Collection):
milestone: 15.07 → 15.10
Revision history for this message
James Page (james-page) wrote :

I think this is a good candidate for unit status output - a unit could display a BLOCKED message with a suitable - 'No usable storage devices found' message.

James Page (james-page)
Changed in ceph (Juju Charms Collection):
milestone: 15.10 → 16.01
Seyeong Kim (seyeongkim)
Changed in ceph (Juju Charms Collection):
status: Triaged → In Progress
assignee: nobody → Seyeong Kim (xtrusia)
tags: added: sts
James Page (james-page)
Changed in ceph (Juju Charms Collection):
milestone: 16.01 → 16.04
Revision history for this message
Seyeong Kim (seyeongkim) wrote :
Revision history for this message
Ryan Beisner (1chb1n) wrote :

There are two conflicting ideas here:

A) If ANY osd-device fails or is not found, BLOCK. (Comment #1)

vs.

B) If ALL osd-devices fail or are not found, BLOCK. (Comment #2)

Given that the behavior and documentation of osd-devices is that of a whitelist and not an explicit list of required devices, idea B) is most compatible with the established and expected configuration and behavior.

A change for A) was proposed and merged, then reverted. If A) is desired, that is a certain shift in default behavior and it should be discussed thoroughly via cross-team meeting.

Seyeong Kim (seyeongkim)
Changed in ceph (Juju Charms Collection):
assignee: Seyeong Kim (xtrusia) → nobody
status: In Progress → Confirmed
James Page (james-page)
Changed in ceph (Juju Charms Collection):
milestone: 16.04 → 16.07
Liam Young (gnuoy)
Changed in ceph (Juju Charms Collection):
milestone: 16.07 → 16.10
James Page (james-page)
Changed in ceph (Juju Charms Collection):
milestone: 16.10 → 17.01
Revision history for this message
James Page (james-page) wrote :

This bug is actually resolved, the ceph-osd charm will switch into a blocked state if no devices are detected for the given whitelist.

This does not apply to the ceph charm (however that has been superceeded by ceph-mon, so I'm proposing not to fix ceph for this problem).

affects: ceph (Juju Charms Collection) → ceph-osd (Juju Charms Collection)
Changed in ceph-osd (Juju Charms Collection):
status: Confirmed → Fix Released
milestone: 17.01 → 16.10
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.