Comment 13 for bug 1988088

Revision history for this message
Nobuto Murata (nobuto) wrote :

"non-pristine devices" could be caused by many reasons.

What we know about potential causes so far are:

1. insufficient resource or misconfiguration
e.g. "mon-relation-changed Volume group "ceph-db-XYZ" has insufficient free space (255 extents): 256 required."

2. bluefs_buffered_io related
e.g. "mon-relation-changed stderr: (...) -1 OSD::mkfs: ObjectStore::mkfs failed with error (5) Input/output error"

For 2., there are some upstream reports, but I'm not personally familiar with what exact condition brings this situation.
- https://tracker.ceph.com/issues/54019
- https://tracker.ceph.com/issues/51034#note-12
- https://github.com/ceph/ceph/pull/49431

config-flags: '{"osd": { "bluefs_buffered_io": false}}' could be used to confirm if it's about buffered io when you see the error above.

In any case, logs would be important to see what's going on.