In the tripleo-ci-centos-7-containerized-undercloud-upgrades we can see the following error in the mistral_executor container docker logs:
INFO:__main__:Setting permission for /var/lib/mistral
INFO:__main__:Setting permission for /var/lib/mistral/undercloud.conf
ERROR:__main__:Failed to change ownership of /var/lib/mistral/undercloud.conf to 42430:42430
Traceback (most recent call last):
File "/usr/local/bin/kolla_set_configs", line 345, in set_perms
os.chown(path, uid, gid)
OSError: [Errno 30] Read-only file system: '/var/lib/mistral/undercloud.conf'
++ cat /run_command
+ CMD='/usr/bin/mistral-server --config-file=/etc/mistral/mistral.conf --log-file=/var/log/mistral/executor.log --server=executor'
http://logs.openstack.org/30/634330/1/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/94198d2/logs/undercloud/var/log/extra/docker/containers/mistral_executor/stdout.log.txt.gz
As well as in the journal:
Jan 31 23:20:03 centos-7-rax-dfw-0002312926 dockerd-current[19403]: INFO:__main__:Setting permission for /var/lib/mistral/undercloud.conf
Jan 31 23:20:03 centos-7-rax-dfw-0002312926 sudo[66635]: pam_unix(sudo:session): session closed for user root
Jan 31 23:20:03 centos-7-rax-dfw-0002312926 dockerd-current[19403]: ERROR:__main__:Failed to change ownership of /var/lib/mistral/undercloud.conf to 42430:42430
Jan 31 23:20:03 centos-7-rax-dfw-0002312926 dockerd-current[19403]: Traceback (most recent call last):
Jan 31 23:20:03 centos-7-rax-dfw-0002312926 dockerd-current[19403]: File "/usr/local/bin/kolla_set_configs", line 345, in set_perms
Jan 31 23:20:03 centos-7-rax-dfw-0002312926 dockerd-current[19403]: os.chown(path, uid, gid)
Jan 31 23:20:03 centos-7-rax-dfw-0002312926 dockerd-current[19403]: OSError: [Errno 30] Read-only file system: '/var/lib/mistral/undercloud.conf'
Jan 31 23:20:03 centos-7-rax-dfw-0002312926 dockerd-current[19403]: ++ cat /run_command
Jan 31 23:20:03 centos-7-rax-dfw-0002312926 dockerd-current[19403]: + CMD='/usr/bin/mistral-server --config-file=/etc/mistral/mistral.conf --log-file=/var/log/mistral/executor.log --server=executor'
http://logs.openstack.org/30/634330/1/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/94198d2/logs/undercloud/var/log/journal.txt.gz#_Jan_31_23_20_03
The main issue looks like we're mapping /home/stack/
But when running the mistral command, we set the permission field to change the ownership for the whole /var/lib/mistral directory (in a recursive manner) and as undercloud.conf is a read-only file we fail. The easies solution is to just map the undercloud.conf as rw.