At [1] the undercloud-upgrade [2] the minor update and [3] the standalone-upgrade jobs are failing during the upgrade trying to pull containers for image prepare:
* 2020-12-14 22:00:20 | 2020-12-14 22:00:20.851286 | fa163e7f-9be0-c5bc-bae3-000000000c0a | FATAL | Container image prepare | undercloud | error={"changed": false, "error": "Not found image: http://199.204.45.249:5001/v2/tripleovictoria/openstack-rabbitmq/manifests/73035ce83cf7ac1c83c997421ed746c6", "msg": "Error running container image prepare: Not found image: http://199.204.45.249:5001/v2/tripleovictoria/openstack-rabbitmq/manifests/73035ce83cf7ac1c83c997421ed746c6", "params": {}, "success": false}
The above is from [1]. Using the same logs as an example the hash is passed in the content provider vars with [4]
* registry_ip_address_branch: ussuri: 199.204.45.238 victoria: 199.204.45.249 provider_dlrn_hash_branch: ussuri: 33e5f8f0b4d9897e80872782519b2589 victoria: b6ac01208810425bd22a88947cc043d1 provider_dlrn_hash_tag_branch: ussuri: 33e5f8f0b4d9897e80872782519b2589 victoria: b6ac01208810425bd22a88947cc043d1
but it is not consumed by the job, looking at the container image prepare params [5]
* tag: 73035ce83cf7ac1c83c997421ed746c6 namespace: 199.204.45.249:5001/tripleovictoria
Looks like a nit in [6] - posting it now
[1] https://d32eb2db9c879b955fb3-cf05ec96aa1131dfad9173080b1236b7.ssl.cf5.rackcdn.com/766992/1/check/tripleo-ci-centos-8-undercloud-upgrade-victoria/297a324/logs/undercloud/home/zuul/undercloud_upgrade.log [2] https://13dfe0d64677b4197a7a-b241a3720f6d18d48bd2c3bcf23977c9.ssl.cf2.rackcdn.com/766992/1/check/tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates-victoria/46c505f/logs/undercloud/home/zuul/undercloud_install.log [3] [4] https://d32eb2db9c879b955fb3-cf05ec96aa1131dfad9173080b1236b7.ssl.cf5.rackcdn.com/766992/1/check/tripleo-ci-centos-8-undercloud-upgrade-victoria/297a324/zuul-info/inventory.yaml [5] https://d32eb2db9c879b955fb3-cf05ec96aa1131dfad9173080b1236b7.ssl.cf5.rackcdn.com/766992/1/check/tripleo-ci-centos-8-undercloud-upgrade-victoria/297a324/logs/undercloud/home/zuul/containers-prepare-parameter.yaml [6] https://opendev.org/openstack/tripleo-quickstart/src/commit/8717fac68cc82c5ae0d92ea6017c63eb4050be78/config/release/tripleo-ci/CentOS-8/victoria.yml#L7
At [1] the undercloud-upgrade [2] the minor update and [3] the standalone-upgrade jobs are failing during the upgrade trying to pull containers for image prepare:
* 2020-12-14 22:00:20 | 2020-12-14 22:00:20.851286 | fa163e7f- 9be0-c5bc- bae3-000000000c 0a | FATAL | Container image prepare | undercloud | error={"changed": false, "error": "Not found image: http:// 199.204. 45.249: 5001/v2/ tripleovictoria /openstack- rabbitmq/ manifests/ 73035ce83cf7ac1 c83c997421ed746 c6", "msg": "Error running container image prepare: Not found image: http:// 199.204. 45.249: 5001/v2/ tripleovictoria /openstack- rabbitmq/ manifests/ 73035ce83cf7ac1 c83c997421ed746 c6", "params": {}, "success": false}
The above is from [1]. Using the same logs as an example the hash is passed in the content provider vars with [4]
* registry_ ip_address_ branch: dlrn_hash_ branch: e80872782519b25 89 bd22a88947cc043 d1 dlrn_hash_ tag_branch: e80872782519b25 89 bd22a88947cc043 d1
ussuri: 199.204.45.238
victoria: 199.204.45.249
provider_
ussuri: 33e5f8f0b4d9897
victoria: b6ac01208810425
provider_
ussuri: 33e5f8f0b4d9897
victoria: b6ac01208810425
but it is not consumed by the job, looking at the container image prepare params [5]
* tag: 73035ce83cf7ac1 c83c997421ed746 c6
namespace: 199.204. 45.249: 5001/tripleovic toria
Looks like a nit in [6] - posting it now
[1] https:/ /d32eb2db9c879b 955fb3- cf05ec96aa1131d fad9173080b1236 b7.ssl. cf5.rackcdn. com/766992/ 1/check/ tripleo- ci-centos- 8-undercloud- upgrade- victoria/ 297a324/ logs/undercloud /home/zuul/ undercloud_ upgrade. log /13dfe0d64677b4 197a7a- b241a3720f6d18d 48bd2c3bcf23977 c9.ssl. cf2.rackcdn. com/766992/ 1/check/ tripleo- ci-centos- 8-scenario000- multinode- oooq-container- updates- victoria/ 46c505f/ logs/undercloud /home/zuul/ undercloud_ install. log /d32eb2db9c879b 955fb3- cf05ec96aa1131d fad9173080b1236 b7.ssl. cf5.rackcdn. com/766992/ 1/check/ tripleo- ci-centos- 8-undercloud- upgrade- victoria/ 297a324/ zuul-info/ inventory. yaml /d32eb2db9c879b 955fb3- cf05ec96aa1131d fad9173080b1236 b7.ssl. cf5.rackcdn. com/766992/ 1/check/ tripleo- ci-centos- 8-undercloud- upgrade- victoria/ 297a324/ logs/undercloud /home/zuul/ containers- prepare- parameter. yaml /opendev. org/openstack/ tripleo- quickstart/ src/commit/ 8717fac68cc82c5 ae0d92ea6017c63 eb4050be78/ config/ release/ tripleo- ci/CentOS- 8/victoria. yml#L7
[2] https:/
[3]
[4] https:/
[5] https:/
[6] https:/