Deploy cluster and check RadosGW fails consistently at setup master node due to missing ami-creator

Bug #1654200 reported by Alexandr Kostrikov
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
In Progress
Medium
Vladimir Kozhukalov

Bug Description

At swarm [0] test with scenario
    Scenario:
        0. Create environment, bootstrap centos_master
        1. Configuration releases
        2. Bootstrap slave and make snapshot
        3. Revert bootstrapped nodes
        4. Create Fuel Environment
        5. Add nodes to environment
        6. Run network checker
        7. Deploy environment
        8. Run network checker
        9. HAProxy backend checking
        10. Check Ceph status in cluster
        11. Run health checker
        12. Check the radosgw daemon is started
fails consistently due to missing ami-creator:
Error: Execution of '/usr/bin/yum -d 0 -e 0 -y install ami-creator' returned 1: Error downloading packages:
  ami-creator-0.3-1.el7~mos1.noarch: [Errno 256] No more mirrors to try.
  system-config-keyboard-base-1.4.0-4.el7.noarch: [Errno 256] No more mirrors to try.
  dosfstools-3.0.20-9.el7.x86_64: [Errno 256] No more mirrors to try.
  system-config-keyboard-1.4.0-4.el7.noarch: [Errno 256] No more mirrors to try.
  1:python-imgcreate-21.4-2.el7.x86_64: [Errno 256] No more mirrors to try.
  squashfs-tools-4.3-0.21.gitaae0aff4.el7.x86_64: [Errno 256] No more mirrors to try.
  pykickstart-1.99.66.10-1.el7.noarch: [Errno 256] No more mirrors to try.
Error: /Stage[main]/Main/Package[ami-creator]/ensure: change from absent to present failed: Execution of '/usr/bin/yum -d 0 -e 0 -y install ami-creator' returned 1: Error downloading packages:
  ami-creator-0.3-1.el7~mos1.noarch: [Errno 256] No more mirrors to try.
  system-config-keyboard-base-1.4.0-4.el7.noarch: [Errno 256] No more mirrors to try.
  dosfstools-3.0.20-9.el7.x86_64: [Errno 256] No more mirrors to try.
  system-config-keyboard-1.4.0-4.el7.noarch: [Errno 256] No more mirrors to try.
  1:python-imgcreate-21.4-2.el7.x86_64: [Errno 256] No more mirrors to try.
  squashfs-tools-4.3-0.21.gitaae0aff4.el7.x86_64: [Errno 256] No more mirrors to try.
  pykickstart-1.99.66.10-1.el7.noarch: [Errno 256] No more mirrors to try.

[0] https://product-ci.infra.mirantis.net/job/9.x.system_test.ubuntu.system_test.deploy_centos_master/161/console

Revision history for this message
Alexandr Kostrikov (akostrikov-mirantis) wrote :
Changed in fuel:
milestone: none → 9.2
Changed in fuel:
status: New → Confirmed
Revision history for this message
Vladimir Kuklin (vkuklin) wrote :

It seems that the test itself configures the environment in a way that the master node does not have access to the repostories. Here is the package that is required

http://mirror.fuel-infra.org/mos-repos/centos/mos9.0-centos7/os/x86_64/Packages/ami-creator-0.3-1.el7~mos1.noarch.rpm

And it is present in the repo and is downloadable. I suggest to recheck the environment settings or at least get an environment that can be debugged as there are no more snapshots left.

Changed in fuel:
status: Confirmed → Incomplete
assignee: Fuel Sustaining (fuel-sustaining-team) → Fuel QA Team (fuel-qa)
Revision history for this message
Vladimir Kozhukalov (kozhukalov) wrote :

FYI, ami-creator package should be in the local repo on the master node because it is in the list of rpm requirements https://github.com/openstack/fuel-main/blob/stable/mitaka/requirements-rpm.txt#L1

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-qa (stable/mitaka)

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/417829

Changed in fuel:
status: Incomplete → In Progress
assignee: Fuel QA Team (fuel-qa) → Vladimir Kozhukalov (kozhukalov)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-qa (stable/mitaka)

Reviewed: https://review.openstack.org/417829
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=4b13982ba458c38ec5245d0ca8a14de55782189b
Submitter: Jenkins
Branch: stable/mitaka

commit 4b13982ba458c38ec5245d0ca8a14de55782189b
Author: Vladimir Kozhukalov <email address hidden>
Date: Mon Jan 9 14:22:20 2017 +0300

    Override resolv.conf on the master node

    Before starting fuel deployment we need ensure
    resolv.conf points on a correct and working DNS server.

    Change-Id: I3f3b7e862199ca3377970e09d2d813f7386fd875
    Closes-Bug: #1654200

tags: added: in-stable-mitaka
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-qa (stable/mitaka)

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/419120

Revision history for this message
Vladimir Kozhukalov (kozhukalov) wrote :

This bug is not about Ceph, but it is more about deployment of the Fuel master node on vanilla Centos. To make it working we need to modify CI scripts that run the test so they inject necessary repositories before starting deployment.

Revision history for this message
Vladimir Kozhukalov (kozhukalov) wrote :

Since this case (installing Fuel master node on vanilla Centos without Fuel ISO) was not originally in the scope of 9.x and does not affect 9.0 -> 9.x update procedure, I am moving bug priority to medium.

Changed in fuel:
importance: High → Medium
Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix proposed to fuel-infra/jenkins-jobs (master)

Fix proposed to branch: master
Change author: Vladimir Kozhukalov <email address hidden>
Review: https://review.fuel-infra.org/29807

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-qa (stable/mitaka)

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/419626

Changed in fuel:
milestone: 9.2 → 9.3
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-qa (stable/mitaka)

Change abandoned by Fuel DevOps Robot (<email address hidden>) on branch: stable/mitaka
Review: https://review.openstack.org/419626
Reason: This review is > 4 weeks without comment, and failed Jenkins the last time it was checked. We are abandoning this for now. Feel free to reactivate the review by pressing the restore button and leaving a 'recheck' comment to get fresh test results.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Change abandoned by Fuel DevOps Robot (<email address hidden>) on branch: stable/mitaka
Review: https://review.openstack.org/419120
Reason: This review is > 4 weeks without comment, and failed Jenkins the last time it was checked. We are abandoning this for now. Feel free to reactivate the review by pressing the restore button and leaving a 'recheck' comment to get fresh test results.

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change abandoned on fuel-infra/jenkins-jobs (master)

Change abandoned by Vladimir Khlyunev <email address hidden> on branch: master
Review: https://review.fuel-infra.org/29807

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.