OpenStack-Ansible

Tempest test numbers are unstable

  1. Series juno
  2. Bug #1530796
Bug #1530796 reported by Hugh Saunders
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack-Ansible
Fix Released
Low
Hugh Saunders
OpenStack-Ansible mitaka-2
Juno
Won't Fix
Low
Unassigned
Kilo
Fix Released
Low
Unassigned
OpenStack-Ansible 11.2.7
Liberty
Fix Released
Low
Unassigned
OpenStack-Ansible 12.0.4
Trunk
Fix Released
Low
Hugh Saunders
OpenStack-Ansible mitaka-2

Bug Description

Using openstack-tempest-gate or run-tempest.sh, tempest runs unstable numbers of tests. This is because --serial is not set. --serial is set in gate-check-commit, but there are situations where gate-check-commit is not used, but tempest is.

https://github.com/openstack/openstack-ansible/blob/master/scripts/gate-check-commit.sh#L22

I propose that we move this default setting into run-tempest itself.

Hugh Saunders (hughsaunders)
Changed in openstack-ansible:
assignee: nobody → Hugh Saunders (hughsaunders)
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to openstack-ansible (master)

Fix proposed to branch: master
Review: https://review.openstack.org/263175

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to openstack-ansible (master)

Reviewed: https://review.openstack.org/263175
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible/commit/?id=850221910e780f6d0b3d790b377992ca6b329456
Submitter: Jenkins
Branch: master

commit 850221910e780f6d0b3d790b377992ca6b329456
Author: Hugh Saunders <email address hidden>
Date: Mon Jan 4 08:59:07 2016 +0000

    Set --serial as default in run-tempest.sh

    Currently this is set in gate-check-commit, but this is a sensible
    default for situations other than gate-check-commit so it should be set
    in run-tempest itself.

    Change-Id: I0bef1c5650757d54dd4fbeb6b872bd00cabed627
    Closes-bug: #1530796

Changed in openstack-ansible:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to openstack-ansible (liberty)

Reviewed: https://review.openstack.org/265831
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible/commit/?id=b708af872d980d83d1d2c1c32b2a316ecc6eeb1e
Submitter: Jenkins
Branch: liberty

commit b708af872d980d83d1d2c1c32b2a316ecc6eeb1e
Author: Hugh Saunders <email address hidden>
Date: Mon Jan 4 08:59:07 2016 +0000

    Set --serial as default in run-tempest.sh

    Currently this is set in gate-check-commit, but this is a sensible
    default for situations other than gate-check-commit so it should be set
    in run-tempest itself.

    Change-Id: I0bef1c5650757d54dd4fbeb6b872bd00cabed627
    Closes-bug: #1530796
    (cherry picked from commit 850221910e780f6d0b3d790b377992ca6b329456)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to openstack-ansible (kilo)

Reviewed: https://review.openstack.org/265830
Committed: https://git.openstack.org/cgit/openstack/openstack-ansible/commit/?id=4ebcee9f6faeb1429c57c1a74c58d5e5ece00216
Submitter: Jenkins
Branch: kilo

commit 4ebcee9f6faeb1429c57c1a74c58d5e5ece00216
Author: Hugh Saunders <email address hidden>
Date: Mon Jan 4 08:59:07 2016 +0000

    Set --serial as default in run-tempest.sh

    Currently this is set in gate-check-commit, but this is a sensible
    default for situations other than gate-check-commit so it should be set
    in run-tempest itself.

    Change-Id: I0bef1c5650757d54dd4fbeb6b872bd00cabed627
    Closes-bug: #1530796
    (cherry picked from commit 850221910e780f6d0b3d790b377992ca6b329456)

Revision history for this message
Jesse Pretorius (jesse-pretorius) wrote :

Setting Juno series target to "Won't Fix" as there will be no more adjustments going into the Juno branch unless they are Critical bugs.

Revision history for this message
Davanum Srinivas (DIMS) (dims-v) wrote : Fix included in openstack/openstack-ansible 13.0.0

This issue was fixed in the openstack/openstack-ansible 13.0.0 release.

Revision history for this message
Davanum Srinivas (DIMS) (dims-v) wrote : Fix included in openstack/openstack-ansible 12.0.11

This issue was fixed in the openstack/openstack-ansible 12.0.11 release.

Revision history for this message
Davanum Srinivas (DIMS) (dims-v) wrote : Fix included in openstack/openstack-ansible 11.2.14

This issue was fixed in the openstack/openstack-ansible 11.2.14 release.

Revision history for this message
Doug Hellmann (doug-hellmann) wrote : Fix included in openstack/openstack-ansible 11.2.15

This issue was fixed in the openstack/openstack-ansible 11.2.15 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.