OSTF results are processed incorrectly after second and further runs
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Fuel for OpenStack |
Fix Released
|
High
|
Dennis Dmitriev | ||
6.1.x |
In Progress
|
High
|
Dennis Dmitriev | ||
7.0.x |
Fix Released
|
High
|
Dennis Dmitriev |
Bug Description
Reproduced on CI , test 'ceph_ha_restart' : http://
Results of OSTF tests are not cleared, so if there is any failed test that must be failed for this particular test case (for example, in failover tests), then any other OSTF runs of another tests will also return this failed result.
From the CI job '7.0.system_
============
2015-06-16 02:06:34,070 - INFO fuel_web_
...
AssertionError: Failed 1 OSTF tests; should fail 0 tests. Names of failed tests: [{u'Check that required services are running (failure)': u'Some nova services have not been started.. Please refer to OpenStack logs for more details.'}]
============
Test 'Check that required services are running' is in 'sanity' group that was run before 'ha' group with expected failed test.
OSTF test results should be filtered regarding running tests.
tags: | added: non-release |
For 7.0: https:/ /review. openstack. org/#/c/ 195543/