Fuel for OpenStack

[system-tests] Fix test cases for the rabbit-fence daemon

Bug #1462942 reported by Bogdan Dobrelya
10
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
High
Maksym Strukov
Fuel for OpenStack 7.0
6.0.x
Invalid
Undecided
Unassigned
6.1.x
Fix Committed
High
Fuel QA Team
Fuel for OpenStack 6.1-updates
7.0.x
Fix Released
High
Maksym Strukov
Fuel for OpenStack 7.0

Bug Description

The test cases "Check alive rabbit node is not kicked from cluster" (ha_neutron_check_alive_rabbit) and "Check dead rabbit node is kicked from cluster" (ha_neutron_check_dead_rabbit) should bring corosync cluster to maint mode prior to any destructive actions being executed. So, the step 1 for both test cases should be changed from

1. SSH to first controller and make master_p_rabbitmq-server resource unmanaged

to

1. SSH to first controller and put corosync cluster to maint mode: crm configure property maintenance-mode=true

W/o this change, the step 4. "On second controller check that rabbitmq cluster_status contains all 3 nodes" of the test case ha_neutron_check_alive_rabbit may fail due to the quorum loss on node-1 which would force all resources to be stopped failing the test case execution.

Bogdan Dobrelya (bogdando)
Changed in fuel:
importance: Undecided → High
milestone: none → 6.1
assignee: nobody → Fuel QA Team (fuel-qa)
tags: added: non-release system-tests
summary: - [system-tests] Fix test case "check alive rabbit node is not kicked from
- cluster"
+ [system-tests] Fix test cases for the rabbit-fence daemon
Revision history for this message
Bogdan Dobrelya (bogdando) wrote :

And here is example of the test case failure in swarm run http://jenkins-product.srt.mirantis.net:8080/job/6.1.system_test.centos.ha_neutron_destructive/143/

Nastya Urlapova (aurlapova)
Changed in fuel:
status: New → Confirmed
Nastya Urlapova (aurlapova)
Changed in fuel:
milestone: 6.1 → 7.0
milestone: 7.0 → 6.1
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-qa (master)

Fix proposed to branch: master
Review: https://review.openstack.org/206361

Changed in fuel:
assignee: Fuel QA Team (fuel-qa) → Maksym Strukov (unbelll)
status: Confirmed → In Progress
Revision history for this message
Maksym Strukov (unbelll) wrote :

Proposed patch tested, seems all ok:
http://jenkins-product.srt.mirantis.net:8080/view/custom_iso/job/7.0.custom_system_test/245/console
http://jenkins-product.srt.mirantis.net:8080/view/custom_iso/job/7.0.custom_system_test/247/console
http://jenkins-product.srt.mirantis.net:8080/view/custom_iso/job/7.0.custom_system_test/248/console

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-qa (master)

Reviewed: https://review.openstack.org/206361
Committed: https://git.openstack.org/cgit/stackforge/fuel-qa/commit/?id=a20070088ed052786a88e76ff6e55199f976b0b8
Submitter: Jenkins
Branch: master

commit a20070088ed052786a88e76ff6e55199f976b0b8
Author: Maksym Strukov <email address hidden>
Date: Tue Jul 28 12:01:03 2015 +0300

    Bring corosync cluster to maintenance mode

    To fix quorum loss tests should bring corosync cluster to maintenance mode
    in following tests:
    * ha_neutron_check_alive_rabbit
    * ha_neutron_check_dead_rabbit
    * ha_nova_check_alive_rabbit
    * ha_nova_check_dead_rabbit

    Change-Id: Ia185a12457d08e7ce7bba9d800a555f31e6e60c8
    Closes-Bug: #1462942

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-qa (stable/6.1)

Fix proposed to branch: stable/6.1
Review: https://review.openstack.org/246372

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-qa (stable/6.1)

Reviewed: https://review.openstack.org/246372
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=3a38fa90890874c022aab8688319179a7f07e185
Submitter: Jenkins
Branch: stable/6.1

commit 3a38fa90890874c022aab8688319179a7f07e185
Author: Maksym Strukov <email address hidden>
Date: Tue Jul 28 12:01:03 2015 +0300

    Bring corosync cluster to maintenance mode

    To fix quorum loss tests should bring corosync cluster to maintenance mode
    in following tests:
    * ha_neutron_check_alive_rabbit
    * ha_neutron_check_dead_rabbit
    * ha_nova_check_alive_rabbit
    * ha_nova_check_dead_rabbit

    Change-Id: Ia185a12457d08e7ce7bba9d800a555f31e6e60c8
    Closes-Bug: #1462942
    (cherry picked from commit a20070088ed052786a88e76ff6e55199f976b0b8)

Nastya Urlapova (aurlapova)
tags: added: area-qa
removed: non-release
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.