Fuel for OpenStack

[System Tests] ha_delete_vips test failed with timeout after deletion vips

Bug #1320800 reported by Andrey Sledzinskiy on 2014-05-19

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	Fuel for OpenStack	Fix Released	High	Fuel QA Team	Fuel for OpenStack 5.0

Bug Description

http://jenkins-product.srt.mirantis.net:8080/view/0_0_swarm/job/master_fuelmain.system_test.centos.thread_5/62/testReport/junit/%28root%29/ha_delete_vips/ha_delete_vips/

Test failed waiting vips restoring after deletion
Traceback (most recent call last):
  File "/usr/lib/python2.7/unittest/case.py", line 332, in run
    testMethod()
  File "/usr/lib/python2.7/unittest/case.py", line 1044, in runTest
    self._testFunc()
  File "/home/jenkins/venv-nailgun-tests/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
    compatability.capture_type_error(s_func)
  File "/home/jenkins/venv-nailgun-tests/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
    func()
  File "/home/jenkins/venv-nailgun-tests/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
    func(test_case.state.get_state())
  File "/home/jenkins/workspace/master_fuelmain.system_test.centos.thread_5/fuelweb_test/helpers/decorators.py", line 49, in wrapper
    return func(*args, **kwagrs)
  File "/home/jenkins/workspace/master_fuelmain.system_test.centos.thread_5/fuelweb_test/tests/tests_strength/test_failover.py", line 199, in ha_delete_vips
    wait(lambda: ip_assigned(slaves), timeout=30)
  File "/home/jenkins/venv-nailgun-tests/local/lib/python2.7/site-packages/devops/helpers/helpers.py", line 95, in wait
    raise TimeoutError("Waiting timed out")
TimeoutError: Waiting timed out

Tags:

Revision history for this message

Andrey Sledzinskiy (asledzinskiy) wrote on 2014-05-19:

fail_ha_delete_vips-2014_05_19__00_45_45.tar.gz Edit (4.0 MiB, application/x-tar)

Revision history for this message

Bogdan Dobrelya (bogdando) wrote on 2014-05-20:

Suspicious crm errors
2014-05-19T00:10:22.982734 node-1 ./node-1.test.domain.local/crmd.log:2014-05-19T00:10:22.982734+00:00 warning: warning: status_from_rc: Action 12
(p_haproxy:1_monitor_0) on node-2.test.domain.local failed (target: 7 vs. rc: 5): Error
2014-05-19T00:10:22.990179 node-2 ./node-2.test.domain.local/crmd.log:2014-05-19T00:10:22.990179+00:00 err: error: generic_get_metadata: Failed to retrieve meta-data for ocf:mirantis:ns_haproxy
2014-05-19T00:10:22.990316 node-2 ./node-2.test.domain.local/crmd.log:2014-05-19T00:10:22.990316+00:00 err: error: generic_get_metadata: Failed to retrieve meta-data for ocf:mirantis:mysql-wss
2014-05-19T00:10:22.990316 node-2 ./node-2.test.domain.local/crmd.log:2014-05-19T00:10:22.990316+00:00 err: error: generic_get_metadata: Failed to retrieve meta-data for ocf:mirantis:openstack-heat-engine
2014-05-19T00:10:22.990316 node-2 ./node-2.test.domain.local/crmd.log:2014-05-19T00:10:22.990316+00:00 warning: warning: get_rsc_metadata: No metadata found for mysql-wss::ocf:mirantis: Input/output error (-5)
2014-05-19T00:10:22.990316 node-2 ./node-2.test.domain.local/crmd.log:2014-05-19T00:10:22.990316+00:00 warning: warning: get_rsc_metadata: No metadata found for ns_haproxy::ocf:mirantis: Input/output error (-5)
2014-05-19T00:10:22.990316 node-2 ./node-2.test.domain.local/crmd.log:2014-05-19T00:10:22.990316+00:00 warning: warning: get_rsc_metadata: No metadata found for openstack-heat-engine::ocf:mirantis: Input/output error (-5)
2014-05-19T00:10:23.050851 node-1 ./node-1.test.domain.local/crmd.log:2014-05-19T00:10:23.050851+00:00 warning: warning: status_from_rc: Action 13 (p_mysql:1_monitor_0) on node-2.test.domain.local failed (target: 7 vs. rc: 5): Error
2014-05-19T00:10:23.050851 node-1 ./node-1.test.domain.local/crmd.log:2014-05-19T00:10:23.050851+00:00 warning: warning: status_from_rc: Action 14 (openstack-heat-engine_monitor_0) on node-2.test.domain.local failed (target: 7 vs. rc: 5): Error

Suspicious crm errors
2014-05-19T00:10:22.982734 node-1 ./node-1.test.domain.local/crmd.log:2014-05-19T00:10:22.982734+00:00 warning:   warning: status_from_rc: Action 12 
(p_haproxy:1_monitor_0) on node-2.test.domain.local failed (target: 7 vs. rc: 5): Error
2014-05-19T00:10:22.990179 node-2 ./node-2.test.domain.local/crmd.log:2014-05-19T00:10:22.990179+00:00 err:     error: generic_get_metadata: Failed to retrieve meta-data for ocf:mirantis:ns_haproxy
2014-05-19T00:10:22.990316 node-2 ./node-2.test.domain.local/crmd.log:2014-05-19T00:10:22.990316+00:00 err:     error: generic_get_metadata: Failed to retrieve meta-data for ocf:mirantis:mysql-wss
2014-05-19T00:10:22.990316 node-2 ./node-2.test.domain.local/crmd.log:2014-05-19T00:10:22.990316+00:00 err:     error: generic_get_metadata: Failed to retrieve meta-data for ocf:mirantis:openstack-heat-engine
2014-05-19T00:10:22.990316 node-2 ./node-2.test.domain.local/crmd.log:2014-05-19T00:10:22.990316+00:00 warning:   warning: get_rsc_metadata: No metadata found for mysql-wss::ocf:mirantis: Input/output error (-5)
2014-05-19T00:10:22.990316 node-2 ./node-2.test.domain.local/crmd.log:2014-05-19T00:10:22.990316+00:00 warning:   warning: get_rsc_metadata: No metadata found for ns_haproxy::ocf:mirantis: Input/output error (-5)
2014-05-19T00:10:22.990316 node-2 ./node-2.test.domain.local/crmd.log:2014-05-19T00:10:22.990316+00:00 warning:   warning: get_rsc_metadata: No metadata found for openstack-heat-engine::ocf:mirantis: Input/output error (-5)
2014-05-19T00:10:23.050851 node-1 ./node-1.test.domain.local/crmd.log:2014-05-19T00:10:23.050851+00:00 warning:   warning: status_from_rc: Action 13 (p_mysql:1_monitor_0) on node-2.test.domain.local failed (target: 7 vs. rc: 5): Error
2014-05-19T00:10:23.050851 node-1 ./node-1.test.domain.local/crmd.log:2014-05-19T00:10:23.050851+00:00 warning:   warning: status_from_rc: Action 14 (openstack-heat-engine_monitor_0) on node-2.test.domain.local failed (target: 7 vs. rc: 5): Error

Revision history for this message

Tatyanka (tatyana-leontovich) wrote on 2014-05-20:

213 iso with applied patch for sync - test passed on local deployment

Nastya Urlapova (aurlapova) on 2014-05-26