Fuel for OpenStack

[nodegroups] Slaves behavior is unpredictable after environment removal

Bug #1521682 reported by Artem Panchenko on 2015-12-01

This bug affects 1 person

	Status	Importance	Assigned to	Milestone
Fuel for OpenStack	Confirmed	Medium	Fuel Sustaining	Fuel for OpenStack 11.0
Mitaka	Won't Fix	Medium	Fuel Python (Deprecated)	Fuel for OpenStack 9.0
Newton	Confirmed	Medium	Fuel Sustaining	Fuel for OpenStack 10.1

Bug Description

Fuel version (8.0 build #231): http://paste.openstack.org/show/480523/

There are 3 possible states if slave nodes from non-default nodegroup after environment is removed:

1) nodes are erased, bootstrapped and marked as 'error' (because there is no nodegroup for them)
2) nodes are erased and bootstrapped, but not discovered, because during bootstrap they failed to get IP address via DHCP
3) nodes are erased, but not bootstrapped - PXE boot failed

Nodes get states #2 or #3 when nodegroup is removed before they are bootstrapped/discovered, for example if their POST takes a lot of time.

In my opinion Fuel should either always put such nodes to state #3 (remove nodegroup before slaves restart) or don't remove nodegroup at all (detach it from environments).

Tags:

Revision history for this message

Artem Panchenko (apanchenko-8) wrote on 2015-12-01:

fail_error_delete_cluster_with_custom_nodegroup-fuel-snapshot-2015-12-01_00-18-52.tar.xz Edit (8.2 MiB, application/octet-stream)

Dmitry Klenov (dklenov) on 2015-12-01

tags:	added: area-python
Changed in fuel:
importance:	Undecided → Medium
status:	New → Confirmed

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2015-12-01: Related fix proposed to fuel-qa (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/251968

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2015-12-03: Related fix merged to fuel-qa (master)

Reviewed: https://review.openstack.org/251968
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=2a97f51ba9c6d99fe918cf75639c655e8d4bd0b9
Submitter: Jenkins
Branch: master

commit 2a97f51ba9c6d99fe918cf75639c655e8d4bd0b9
Author: Artem Panchenko <email address hidden>
Date: Wed Dec 2 16:25:17 2015 +0200

Add test with nodegroup removal after cluster reset

    Create test which removes nodegroup from new environment
    and checks its nodes are marked as 'error'.
    Also change 'assign_nodegroup' method to use PUT request
    to '/api/nodes/' URL for assigning nodes to nodegroup,
    because old handler was removed from Nailgun here:
    I88b7d4c550f87fe9620467f4c3212a7034c89999.

Change-Id: Iae0abac3af1d126facf2045763c4fe1b1b9e940e
Related-bug: #1521682

Nastya Urlapova (aurlapova) on 2015-12-04

tags:

added: swarm-blocker

Revision history for this message

Aleksey Kasatkin (alekseyk-ru) wrote on 2015-12-04:

This depends on moving node groups out of environments which is a feature and it cannot be done in 8.0.

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2015-12-04: Related fix proposed to fuel-qa (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/253507

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2015-12-07: Related fix merged to fuel-qa (master)

Reviewed: https://review.openstack.org/253507
Committed: https://git.openstack.org/cgit/openstack/fuel-qa/commit/?id=4629bf8ed3480e8c49d40fb3af6237cae78de038
Submitter: Jenkins
Branch: master

commit 4629bf8ed3480e8c49d40fb3af6237cae78de038
Author: Artem Panchenko <email address hidden>
Date: Fri Dec 4 16:04:22 2015 +0200

Disable delete_cluster_with_custom_nodegroup test

    Disable delete_cluster_with_custom_nodegroup test because it's
    blocked by bug #1521682 in 8.0 (another test for nodegroup removal
    was added recently: Iae0abac3af1d126facf2045763c4fe1b1b9e940e)

Change-Id: I4f4a0b4cd5b815306917535595545a88c1e09919
Related-bug: #1521682

Artem Panchenko (apanchenko-8) on 2015-12-07

tags:

removed: swarm-blocker

Dmitry Pyzhov (dpyzhov) on 2015-12-25

tags:	added: team-network
Changed in fuel:
milestone:	8.0 → 9.0

Revision history for this message

Bug Checker Bot (bug-checker) wrote on 2016-03-28: Autochecker

(This check performed automatically)
Please, make sure that bug description contains the following sections filled in with the appropriate data related to the bug you are describing:

actual result

expected result

steps to reproduce

For more detailed information on the contents of each of the listed sections see https://wiki.openstack.org/wiki/Fuel/How_to_contribute#Here_is_how_you_file_a_bug