cluster-node-add faild

Bug #1706532 reported by chenyb4
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
senlin
New
Undecided
chenyb4

Bug Description

When use senlin cluster-node-add has exist node,the node add faild, but the cluster-node-list record faild node message:

Add node to cluster:
# senlin cluster-node-add -n fabian_test cluster_001
WARNING (shell) "senlin cluster-node-add" is deprecated and will be removed by Apr 2017, please use "openstack cluster node members add" instead.
Request accepted by action: 6ae85970-4208-45fa-8d8c-c00455f98fb9

# senlin cluster-node-list cluster_001
WARNING (shell) "senlin cluster-node-list" is deprecated and will be removed by Apr 2017, please use "openstack cluster members list" instead.
+----------+-------------------+-------+--------+-------------+----------------------+
| id | name | index | status | physical_id | created_at |
+----------+-------------------+-------+--------+-------------+----------------------+
| 8f3f7cd1 | node-cbab4413-006 | 6 | ACTIVE | df8e0cf9 | 2017-07-26T06:36:13Z |
| 32b56212 | fabian_test | 7 | ACTIVE | 76ec24b9 | 2017-07-26T06:41:06Z |
+----------+-------------------+-------+--------+-------------+----------------------+

The cluster detail desired_capacity error:
# senlin cluster-show cluster_001
WARNING (shell) "senlin cluster-show" is deprecated and will be removed by Apr 2017, please use "openstack cluster show" instead.
+------------------+--------------------------------------------------------------------------------+
| Property | Value |
+------------------+--------------------------------------------------------------------------------+
| config | {} |
| created_at | 2017-05-26T09:04:50Z |
| data | {} |
| dependents | {} |
| desired_capacity | 1 |
| domain_id | - |
| id | cbab4413-b828-4fae-8c21-e145569472de |
| init_at | 2017-05-26T09:04:49Z |
| location | - |
| max_size | 5 |
| metadata | {} |
| min_size | 0 |
| name | cluster_001 |
| node_ids | 32b56212-a68e-4a1b-83d8-cbdd6ae3c4dc |
| | 8f3f7cd1-a31e-4660-a648-ee7947561bc1 |
| profile_id | 8c7ca125-3986-4464-880a-29eaf8a5ec7b |
| profile_name | profile_nova |
| project_id | 631b9209a992429fb70909d810a4d3b9 |
| status | ACTIVE |
| status_reason | CLUSTER_RESIZE: number of active nodes is equal or above desired_capacity (1). |
| timeout | 300 |
| updated_at | 2017-07-26T06:36:15Z |
| user_id | 0ed165520f9b443ca9040e4e1f44d7f0 |
+------------------+--------------------------------------------------------------------------------+

Log message:
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base [req-cec6fc0b-9a97-40c7-be71-7978a439e2d3 0ed165520f9b443ca9040e4e1f44d7f0 631b9209a992429fb70909d810a4d3b9 - - -] Unexpected exception occurred during action NODE_JOIN (198ab879-b2d9-46bb-94a9-dcaa7a910178) execution: Not Found (HTTP 404)
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base Traceback (most recent call last):
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base File "/usr/lib/python2.7/site-packages/senlin/engine/actions/base.py", line 478, in ActionProc
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base result, reason = action.execute()
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base File "/usr/lib/python2.7/site-packages/senlin/engine/actions/node_action.py", line 270, in execute
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base res, reason = self._execute()
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base File "/usr/lib/python2.7/site-packages/senlin/engine/actions/node_action.py", line 236, in _execute
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base return method()
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 153, in wrapper
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base return f(*args, **kwargs)
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base File "/usr/lib/python2.7/site-packages/senlin/engine/actions/node_action.py", line 162, in do_join
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base result = self.entity.do_join(self.context, cluster_id)
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base File "/usr/lib/python2.7/site-packages/senlin/engine/node.py", line 291, in do_join
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base res = pb.Profile.join_cluster(context, self, cluster_id)
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 153, in wrapper
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base return f(*args, **kwargs)
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base File "/usr/lib/python2.7/site-packages/senlin/profiles/base.py", line 270, in join_cluster
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base return profile.do_join(obj, cluster_id)
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base File "/usr/lib/python2.7/site-packages/senlin/profiles/os/nova/server.py", line 1140, in do_join
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base metadata = driver.server_metadata_get(obj.physical_id) or {}
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base File "/usr/lib/python2.7/site-packages/senlin/drivers/openstack/sdk.py", line 99, in invoke_with_catch
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base raise parse_exception(ex)
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base File "/usr/lib/python2.7/site-packages/senlin/drivers/openstack/sdk.py", line 87, in parse_exception
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base raise senlin_exc.InternalError(code=code, message=message)
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base InternalError: Not Found (HTTP 404)
2017-07-26 03:08:11.139 2440 ERROR senlin.engine.actions.base
2017-07-26 03:08:11.215 2440 ERROR senlin.engine.event [req-cec6fc0b-9a97-40c7-be71-7978a439e2d3 0ed165520f9b443ca9040e4e1f44d7f0 631b9209a992429fb70909d810a4d3b9 - - -] fabian_test [32b56212] NODE_JOIN - error: Not Found (HTTP 404)
2017-07-26 03:08:12.911 2441 DEBUG senlin.engine.actions.cluster_action [req-cec6fc0b-9a97-40c7-be71-7978a439e2d3 0ed165520f9b443ca9040e4e1f44d7f0 631b9209a992429fb70909d810a4d3b9 - - -] CLUSTER_ADD_NODES [6ae85970] failed _wait_for_dependents /usr/lib/python2.7/site-packages/senlin/engine/actions/cluster_action.py:72
2017-07-26 03:08:12.971 2441 ERROR senlin.engine.event [req-cec6fc0b-9a97-40c7-be71-7978a439e2d3 0ed165520f9b443ca9040e4e1f44d7f0 631b9209a992429fb70909d810a4d3b9 - - -] cluster_001 [cbab4413] CLUSTER_ADD_NODES - error: CLUSTER_ADD_NODES [6ae85970] failed

So, I think cluster node add faild, the cluster it should not be recorded faild node message.

In the following way, the bug will appear

1. senlin node-create -p xxx xxxx

2. nova delete obj_name

3. senlin cluster-node-add obj_name

chenyb4 (chenyb4)
Changed in senlin:
assignee: nobody → chenyb4 (chenyb4)
Revision history for this message
chenyb4 (chenyb4) wrote :

When execute cluster-node-add,you must perform the node's current state detection. The node status of database records is not updated every moment.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.