when do health check, it was raised in db

Step:
1.Update /opt/stack/senlin to commit f0066505b45b9dba9cf2961578c0a7cbd7af8f2a
root@tecs:/opt/stack/senlin# git log
commit f0066505b45b9dba9cf2961578c0a7cbd7af8f2a
Merge: e139707 40889bf
Author: Jenkins <email address hidden>
Date: Tue Jan 24 10:18:36 2017 +0000

    Merge "Fix health check enable/disable problem"

2. Run senlin-manage db_sync

3.Update cluster policy of mycluster4: senlin cluster-policy-update mycluster4 -p hp01 -e False

4.It will fail
2017-01-24 21:30:19.361 INFO senlin.engine.service [req-cf0d3b57-8a8b-4e80-ae8a-90a36fa3f01e admin admin] Updating policy 'hp01' on cluster '4fda1570-a403-4567-a4e9-275d33f704f8.'
2017-01-24 21:30:45.530 DEBUG oslo_messaging._drivers.amqpdriver [req-cf0d3b57-8a8b-4e80-ae8a-90a36fa3f01e None None] CAST unique_id: 47e4baccfa20408fa85715f69efd9203 FANOUT topic 'engine-dispatcher' from (pid=2935) _send /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:440
2017-01-24 21:30:45.533 INFO senlin.engine.service [req-cf0d3b57-8a8b-4e80-ae8a-90a36fa3f01e None None] Policy update action queued: 63231fe1-1be8-4d2c-b35e-58901dccdd81.
2017-01-24 21:30:45.534 DEBUG oslo_messaging._drivers.amqpdriver [req-cf0d3b57-8a8b-4e80-ae8a-90a36fa3f01e None None] sending reply msg_id: c633adcc3eb749a88feea26a3fdbbcf4 reply queue: reply_6e64feb5ab5846989dee32cb6cfc2f50 time elapsed: 26.1751339296s from (pid=2935) _send_reply /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:73
2017-01-24 21:30:45.536 DEBUG oslo_messaging._drivers.amqpdriver [-] received message with unique_id: 47e4baccfa20408fa85715f69efd9203 from (pid=2935) __call__ /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:196
2017-01-24 21:32:22.409 INFO senlin.engine.event [req-c6758068-5d4e-4d97-8e53-817538f90814 None None] mycluster1 [d2f0dc8d] CLUSTER_CHECK - start: None
2017-01-24 21:32:26.955 INFO senlin.engine.event [req-cf0d3b57-8a8b-4e80-ae8a-90a36fa3f01e None None] mycluster4 [4fda1570] CLUSTER_UPDATE_POLICY - start: None
2017-01-24 21:32:55.237 INFO senlin.engine.event [req-8623704a-e93f-40f6-bdb3-48d27ab01853 None None] mycluster4 [4fda1570] CLUSTER_CHECK - start: None
2017-01-24 21:33:13.750 INFO senlin.engine.event [req-93403aa3-43ea-4a21-9b97-f65e0d819b4f None None] mycluster1 [d2f0dc8d] CLUSTER_CHECK - start: None
2017-01-24 21:33:28.226 ERROR senlin.engine.senlin_lock [req-8623704a-e93f-40f6-bdb3-48d27ab01853 None None] Cluster is already locked by action [u'63231fe1-1be8-4d2c-b35e-58901dccdd81'], action 59014132-6544-4898-9876-956625d5e000 failed grabbing the lock
2017-01-24 21:33:28.236 ERROR senlin.engine.senlin_lock [req-93403aa3-43ea-4a21-9b97-f65e0d819b4f None None] Cluster is already locked by action [u'6052770e-de77-496e-8cd7-d0a705d41641'], action e758800a-22c6-409d-928a-586075644dcf failed grabbing the lock
2017-01-24 21:33:28.351 INFO senlin.engine.event [req-13cab1a9-5906-4a61-9af3-1426f26d6918 None None] mycluster1 [d2f0dc8d] CLUSTER_CHECK - start: None
2017-01-24 21:33:28.367 ERROR senlin.engine.senlin_lock [req-13cab1a9-5906-4a61-9af3-1426f26d6918 None None] Cluster is already locked by action [u'6052770e-de77-496e-8cd7-d0a705d41641'], action 8e48b817-6042-4123-9f41-b78830531a54 failed grabbing the lock
2017-01-24 21:33:28.403 INFO senlin.engine.event [req-4b618eb4-ee8f-410f-931e-4ec87897654d None None] mycluster4 [4fda1570] CLUSTER_CHECK - start: None
2017-01-24 21:33:28.441 ERROR senlin.engine.senlin_lock [req-4b618eb4-ee8f-410f-931e-4ec87897654d None None] Cluster is already locked by action [u'63231fe1-1be8-4d2c-b35e-58901dccdd81'], action 3f480999-fd4c-4742-9f32-5c71bf1f7616 failed grabbing the lock
2017-01-24 21:33:28.469 WARNING senlin.engine.event [req-8623704a-e93f-40f6-bdb3-48d27ab01853 None None] mycluster4 [4fda1570] CLUSTER_CHECK - error: Failed in locking cluster.
2017-01-24 21:33:28.470 WARNING senlin.engine.event [req-93403aa3-43ea-4a21-9b97-f65e0d819b4f None None] mycluster1 [d2f0dc8d] CLUSTER_CHECK - error: Failed in locking cluster.
2017-01-24 21:33:28.523 WARNING senlin.engine.event [req-13cab1a9-5906-4a61-9af3-1426f26d6918 None None] mycluster1 [d2f0dc8d] CLUSTER_CHECK - error: Failed in locking cluster.
2017-01-24 21:33:28.826 WARNING senlin.engine.event [req-4b618eb4-ee8f-410f-931e-4ec87897654d None None] mycluster4 [4fda1570] CLUSTER_CHECK - error: Failed in locking cluster.
2017-01-24 21:33:28.863 INFO senlin.engine.event [req-cf0d3b57-8a8b-4e80-ae8a-90a36fa3f01e None None] mycluster4 [4fda1570] CLUSTER_UPDATE_POLICY - end: Policy updated.
2017-01-24 21:33:28.952 DEBUG oslo_messaging._drivers.amqpdriver [req-c6758068-5d4e-4d97-8e53-817538f90814 None None] CAST unique_id: aea7f83ed8d844a085624b4735ff4211 FANOUT topic 'engine-dispatcher' from (pid=2935) _send /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:440
2017-01-24 21:33:28.964 DEBUG oslo_messaging._drivers.amqpdriver [-] received message with unique_id: aea7f83ed8d844a085624b4735ff4211 from (pid=2935) __call__ /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:196
2017-01-24 21:33:28.987 DEBUG senlin.engine.scheduler [req-c6758068-5d4e-4d97-8e53-817538f90814 None None] Action 6052770e-de77-496e-8cd7-d0a705d41641 sleep for 3 seconds from (pid=2935) reschedule /opt/stack/senlin/senlin/engine/scheduler.py:199
2017-01-24 21:33:29.086 INFO senlin.engine.event [req-c6758068-5d4e-4d97-8e53-817538f90814 None None] mynode22 [ab898b6e] NODE_CHECK - start: None
2017-01-24 21:33:34.293 DEBUG senlin.engine.scheduler [req-c6758068-5d4e-4d97-8e53-817538f90814 None None] Action 6052770e-de77-496e-8cd7-d0a705d41641 sleep for 3 seconds from (pid=2935) reschedule /opt/stack/senlin/senlin/engine/scheduler.py:199
2017-01-24 21:33:56.650 DEBUG senlin.engine.scheduler [req-c6758068-5d4e-4d97-8e53-817538f90814 None None] Action 6052770e-de77-496e-8cd7-d0a705d41641 sleep for 3 seconds from (pid=2935) reschedule /opt/stack/senlin/senlin/engine/scheduler.py:199
2017-01-24 21:34:29.554 DEBUG senlin.engine.scheduler [req-c6758068-5d4e-4d97-8e53-817538f90814 None None] Action 6052770e-de77-496e-8cd7-d0a705d41641 sleep for 3 seconds from (pid=2935) reschedule /opt/stack/senlin/senlin/engine/scheduler.py:199
2017-01-24 21:34:53.608 DEBUG senlin.engine.scheduler [req-c6758068-5d4e-4d97-8e53-817538f90814 None None] Action 6052770e-de77-496e-8cd7-d0a705d41641 sleep for 3 seconds from (pid=2935) reschedule /opt/stack/senlin/senlin/engine/scheduler.py:199
2017-01-24 21:34:53.665 INFO senlin.engine.event [req-c6758068-5d4e-4d97-8e53-817538f90814 None None] mynode21 [c4658723] NODE_CHECK - start: None
2017-01-24 21:34:53.718 INFO senlin.engine.event [req-93403aa3-43ea-4a21-9b97-f65e0d819b4f None None] mycluster1 [d2f0dc8d] CLUSTER_CHECK - start: None
2017-01-24 21:34:53.733 ERROR senlin.engine.senlin_lock [req-93403aa3-43ea-4a21-9b97-f65e0d819b4f None None] Cluster is already locked by action [u'6052770e-de77-496e-8cd7-d0a705d41641'], action e758800a-22c6-409d-928a-586075644dcf failed grabbing the lock
2017-01-24 21:34:53.757 INFO senlin.engine.event [req-13cab1a9-5906-4a61-9af3-1426f26d6918 None None] mycluster1 [d2f0dc8d] CLUSTER_CHECK - start: None
2017-01-24 21:34:53.762 INFO senlin.engine.event [req-c6758068-5d4e-4d97-8e53-817538f90814 None None] mynode22 [ab898b6e] NODE_CHECK - end: Node status is ACTIVE.
2017-01-24 21:34:53.763 INFO senlin.engine.event [req-8623704a-e93f-40f6-bdb3-48d27ab01853 None None] mycluster4 [4fda1570] CLUSTER_CHECK - start: None
2017-01-24 21:34:53.766 INFO senlin.engine.event [req-4b618eb4-ee8f-410f-931e-4ec87897654d None None] mycluster4 [4fda1570] CLUSTER_CHECK - start: None
2017-01-24 21:34:53.800 ERROR senlin.engine.actions.base [req-4b618eb4-ee8f-410f-931e-4ec87897654d None None] Unexpected exception occurred during action CLUSTER_CHECK (3f480999-fd4c-4742-9f32-5c71bf1f7616) execution: (pymysql.err.IntegrityError) (1062, u"Duplicate entry '4fda1570-a403-4567-a4e9-275d33f704f8' for key 'PRIMARY'") [SQL: u'INSERT INTO cluster_lock (cluster_id, action_ids, semaphore) VALUES (%(cluster_id)s, %(action_ids)s, %(semaphore)s)'] [parameters: {'action_ids': '["3f480999-fd4c-4742-9f32-5c71bf1f7616"]', 'cluster_id': '4fda1570-a403-4567-a4e9-275d33f704f8', 'semaphore': -1}]
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base Traceback (most recent call last):
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/opt/stack/senlin/senlin/engine/actions/base.py", line 501, in ActionProc
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base result, reason = action.execute()
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/opt/stack/senlin/senlin/engine/actions/cluster_action.py", line 992, in execute
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base forced)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/opt/stack/senlin/senlin/engine/senlin_lock.py", line 53, in cluster_lock_acquire
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base owners = cl_obj.ClusterLock.acquire(cluster_id, action_id, scope)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/opt/stack/senlin/senlin/objects/cluster_lock.py", line 32, in acquire
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base return db_api.cluster_lock_acquire(cluster_id, action_id, scope)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/opt/stack/senlin/senlin/db/api.py", line 124, in cluster_lock_acquire
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base return IMPL.cluster_lock_acquire(cluster_id, action_id, scope)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/opt/stack/senlin/senlin/db/sqlalchemy/api.py", line 420, in cluster_lock_acquire
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base return lock.action_ids
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base self.gen.next()
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 875, in _transaction_scope
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base yield resource
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base self.gen.next()
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 522, in _session
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base self._end_session_transaction(self.session)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 543, in _end_session_transaction
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base session.commit()
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 801, in commit
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base self.transaction.commit()
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 392, in commit
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base self._prepare_impl()
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 372, in _prepare_impl
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base self.session.flush()
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 2019, in flush
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base self._flush(objects)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 2137, in _flush
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base transaction.rollback(_capture_exception=True)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base compat.reraise(exc_type, exc_value, exc_tb)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 2101, in _flush
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base flush_context.execute()
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/unitofwork.py", line 373, in execute
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base rec.execute(self)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/unitofwork.py", line 532, in execute
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base uow
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/persistence.py", line 174, in save_obj
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base mapper, table, insert)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/persistence.py", line 767, in _emit_insert_statements
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base execute(statement, multiparams)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base return meth(self, multiparams, params)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base return connection._execute_clauseelement(self, multiparams, params)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base compiled_sql, distilled_params
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base context)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base util.raise_from_cause(newraise, exc_info)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 202, in raise_from_cause
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base reraise(type(exception), exception, tb=exc_tb, cause=cause)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base context)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base cursor.execute(statement, parameters)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/pymysql/cursors.py", line 166, in execute
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base result = self._query(query)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/pymysql/cursors.py", line 322, in _query
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base conn.query(q)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/pymysql/connections.py", line 835, in query
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base self._affected_rows = self._read_query_result(unbuffered=unbuffered)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/pymysql/connections.py", line 1019, in _read_query_result
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base result.read()
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/pymysql/connections.py", line 1302, in read
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base first_packet = self.connection._read_packet()
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/pymysql/connections.py", line 981, in _read_packet
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base packet.check_error()
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/pymysql/connections.py", line 393, in check_error
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base err.raise_mysql_exception(self._data)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base File "/usr/local/lib/python2.7/dist-packages/pymysql/err.py", line 107, in raise_mysql_exception
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base raise errorclass(errno, errval)
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, u"Duplicate entry '4fda1570-a403-4567-a4e9-275d33f704f8' for key 'PRIMARY'") [SQL: u'INSERT INTO cluster_lock (cluster_id, action_ids, semaphore) VALUES (%(cluster_id)s, %(action_ids)s, %(semaphore)s)'] [parameters: {'action_ids': '["3f480999-fd4c-4742-9f32-5c71bf1f7616"]', 'cluster_id': '4fda1570-a403-4567-a4e9-275d33f704f8', 'semaphore': -1}]
2017-01-24 21:34:53.800 TRACE senlin.engine.actions.base
2017-01-24 21:34:53.809 ERROR senlin.engine.senlin_lock [req-13cab1a9-5906-4a61-9af3-1426f26d6918 None None] Cluster is already locked by action [u'6052770e-de77-496e-8cd7-d0a705d41641'], action 8e48b817-6042-4123-9f41-b78830531a54 failed grabbing the lock
2017-01-24 21:34:53.880 WARNING senlin.engine.event [req-93403aa3-43ea-4a21-9b97-f65e0d819b4f None None] mycluster1 [d2f0dc8d] CLUSTER_CHECK - error: Failed in locking cluster.
2017-01-24 21:34:53.943 ERROR senlin.engine.event [req-4b618eb4-ee8f-410f-931e-4ec87897654d None None] mycluster4 [4fda1570] CLUSTER_CHECK - error: (pymysql.err.IntegrityError) (1062, u"Duplicate entry '4fda1570-a403-4567-a4e9-275d33f704f8' for key 'PRIMARY'") [SQL: u'INSERT INTO cluster_lock (cluster_id, action_ids, semaphore) VALUES (%(cluster_id)s, %(action_ids)s, %(semaphore)s)'] [parameters: {'action_ids': '["3f480999-fd4c-4742-9f32-5c71bf1f7616"]', 'cluster_id': '4fda1570-a403-4567-a4e9-275d33f704f8', 'semaphore': -1}]
2017-01-24 21:34:53.971 WARNING senlin.engine.event [req-13cab1a9-5906-4a61-9af3-1426f26d6918 None None] mycluster1 [d2f0dc8d] CLUSTER_CHECK - error: Failed in locking cluster.
2017-01-24 21:34:54.195 DEBUG oslo_messaging._drivers.amqpdriver [req-8623704a-e93f-40f6-bdb3-48d27ab01853 None None] CAST unique_id: 2d1c0534e9d74472965d3963c05f121d FANOUT topic 'engine-dispatcher' from (pid=2935) _send /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:440
2017-01-24 21:34:54.208 DEBUG oslo_messaging._drivers.amqpdriver [-] received message with unique_id: 2d1c0534e9d74472965d3963c05f121d from (pid=2935) __call__ /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:196
2017-01-24 21:34:54.227 DEBUG senlin.engine.scheduler [req-8623704a-e93f-40f6-bdb3-48d27ab01853 None None] Action 59014132-6544-4898-9876-956625d5e000 sleep for 3 seconds from (pid=2935) reschedule /opt/stack/senlin/senlin/engine/scheduler.py:199
2017-01-24 21:34:59.847 DEBUG senlin.engine.scheduler [req-c6758068-5d4e-4d97-8e53-817538f90814 None None] Action 6052770e-de77-496e-8cd7-d0a705d41641 sleep for 3 seconds from (pid=2935) reschedule /opt/stack/senlin/senlin/engine/scheduler.py:199
2017-01-24 21:34:59.848 DEBUG senlin.engine.scheduler [req-8623704a-e93f-40f6-bdb3-48d27ab01853 None None] Action 59014132-6544-4898-9876-956625d5e000 sleep for 3 seconds from (pid=2935) reschedule /opt/stack/senlin/senlin/engine/scheduler.py:199
2017-01-24 21:34:59.869 INFO senlin.engine.event [req-8623704a-e93f-40f6-bdb3-48d27ab01853 None None] mynode31 [d343764d] NODE_CHECK - start: None
2017-01-24 21:35:16.823 DEBUG senlin.engine.scheduler [req-c6758068-5d4e-4d97-8e53-817538f90814 None None] Action 6052770e-de77-496e-8cd7-d0a705d41641 sleep for 3 seconds from (pid=2935) reschedule /opt/stack/senlin/senlin/engine/scheduler.py:199