VMWare: AssertionError: Trying to re-send() an already-triggered event.

Bug #1246848 reported by Gary Kotton
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Fix Released
High
Gary Kotton
Havana
Fix Released
High
Tracy Jones
VMwareAPI-Team
In Progress
High
Gary Kotton

Bug Description

When an exceptin occurs in _wait_for_task and a failure occurs, for example a file is requested and it does not exists then another exception is also thrown:

013-10-31 10:49:52.617 WARNING nova.virt.vmwareapi.driver [-] In vmwareapi:_poll_task, Got this error Trying to re-send() an already-triggered event.
2013-10-31 10:49:52.618 ERROR nova.openstack.common.loopingcall [-] in fixed duration looping call
2013-10-31 10:49:52.618 TRACE nova.openstack.common.loopingcall Traceback (most recent call last):
2013-10-31 10:49:52.618 TRACE nova.openstack.common.loopingcall File "/opt/stack/nova/nova/openstack/common/loopingcall.py", line 78, in _inner
2013-10-31 10:49:52.618 TRACE nova.openstack.common.loopingcall self.f(*self.args, **self.kw)
2013-10-31 10:49:52.618 TRACE nova.openstack.common.loopingcall File "/opt/stack/nova/nova/virt/vmwareapi/driver.py", line 941, in _poll_task
2013-10-31 10:49:52.618 TRACE nova.openstack.common.loopingcall done.send_exception(excep)
2013-10-31 10:49:52.618 TRACE nova.openstack.common.loopingcall File "/usr/local/lib/python2.7/dist-packages/eventlet/event.py", line 208, in send_exception
2013-10-31 10:49:52.618 TRACE nova.openstack.common.loopingcall return self.send(None, args)
2013-10-31 10:49:52.618 TRACE nova.openstack.common.loopingcall File "/usr/local/lib/python2.7/dist-packages/eventlet/event.py", line 150, in send
2013-10-31 10:49:52.618 TRACE nova.openstack.common.loopingcall assert self._result is NOT_USED, 'Trying to re-send() an already-triggered event.'
2013-10-31 10:49:52.618 TRACE nova.openstack.common.loopingcall AssertionError: Trying to re-send() an already-triggered event.
2013-10-31 10:49:52.618 TRACE nova.openstack.common.loopingcall

Tags: vmware
Gary Kotton (garyk)
Changed in nova:
importance: Undecided → High
tags: added: grizzly-backport-potential havana-backport-potential vmware
Revision history for this message
Gary Kotton (garyk) wrote :
Changed in nova:
assignee: nobody → Gary Kotton (garyk)
milestone: none → icehouse-1
Gary Kotton (garyk)
Changed in nova:
status: New → In Progress
Gary Kotton (garyk)
Changed in openstack-vmwareapi-team:
importance: Undecided → High
assignee: nobody → Gary Kotton (garyk)
Changed in nova:
milestone: icehouse-1 → icehouse-2
Revision history for this message
dan wendlandt (danwent) wrote :

Can we update the bug title to be more descriptive now that we understand the problem?

Tracy Jones (tjones-i)
Changed in openstack-vmwareapi-team:
status: New → In Progress
Thierry Carrez (ttx)
Changed in nova:
milestone: icehouse-2 → icehouse-3
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (master)

Reviewed: https://review.openstack.org/54808
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=1c1570ff7ac8470d7dba28c893300835b22e0966
Submitter: Jenkins
Branch: master

commit 1c1570ff7ac8470d7dba28c893300835b22e0966
Author: Gary Kotton <email address hidden>
Date: Thu Oct 31 12:07:54 2013 -0700

    VMware: fix bug for exceptions thrown in _wait_for_task

    If the _call_method fails, for example a resource is not found,
    then the same call will be invoked again due to the fact that the
    polling task was not stopped.

    Closes-Bug: #1246848

    Change-Id: If4818e41aed5be03395ab22afc0edf9abb3c34e1

Changed in nova:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to nova (stable/havana)

Fix proposed to branch: stable/havana
Review: https://review.openstack.org/74439

Thierry Carrez (ttx)
Changed in nova:
status: Fix Committed → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to nova (stable/havana)

Reviewed: https://review.openstack.org/74439
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=5661055b8b138aa027b4e3f3d3d7f8a2ec928adf
Submitter: Jenkins
Branch: stable/havana

commit 5661055b8b138aa027b4e3f3d3d7f8a2ec928adf
Author: Gary Kotton <email address hidden>
Date: Thu Oct 31 12:07:54 2013 -0700

    VMware: fix bug for exceptions thrown in _wait_for_task

    If the _call_method fails, for example a resource is not found,
    then the same call will be invoked again due to the fact that the
    polling task was not stopped.

    Closes-Bug: #1246848

    Change-Id: If4818e41aed5be03395ab22afc0edf9abb3c34e1
    (cherry picked from commit 1c1570ff7ac8470d7dba28c893300835b22e0966)

tags: added: in-stable-havana
Alan Pevec (apevec)
tags: removed: grizzly-backport-potential havana-backport-potential in-stable-havana
Thierry Carrez (ttx)
Changed in nova:
milestone: icehouse-3 → 2014.1
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on nova (master)

Change abandoned by Joe Gordon (<email address hidden>) on branch: master
Review: https://review.openstack.org/71701
Reason: Patch is stalled waiting for the author, looks like this has been abandoned. Feel free to restore.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.