Router VMs that are slow to delete cause a tight loop in the state machine

Bug #1470480 reported by Ryan Petrello
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
akanda
New
Medium
Unassigned

Bug Description

We've noticed in situations where Nova is slow to delete router VMs that rug workers can get caught in a tight loop, preventing other events from being processed, e.g.,

2015-05-18 18:47:07:INFO:akanda.rug.state.:p00:t00:Previous router is deleting
2015-05-18 18:47:07:DEBUG:akanda.rug.state.:p00:t00:CreateVM.execute -> poll vm.state=down
2015-05-18 18:47:07:DEBUG:akanda.rug.state.:p00:t00:CreateVM.transition(poll) -> CreateVM vm.state=down
2015-05-18 18:47:07:DEBUG:akanda.rug.state.:p00:t00:CreateVM.execute(poll) vm.state=down
2015-05-18 18:47:08:INFO:akanda.rug.state.:p00:t00:Booting router
2015-05-18 18:47:09:INFO:akanda.rug.state.:p00:t00:Previous router is deleting
2015-05-18 18:47:09:DEBUG:akanda.rug.state.:p00:t00:CreateVM.execute -> poll vm.state=down
2015-05-18 18:47:09:DEBUG:akanda.rug.state.:p00:t00:CreateVM.transition(poll) -> CreateVM vm.state=down
2015-05-18 18:47:09:DEBUG:akanda.rug.state.:p00:t00:CreateVM.execute(poll) vm.state=down
2015-05-18 18:47:11:INFO:akanda.rug.state.:p00:t00:Booting router
2015-05-18 18:47:12:INFO:akanda.rug.state.:p00:t00:Previous router is deleting
2015-05-18 18:47:12:DEBUG:akanda.rug.state.:p00:t00:CreateVM.execute -> poll vm.state=down
2015-05-18 18:47:12:DEBUG:akanda.rug.state.:p00:t00:CreateVM.transition(poll) -> CreateVM vm.state=down
2015-05-18 18:47:12:DEBUG:akanda.rug.state.:p00:t00:CreateVM.execute(poll) vm.state=down
2015-05-18 18:47:12:INFO:akanda.rug.state.:p00:t00:Booting router
2015-05-18 18:47:13:INFO:akanda.rug.state.:p00:t00:Previous router is deleting
2015-05-18 18:47:13:DEBUG:akanda.rug.state.:p00:t00:CreateVM.execute -> poll vm.state=down
2015-05-18 18:47:13:DEBUG:akanda.rug.state.:p00:t00:CreateVM.transition(poll) -> CreateVM vm.state=down
2015-05-18 18:47:13:DEBUG:akanda.rug.state.:p00:t00:CreateVM.execute(poll) vm.state=down
2015-05-18 18:47:14:INFO:akanda.rug.state.:p00:t00:Booting router

It might be nice for this process to be asynchronous in the same way as `CreateVM -> CheckBoot`.

Tags: akanda-rug
Sean Roberts (sarob)
Changed in akanda:
importance: Undecided → Medium
tags: added: akanda-rug
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.