| 2014-10-20 23:02:50 |
Aleksandr Shaposhnikov |
bug |
|
|
added bug |
| 2014-10-20 23:02:50 |
Aleksandr Shaposhnikov |
attachment added |
|
Screen Shot 2014-10-20 at 15.59.13.png https://bugs.launchpad.net/bugs/1383511/+attachment/4240840/+files/Screen%20Shot%202014-10-20%20at%2015.59.13.png |
|
| 2014-10-20 23:03:02 |
Aleksandr Shaposhnikov |
tags |
|
scale |
|
| 2014-10-20 23:18:15 |
Aleksandr Shaposhnikov |
attachment added |
|
Diagnostic snapshot https://bugs.launchpad.net/fuel/+bug/1383511/+attachment/4240842/+files/fuel-snapshot-2014-10-20_23-58-41.tgz |
|
| 2014-10-21 12:48:50 |
Nastya Urlapova |
fuel: milestone |
|
6.0 |
|
| 2014-10-21 12:49:08 |
Nastya Urlapova |
fuel: assignee |
|
Fuel Astute Team (fuel-astute) |
|
| 2014-10-22 06:15:19 |
Vladimir Sharshov |
fuel: assignee |
Fuel Astute Team (fuel-astute) |
Vladimir Sharshov (vsharshov) |
|
| 2014-10-22 06:15:34 |
Vladimir Sharshov |
fuel: assignee |
Vladimir Sharshov (vsharshov) |
Fuel UI Team (fuel-ui) |
|
| 2014-10-23 13:40:31 |
Bogdan Dobrelya |
fuel: status |
New |
Confirmed |
|
| 2014-10-23 13:40:39 |
Bogdan Dobrelya |
fuel: importance |
Undecided |
High |
|
| 2014-10-27 13:36:06 |
Vitaly Kramskikh |
fuel: assignee |
Fuel UI Team (fuel-ui) |
Fuel Python Team (fuel-python) |
|
| 2014-10-28 08:30:02 |
Tomasz 'Zen' Napierala |
fuel: assignee |
Fuel Python Team (fuel-python) |
Łukasz Oleś (loles) |
|
| 2014-10-28 08:55:15 |
Tomasz 'Zen' Napierala |
bug |
|
|
added subscriber Tomasz 'Zen' Napierala |
| 2014-10-28 11:21:28 |
Łukasz Oleś |
fuel: assignee |
Łukasz Oleś (loles) |
|
|
| 2014-10-28 11:21:45 |
Łukasz Oleś |
fuel: assignee |
|
Fuel Python Team (fuel-python) |
|
| 2014-10-28 20:45:26 |
Aleksandr Shaposhnikov |
attachment added |
|
Screen Shot 2014-10-28 at 13.43.34.png https://bugs.launchpad.net/fuel/+bug/1383511/+attachment/4247540/+files/Screen%20Shot%202014-10-28%20at%2013.43.34.png |
|
| 2014-11-03 13:30:48 |
OpenStack Infra |
fuel: status |
Confirmed |
In Progress |
|
| 2014-11-03 13:30:48 |
OpenStack Infra |
fuel: assignee |
Fuel Python Team (fuel-python) |
Dima Shulyak (dshulyak) |
|
| 2014-11-05 06:19:20 |
Dima Shulyak |
fuel: status |
In Progress |
Confirmed |
|
| 2014-11-05 06:19:35 |
Dima Shulyak |
fuel: assignee |
Dima Shulyak (dshulyak) |
Roman Prykhodchenko (romcheg) |
|
| 2014-11-13 10:41:01 |
Matthew Mosesohn |
fuel: assignee |
Roman Prykhodchenko (romcheg) |
Matthew Mosesohn (raytrac3r) |
|
| 2014-11-24 12:13:47 |
Vladimir Kuklin |
fuel: assignee |
Matthew Mosesohn (raytrac3r) |
Fuel Astute Team (fuel-astute) |
|
| 2014-11-24 15:35:45 |
Dima Shulyak |
fuel: importance |
High |
Medium |
|
| 2014-11-24 15:35:51 |
Dima Shulyak |
fuel: assignee |
Fuel Astute Team (fuel-astute) |
Fuel Library Team (fuel-library) |
|
| 2014-11-24 15:35:53 |
Dima Shulyak |
fuel: milestone |
6.0 |
6.1 |
|
| 2014-11-24 15:36:29 |
Dima Shulyak |
summary |
Controller deployment completion wasn't seen by Fuel/MOS masternode |
Supervisord sends SIGINT signals for random reasons |
|
| 2014-11-24 15:45:24 |
Roman Prykhodchenko |
summary |
Supervisord sends SIGINT signals for random reasons |
receiverd ACKs messages if it was interrupted |
|
| 2014-11-24 15:49:10 |
Roman Prykhodchenko |
description |
During 100 nodes cluster deployment MOS/Fuel masternode didn't see that last controller was finished his deployment procedure.
Here is last lines of puppet logs from controller itself(about half hour ago):
Mon Oct 20 22:35:57 +0000 2014 Stage[main] (info): Evaluated in 0.36 seconds
Mon Oct 20 22:35:57 +0000 2014 Stage[glance-image] (info): Starting to evaluate the resource
Mon Oct 20 22:35:57 +0000 2014 Stage[glance-image] (info): Evaluated in 0.02 seconds
Mon Oct 20 22:35:57 +0000 2014 Stage[glance-image] (info): Starting to evaluate the resource
Mon Oct 20 22:35:57 +0000 2014 Stage[glance-image] (info): Evaluated in 0.01 seconds
Mon Oct 20 22:35:57 +0000 2014 Puppet (debug): Finishing transaction 70365384691300
Mon Oct 20 22:35:57 +0000 2014 Puppet (debug): Storing state
Mon Oct 20 22:35:57 +0000 2014 Puppet (info): Creating state file /var/lib/puppet/state/state.yaml
Mon Oct 20 22:35:57 +0000 2014 Puppet (debug): Stored state in 0.16 seconds
Mon Oct 20 22:35:57 +0000 2014 Puppet (notice): Finished catalog run in 1270.24 seconds
Please find diagnostic snapshot and screenshot of Fuel UI in attachments. |
[UPD]: receiverd sends ACKs for all messages even if it was interrupted in the middle of processing one. Because of that some messages do not get processed after receiverd is restarted. One of the consequences which happened in the test lab is the following:
During 100 nodes cluster deployment MOS/Fuel masternode didn't see that last controller was finished his deployment procedure.
Here is last lines of puppet logs from controller itself(about half hour ago):
Mon Oct 20 22:35:57 +0000 2014 Stage[main] (info): Evaluated in 0.36 seconds
Mon Oct 20 22:35:57 +0000 2014 Stage[glance-image] (info): Starting to evaluate the resource
Mon Oct 20 22:35:57 +0000 2014 Stage[glance-image] (info): Evaluated in 0.02 seconds
Mon Oct 20 22:35:57 +0000 2014 Stage[glance-image] (info): Starting to evaluate the resource
Mon Oct 20 22:35:57 +0000 2014 Stage[glance-image] (info): Evaluated in 0.01 seconds
Mon Oct 20 22:35:57 +0000 2014 Puppet (debug): Finishing transaction 70365384691300
Mon Oct 20 22:35:57 +0000 2014 Puppet (debug): Storing state
Mon Oct 20 22:35:57 +0000 2014 Puppet (info): Creating state file /var/lib/puppet/state/state.yaml
Mon Oct 20 22:35:57 +0000 2014 Puppet (debug): Stored state in 0.16 seconds
Mon Oct 20 22:35:57 +0000 2014 Puppet (notice): Finished catalog run in 1270.24 seconds
Please find diagnostic snapshot and screenshot of Fuel UI in attachments. |
|
| 2014-11-24 15:49:18 |
Roman Prykhodchenko |
fuel: assignee |
Fuel Library Team (fuel-library) |
Dima Shulyak (dshulyak) |
|
| 2014-11-24 15:49:21 |
Roman Prykhodchenko |
fuel: status |
Confirmed |
Fix Committed |
|
| 2014-11-24 15:50:05 |
Roman Prykhodchenko |
fuel: milestone |
6.1 |
6.0 |
|
