Cluster scaling fails if used heat as infrastructure engine

env: sahara with heat engine

Steps to reprocude:

1. Create two sahara cluster
2. Scale up one cluster.

Result:

2015-01-24 14:27:42.533 4953 DEBUG heatclient.common.http [-] curl -i -X GET -H 'X-Auth-Token: {SHA1}85d735c5bc6df5b397d8269c3244eb08fb4c49b3' -H 'Content-Type: application/json' -H 'Accept: application/json' -H 'User-Agent: python-heatclient' http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks? log_curl_request /usr/local/lib/python2.7/dist-packages/heatclient/common/http.py:120
2015-01-24 14:27:42.817 4953 DEBUG heatclient.common.http [-]
HTTP/1.1 200 OK
date: Sat, 24 Jan 2015 14:27:57 GMT
connection: keep-alive
content-type: application/json; charset=UTF-8
content-length: 7258
x-openstack-request-id: req-9f2cc609-8676-4a23-aece-6e5e27f2ae75

{"stacks": [{"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-6-51-149821-1-vanilla-v2/a69fcf95-1343-41ab-a642-32bba6c1be08", "rel": "self"}], "stack_status_reason": "Stack CREATE completed successfully", "stack_name": "c1-2-6-51-149821-1-vanilla-v2", "creation_time": "2015-01-24T14:20:14Z", "updated_time": null, "stack_owner": null, "stack_status": "CREATE_COMPLETE", "id": "a69fcf95-1343-41ab-a642-32bba6c1be08"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-4-55-149821-1-vanilla-v2/cb314f2e-c6ec-41b0-8f7f-74bef2168dff", "rel": "self"}], "stack_status_reason": "Stack CREATE completed successfully", "stack_name": "c1-2-4-55-149821-1-vanilla-v2", "creation_time": "2015-01-24T14:16:47Z", "updated_time": null, "stack_owner": null, "stack_status": "CREATE_COMPLETE", "id": "cb314f2e-c6ec-41b0-8f7f-74bef2168dff"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-1-621-147933-16-2-transient/ae5fa4a4-e8a3-4ad0-b8e6-4640369c3818", "rel": "self"}], "stack_status_reason": "Resource DELETE failed: BadRequest: Expecting to find username or userId in passwordCredentials - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400)", "stack_name": "c1-1-621-147933-16-2-transient", "creation_time": "2015-01-24T14:07:27Z", "updated_time": null, "stack_owner": null, "stack_status": "DELETE_FAILED", "id": "ae5fa4a4-e8a3-4ad0-b8e6-4640369c3818"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-1-621-147933-16-1-transient/52e0b63e-cf78-4cfd-94f4-8191c018c160", "rel": "self"}], "stack_status_reason": "Resource DELETE failed: BadRequest: Expecting to find username or userId in passwordCredentials - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400)", "stack_name": "c1-1-621-147933-16-1-transient", "creation_time": "2015-01-24T14:07:24Z", "updated_time": null, "stack_owner": null, "stack_status": "DELETE_FAILED", "id": "52e0b63e-cf78-4cfd-94f4-8191c018c160"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-6-656-147933-16-vanilla-v2/d0e954a7-7571-4ce8-bf45-f51183fdd77e", "rel": "self"}], "stack_status_reason": "Stack successfully updated", "stack_name": "c1-2-6-656-147933-16-vanilla-v2", "creation_time": "2015-01-24T13:50:20Z", "updated_time": "2015-01-24T14:03:16Z", "stack_owner": null, "stack_status": "UPDATE_COMPLETE", "id": "d0e954a7-7571-4ce8-bf45-f51183fdd77e"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-4-681-149714-2-vanilla-v2/886be276-fbd6-49e1-b933-f24360d29fa4", "rel": "self"}], "stack_status_reason": "Stack DELETE started", "stack_name": "c1-2-4-681-149714-2-vanilla-v2", "creation_time": "2015-01-24T09:22:42Z", "updated_time": "2015-01-24T09:33:48Z", "stack_owner": null, "stack_status": "DELETE_IN_PROGRESS", "id": "886be276-fbd6-49e1-b933-f24360d29fa4"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-4-679-147933-15-vanilla-v2/6cfad38e-549a-4349-b58c-0506080ffcef", "rel": "self"}], "stack_status_reason": "Stack DELETE started", "stack_name": "c1-2-4-679-147933-15-vanilla-v2", "creation_time": "2015-01-24T07:27:44Z", "updated_time": "2015-01-24T07:38:57Z", "stack_owner": null, "stack_status": "DELETE_IN_PROGRESS", "id": "6cfad38e-549a-4349-b58c-0506080ffcef"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-6-651-147933-14-vanilla-v2/9cea4721-cc6f-4891-8732-e8381e97786b", "rel": "self"}], "stack_status_reason": "Stack DELETE started", "stack_name": "c1-2-6-651-147933-14-vanilla-v2", "creation_time": "2015-01-24T06:21:18Z", "updated_time": "2015-01-24T06:33:26Z", "stack_owner": null, "stack_status": "DELETE_IN_PROGRESS", "id": "9cea4721-cc6f-4891-8732-e8381e97786b"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-4-675-146447-3-vanilla-v2/e7d0ab67-2933-4aee-a0af-18267ae6066b", "rel": "self"}], "stack_status_reason": "Stack DELETE started", "stack_name": "c1-2-4-675-146447-3-vanilla-v2", "creation_time": "2015-01-24T02:56:24Z", "updated_time": "2015-01-24T03:07:15Z", "stack_owner": null, "stack_status": "DELETE_IN_PROGRESS", "id": "e7d0ab67-2933-4aee-a0af-18267ae6066b"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-6-647-149714-2-vanilla-v2/7524f8a1-78f7-4eb4-853f-e7e3bbae3421", "rel": "self"}], "stack_status_reason": "Stack DELETE started", "stack_name": "c1-2-6-647-149714-2-vanilla-v2", "creation_time": "2015-01-24T02:09:44Z", "updated_time": "2015-01-24T02:21:48Z", "stack_owner": null, "stack_status": "DELETE_IN_PROGRESS", "id": "7524f8a1-78f7-4eb4-853f-e7e3bbae3421"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-4-670-149714-2-vanilla-v2/d27428fb-3c7f-4481-ba14-edbe3d06b38a", "rel": "self"}], "stack_status_reason": "Stack DELETE started", "stack_name": "c1-2-4-670-149714-2-vanilla-v2", "creation_time": "2015-01-23T20:48:05Z", "updated_time": "2015-01-23T21:00:13Z", "stack_owner": null, "stack_status": "DELETE_IN_PROGRESS", "id": "d27428fb-3c7f-4481-ba14-edbe3d06b38a"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-4-669-149716-1-vanilla-v2/e6ddfb22-58c3-4450-8e2c-416d61f5e36e", "rel": "self"}], "stack_status_reason": "Stack DELETE started", "stack_name": "c1-2-4-669-149716-1-vanilla-v2", "creation_time": "2015-01-23T20:22:56Z", "updated_time": "2015-01-23T20:34:16Z", "stack_owner": null, "stack_status": "DELETE_IN_PROGRESS", "id": "e6ddfb22-58c3-4450-8e2c-416d61f5e36e"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-4-667-149714-2-vanilla-v2/38b8a82c-7667-41e4-98bc-2493895d06b2", "rel": "self"}], "stack_status_reason": "Stack DELETE started", "stack_name": "c1-2-4-667-149714-2-vanilla-v2", "creation_time": "2015-01-23T19:30:03Z", "updated_time": "2015-01-23T19:41:42Z", "stack_owner": null, "stack_status": "DELETE_IN_PROGRESS", "id": "38b8a82c-7667-41e4-98bc-2493895d06b2"}]}
 log_http_response /usr/local/lib/python2.7/dist-packages/heatclient/common/http.py:133
2015-01-24 14:27:42.820 4953 DEBUG heatclient.common.http [-] curl -i -X PUT -H 'X-Auth-Token: {SHA1}85d735c5bc6df5b397d8269c3244eb08fb4c49b3' -H 'Content-Type: application/json' -H 'Accept: application/json' -H 'User-Agent: python-heatclient' -d '{"stack_name": "c1-2-4-55-149821-1-vanilla-v2", "disable_rollback": false, "template": {"AWSTemplateFormatVersion": "2010-09-09", "Outputs": {}, "Description": "Data Processing Cluster by Sahara", "Resources": {"c1-2-4-55-149821-1-vanilla-v2-worker-node-nm-dn-001": {"Type": "OS::Nova::Server", "Properties": {"admin_user": "ubuntu", "name": "c1-2-4-55-149821-1-vanilla-v2-worker-node-nm-dn-001", "key_name": "sahara-i-test-key-pair-5bfa538e", "image": "221c9555-4504-4a07-a690-2002218b64ff", "user_data": {"Fn::Join": ["\n", ["#!/bin/bash", "echo \"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAcC6TFjjAMQAiMI9IMNiJyHPK2rIBh3E+soRIOHG8DR72/xOOdbnxVkKDAlPhXEBfoJxKw1Jl42MkLDOZBmhWgu2lEQK3tTlahqpSEMHCrfvgxSaYYNYqLB/PhgKfjdagMgu5aT1TJiCiH+rnubBMGmI5sKIHz65fSd4sS5DMXONn0hgUFTRWTkBDzQu1B/u5qhO84GHnMqRj43ou8dOKUwiAovvz6IjWlO9mquNKNqXBuV1gvUqLokd0YdyKhb40PDJIfWVsZkB3Ysqtn8Vx9ioTN/446Y5O1Ui6OoMWoNipfiZRvA9ps3Z0xcTlr/zA+Cq8m1tuT+abUSvCVZi1 Generated by Sahara", "\" >> /home/ubuntu//.ssh/authorized_keys", "", "# ====== COMMENT OUT Defaults requiretty in /etc/sudoers ========", "sed '/^Defaults requiretty*/ s/^/#/' -i /etc/sudoers", ""]]}, "flavor": "20", "networks": [{"port": {"Ref": "c1-2-4-55-149821-1-vanilla-v2-worker-node-nm-dn-001-port"}}]}}, "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001-volume-1": {"Type": "OS::Cinder::Volume", "Properties": {"name": "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001-volume-1", "volume_type": null, "size": "2"}}, "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001-volume-0": {"Type": "OS::Cinder::Volume", "Properties": {"name": "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001-volume-0", "volume_type": null, "size": "2"}}, "c1-2-4-55-149821-1-vanilla-v2-worker-node-nm-dn-be3f1c7c": {"Type": "AWS::EC2::SecurityGroup", "Properties": {"SecurityGroupIngress": [{"ToPort": "50010", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "50010"}, {"ToPort": "50075", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "50075"}, {"ToPort": "50020", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "50020"}, {"ToPort": "8042", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "8042"}, {"ToPort": "22", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "22"}, {"ToPort": "65535", "IpProtocol": "tcp", "CidrIp": "10.20.0.0/24", "FromPort": "1"}, {"ToPort": "65535", "IpProtocol": "udp", "CidrIp": "10.20.0.0/24", "FromPort": "1"}, {"ToPort": "-1", "IpProtocol": "icmp", "CidrIp": "10.20.0.0/24", "FromPort": "-1"}], "GroupDescription": "Auto security group created by Sahara for Node Group 'worker-node-nm-dn' of cluster 'c1-2-4-55-149821-1-vanilla-v2'."}}, "c1-2-4-55-149821-1-vanilla-v2-worker-node-dn-4ee3d9c1": {"Type": "AWS::EC2::SecurityGroup", "Properties": {"SecurityGroupIngress": [{"ToPort": "50010", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "50010"}, {"ToPort": "50075", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "50075"}, {"ToPort": "50020", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "50020"}, {"ToPort": "22", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "22"}, {"ToPort": "65535", "IpProtocol": "tcp", "CidrIp": "10.20.0.0/24", "FromPort": "1"}, {"ToPort": "65535", "IpProtocol": "udp", "CidrIp": "10.20.0.0/24", "FromPort": "1"}, {"ToPort": "-1", "IpProtocol": "icmp", "CidrIp": "10.20.0.0/24", "FromPort": "-1"}], "GroupDescription": "Auto security group created by Sahara for Node Group 'worker-node-dn' of cluster 'c1-2-4-55-149821-1-vanilla-v2'."}}, "c1-2-4-55-149821-1-vanilla-v2-master-node-rm-nn-acaaa765": {"Type": "AWS::EC2::SecurityGroup", "Properties": {"SecurityGroupIngress": [{"ToPort": "50070", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "50070"}, {"ToPort": "9000", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "9000"}, {"ToPort": "8088", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "8088"}, {"ToPort": "8032", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "8032"}, {"ToPort": "22", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "22"}, {"ToPort": "65535", "IpProtocol": "tcp", "CidrIp": "10.20.0.0/24", "FromPort": "1"}, {"ToPort": "65535", "IpProtocol": "udp", "CidrIp": "10.20.0.0/24", "FromPort": "1"}, {"ToPort": "-1", "IpProtocol": "icmp", "CidrIp": "10.20.0.0/24", "FromPort": "-1"}], "GroupDescription": "Auto security group created by Sahara for Node Group 'master-node-rm-nn' of cluster 'c1-2-4-55-149821-1-vanilla-v2'."}}, "c1-2-4-55-149821-1-vanilla-v2-master-node-oo-hs-001": {"Type": "OS::Nova::Server", "Properties": {"admin_user": "ubuntu", "name": "c1-2-4-55-149821-1-vanilla-v2-master-node-oo-hs-001", "key_name": "sahara-i-test-key-pair-5bfa538e", "image": "221c9555-4504-4a07-a690-2002218b64ff", "user_data": {"Fn::Join": ["\n", ["#!/bin/bash", "echo \"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAcC6TFjjAMQAiMI9IMNiJyHPK2rIBh3E+soRIOHG8DR72/xOOdbnxVkKDAlPhXEBfoJxKw1Jl42MkLDOZBmhWgu2lEQK3tTlahqpSEMHCrfvgxSaYYNYqLB/PhgKfjdagMgu5aT1TJiCiH+rnubBMGmI5sKIHz65fSd4sS5DMXONn0hgUFTRWTkBDzQu1B/u5qhO84GHnMqRj43ou8dOKUwiAovvz6IjWlO9mquNKNqXBuV1gvUqLokd0YdyKhb40PDJIfWVsZkB3Ysqtn8Vx9ioTN/446Y5O1Ui6OoMWoNipfiZRvA9ps3Z0xcTlr/zA+Cq8m1tuT+abUSvCVZi1 Generated by Sahara", "\" >> /home/ubuntu//.ssh/authorized_keys", "", "# ====== COMMENT OUT Defaults requiretty in /etc/sudoers ========", "sed '/^Defaults requiretty*/ s/^/#/' -i /etc/sudoers", ""]]}, "flavor": "20", "networks": [{"port": {"Ref": "c1-2-4-55-149821-1-vanilla-v2-master-node-oo-hs-001-port"}}]}}, "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-nm-001-port": {"Type": "OS::Neutron::Port", "Properties": {"network_id": "c74c64f5-fb53-425a-b48a-f64af6472fd6", "replacement_policy": "AUTO", "security_groups": [{"Ref": "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-nm-8d713fda"}]}}, "c1-2-4-55-149821-1-vanilla-v2-master-node-rm-nn-001-port": {"Type": "OS::Neutron::Port", "Properties": {"network_id": "c74c64f5-fb53-425a-b48a-f64af6472fd6", "replacement_policy": "AUTO", "security_groups": [{"Ref": "c1-2-4-55-149821-1-vanilla-v2-master-node-rm-nn-acaaa765"}]}}, "c1-2-4-55-149821-1-vanilla-v2-master-node-rm-nn-001-floating": {"Type": "OS::Neutron::FloatingIP", "Properties": {"floating_network_id": "d8466e13-c514-4db9-900d-0f1129d9a3a2", "port_id": {"Ref": "c1-2-4-55-149821-1-vanilla-v2-master-node-rm-nn-001-port"}}}, "c1-2-4-55-149821-1-vanilla-v2-worker-node-nm-dn-001-port": {"Type": "OS::Neutron::Port", "Properties": {"network_id": "c74c64f5-fb53-425a-b48a-f64af6472fd6", "replacement_policy": "AUTO", "security_groups": [{"Ref": "c1-2-4-55-149821-1-vanilla-v2-worker-node-nm-dn-be3f1c7c"}]}}, "c1-2-4-55-149821-1-vanilla-v2-master-node-oo-hs-bef30985": {"Type": "AWS::EC2::SecurityGroup", "Properties": {"SecurityGroupIngress": [{"ToPort": "50090", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "50090"}, {"ToPort": "19888", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "19888"}, {"ToPort": "11000", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "11000"}, {"ToPort": "22", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "22"}, {"ToPort": "65535", "IpProtocol": "tcp", "CidrIp": "10.20.0.0/24", "FromPort": "1"}, {"ToPort": "65535", "IpProtocol": "udp", "CidrIp": "10.20.0.0/24", "FromPort": "1"}, {"ToPort": "-1", "IpProtocol": "icmp", "CidrIp": "10.20.0.0/24", "FromPort": "-1"}], "GroupDescription": "Auto security group created by Sahara for Node Group 'master-node-oo-hs' of cluster 'c1-2-4-55-149821-1-vanilla-v2'."}}, "c1-2-4-55-149821-1-vanilla-v2-worker-node-nm-ebe16368": {"Type": "AWS::EC2::SecurityGroup", "Properties": {"SecurityGroupIngress": [{"ToPort": "8042", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "8042"}, {"ToPort": "22", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "22"}, {"ToPort": "65535", "IpProtocol": "tcp", "CidrIp": "10.20.0.0/24", "FromPort": "1"}, {"ToPort": "65535", "IpProtocol": "udp", "CidrIp": "10.20.0.0/24", "FromPort": "1"}, {"ToPort": "-1", "IpProtocol": "icmp", "CidrIp": "10.20.0.0/24", "FromPort": "-1"}], "GroupDescription": "Auto security group created by Sahara for Node Group 'worker-node-nm' of cluster 'c1-2-4-55-149821-1-vanilla-v2'."}}, "c1-2-4-55-149821-1-vanilla-v2-master-node-oo-hs-001-port": {"Type": "OS::Neutron::Port", "Properties": {"network_id": "c74c64f5-fb53-425a-b48a-f64af6472fd6", "replacement_policy": "AUTO", "security_groups": [{"Ref": "c1-2-4-55-149821-1-vanilla-v2-master-node-oo-hs-bef30985"}]}}, "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001-port": {"Type": "OS::Neutron::Port", "Properties": {"network_id": "c74c64f5-fb53-425a-b48a-f64af6472fd6", "replacement_policy": "AUTO", "security_groups": [{"Ref": "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-6baf5395"}]}}, "c1-2-4-55-149821-1-vanilla-v2-worker-node-nm-dn-001-floating": {"Type": "OS::Neutron::FloatingIP", "Properties": {"floating_network_id": "d8466e13-c514-4db9-900d-0f1129d9a3a2", "port_id": {"Ref": "c1-2-4-55-149821-1-vanilla-v2-worker-node-nm-dn-001-port"}}}, "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001-floating": {"Type": "OS::Neutron::FloatingIP", "Properties": {"floating_network_id": "d8466e13-c514-4db9-900d-0f1129d9a3a2", "port_id": {"Ref": "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001-port"}}}, "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-nm-8d713fda": {"Type": "AWS::EC2::SecurityGroup", "Properties": {"SecurityGroupIngress": [{"ToPort": "8042", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "8042"}, {"ToPort": "22", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "22"}, {"ToPort": "65535", "IpProtocol": "tcp", "CidrIp": "10.20.0.0/24", "FromPort": "1"}, {"ToPort": "65535", "IpProtocol": "udp", "CidrIp": "10.20.0.0/24", "FromPort": "1"}, {"ToPort": "-1", "IpProtocol": "icmp", "CidrIp": "10.20.0.0/24", "FromPort": "-1"}], "GroupDescription": "Auto security group created by Sahara for Node Group 'new-worker-node-nm' of cluster 'c1-2-4-55-149821-1-vanilla-v2'."}}, "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001-volume-attachment-0": {"Type": "OS::Cinder::VolumeAttachment", "Properties": {"instance_uuid": {"Ref": "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001"}, "mountpoint": null, "volume_id": {"Ref": "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001-volume-0"}}}, "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001-volume-attachment-1": {"Type": "OS::Cinder::VolumeAttachment", "Properties": {"instance_uuid": {"Ref": "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001"}, "mountpoint": null, "volume_id": {"Ref": "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001-volume-1"}}}, "c1-2-4-55-149821-1-vanilla-v2-master-node-oo-hs-001-floating": {"Type": "OS::Neutron::FloatingIP", "Properties": {"floating_network_id": "d8466e13-c514-4db9-900d-0f1129d9a3a2", "port_id": {"Ref": "c1-2-4-55-149821-1-vanilla-v2-master-node-oo-hs-001-port"}}}, "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001": {"Type": "OS::Nova::Server", "Properties": {"admin_user": "ubuntu", "name": "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001", "key_name": "sahara-i-test-key-pair-5bfa538e", "image": "221c9555-4504-4a07-a690-2002218b64ff", "user_data": {"Fn::Join": ["\n", ["#!/bin/bash", "echo \"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAcC6TFjjAMQAiMI9IMNiJyHPK2rIBh3E+soRIOHG8DR72/xOOdbnxVkKDAlPhXEBfoJxKw1Jl42MkLDOZBmhWgu2lEQK3tTlahqpSEMHCrfvgxSaYYNYqLB/PhgKfjdagMgu5aT1TJiCiH+rnubBMGmI5sKIHz65fSd4sS5DMXONn0hgUFTRWTkBDzQu1B/u5qhO84GHnMqRj43ou8dOKUwiAovvz6IjWlO9mquNKNqXBuV1gvUqLokd0YdyKhb40PDJIfWVsZkB3Ysqtn8Vx9ioTN/446Y5O1Ui6OoMWoNipfiZRvA9ps3Z0xcTlr/zA+Cq8m1tuT+abUSvCVZi1 Generated by Sahara", "\" >> /home/ubuntu//.ssh/authorized_keys", "", "# ====== COMMENT OUT Defaults requiretty in /etc/sudoers ========", "sed '/^Defaults requiretty*/ s/^/#/' -i /etc/sudoers", ""]]}, "flavor": "20", "networks": [{"port": {"Ref": "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001-port"}}]}}, "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-nm-001-floating": {"Type": "OS::Neutron::FloatingIP", "Properties": {"floating_network_id": "d8466e13-c514-4db9-900d-0f1129d9a3a2", "port_id": {"Ref": "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-nm-001-port"}}}, "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-6baf5395": {"Type": "AWS::EC2::SecurityGroup", "Properties": {"SecurityGroupIngress": [{"ToPort": "50010", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "50010"}, {"ToPort": "50075", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "50075"}, {"ToPort": "50020", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "50020"}, {"ToPort": "22", "IpProtocol": "tcp", "CidrIp": "0.0.0.0/0", "FromPort": "22"}, {"ToPort": "65535", "IpProtocol": "tcp", "CidrIp": "10.20.0.0/24", "FromPort": "1"}, {"ToPort": "65535", "IpProtocol": "udp", "CidrIp": "10.20.0.0/24", "FromPort": "1"}, {"ToPort": "-1", "IpProtocol": "icmp", "CidrIp": "10.20.0.0/24", "FromPort": "-1"}], "GroupDescription": "Auto security group created by Sahara for Node Group 'new-worker-node-dn' of cluster 'c1-2-4-55-149821-1-vanilla-v2'."}}, "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-nm-001-volume-attachment-1": {"Type": "OS::Cinder::VolumeAttachment", "Properties": {"instance_uuid": {"Ref": "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-nm-001"}, "mountpoint": null, "volume_id": {"Ref": "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-nm-001-volume-1"}}}, "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-nm-001-volume-attachment-0": {"Type": "OS::Cinder::VolumeAttachment", "Properties": {"instance_uuid": {"Ref": "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-nm-001"}, "mountpoint": null, "volume_id": {"Ref": "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-nm-001-volume-0"}}}, "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-nm-001": {"Type": "OS::Nova::Server", "Properties": {"admin_user": "ubuntu", "name": "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-nm-001", "key_name": "sahara-i-test-key-pair-5bfa538e", "image": "221c9555-4504-4a07-a690-2002218b64ff", "user_data": {"Fn::Join": ["\n", ["#!/bin/bash", "echo \"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAcC6TFjjAMQAiMI9IMNiJyHPK2rIBh3E+soRIOHG8DR72/xOOdbnxVkKDAlPhXEBfoJxKw1Jl42MkLDOZBmhWgu2lEQK3tTlahqpSEMHCrfvgxSaYYNYqLB/PhgKfjdagMgu5aT1TJiCiH+rnubBMGmI5sKIHz65fSd4sS5DMXONn0hgUFTRWTkBDzQu1B/u5qhO84GHnMqRj43ou8dOKUwiAovvz6IjWlO9mquNKNqXBuV1gvUqLokd0YdyKhb40PDJIfWVsZkB3Ysqtn8Vx9ioTN/446Y5O1Ui6OoMWoNipfiZRvA9ps3Z0xcTlr/zA+Cq8m1tuT+abUSvCVZi1 Generated by Sahara", "\" >> /home/ubuntu//.ssh/authorized_keys", "", "# ====== COMMENT OUT Defaults requiretty in /etc/sudoers ========", "sed '/^Defaults requiretty*/ s/^/#/' -i /etc/sudoers", ""]]}, "flavor": "20", "networks": [{"port": {"Ref": "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-nm-001-port"}}]}}, "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-nm-001-volume-0": {"Type": "OS::Cinder::Volume", "Properties": {"name": "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-nm-001-volume-0", "volume_type": null, "size": "2"}}, "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-nm-001-volume-1": {"Type": "OS::Cinder::Volume", "Properties": {"name": "c1-2-4-55-149821-1-vanilla-v2-new-worker-node-nm-001-volume-1", "volume_type": null, "size": "2"}}, "c1-2-4-55-149821-1-vanilla-v2-master-node-rm-nn-001": {"Type": "OS::Nova::Server", "Properties": {"admin_user": "ubuntu", "name": "c1-2-4-55-149821-1-vanilla-v2-master-node-rm-nn-001", "key_name": "sahara-i-test-key-pair-5bfa538e", "image": "221c9555-4504-4a07-a690-2002218b64ff", "user_data": {"Fn::Join": ["\n", ["#!/bin/bash", "echo \"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAcC6TFjjAMQAiMI9IMNiJyHPK2rIBh3E+soRIOHG8DR72/xOOdbnxVkKDAlPhXEBfoJxKw1Jl42MkLDOZBmhWgu2lEQK3tTlahqpSEMHCrfvgxSaYYNYqLB/PhgKfjdagMgu5aT1TJiCiH+rnubBMGmI5sKIHz65fSd4sS5DMXONn0hgUFTRWTkBDzQu1B/u5qhO84GHnMqRj43ou8dOKUwiAovvz6IjWlO9mquNKNqXBuV1gvUqLokd0YdyKhb40PDJIfWVsZkB3Ysqtn8Vx9ioTN/446Y5O1Ui6OoMWoNipfiZRvA9ps3Z0xcTlr/zA+Cq8m1tuT+abUSvCVZi1 Generated by Sahara", "\" >> /home/ubuntu//.ssh/authorized_keys", "", "# ====== COMMENT OUT Defaults requiretty in /etc/sudoers ========", "sed '/^Defaults requiretty*/ s/^/#/' -i /etc/sudoers", ""]]}, "flavor": "20", "networks": [{"port": {"Ref": "c1-2-4-55-149821-1-vanilla-v2-master-node-rm-nn-001-port"}}]}}}}, "parameters": {}, "timeout_mins": 180}' http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-4-55-149821-1-vanilla-v2/cb314f2e-c6ec-41b0-8f7f-74bef2168dff log_curl_request /usr/local/lib/python2.7/dist-packages/heatclient/common/http.py:120
2015-01-24 14:27:45.153 4953 DEBUG heatclient.common.http [-]
HTTP/1.1 202 Accepted
date: Sat, 24 Jan 2015 14:28:00 GMT
connection: keep-alive
content-type: text/plain; charset=UTF-8
content-length: 58
x-openstack-request-id: req-6fb4d505-4867-46a2-bfb2-d6feb68afc7b

202 Accepted

The request is accepted for processing.

 log_http_response /usr/local/lib/python2.7/dist-packages/heatclient/common/http.py:133
2015-01-24 14:27:45.155 4953 DEBUG heatclient.common.http [-] curl -i -X GET -H 'X-Auth-Token: {SHA1}85d735c5bc6df5b397d8269c3244eb08fb4c49b3' -H 'Content-Type: application/json' -H 'Accept: application/json' -H 'User-Agent: python-heatclient' http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks?stack_name=c1-2-4-55-149821-1-vanilla-v2 log_curl_request /usr/local/lib/python2.7/dist-packages/heatclient/common/http.py:120
2015-01-24 14:27:45.392 4953 DEBUG heatclient.common.http [-]
HTTP/1.1 200 OK
date: Sat, 24 Jan 2015 14:28:00 GMT
connection: keep-alive
content-type: application/json; charset=UTF-8
content-length: 7246
x-openstack-request-id: req-0bf841fa-925a-417a-8877-131501a4b1cb

{"stacks": [{"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-6-51-149821-1-vanilla-v2/a69fcf95-1343-41ab-a642-32bba6c1be08", "rel": "self"}], "stack_status_reason": "Stack CREATE completed successfully", "stack_name": "c1-2-6-51-149821-1-vanilla-v2", "creation_time": "2015-01-24T14:20:14Z", "updated_time": null, "stack_owner": null, "stack_status": "CREATE_COMPLETE", "id": "a69fcf95-1343-41ab-a642-32bba6c1be08"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-4-55-149821-1-vanilla-v2/cb314f2e-c6ec-41b0-8f7f-74bef2168dff", "rel": "self"}], "stack_status_reason": "Stack UPDATE started", "stack_name": "c1-2-4-55-149821-1-vanilla-v2", "creation_time": "2015-01-24T14:16:47Z", "updated_time": null, "stack_owner": null, "stack_status": "UPDATE_IN_PROGRESS", "id": "cb314f2e-c6ec-41b0-8f7f-74bef2168dff"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-1-621-147933-16-2-transient/ae5fa4a4-e8a3-4ad0-b8e6-4640369c3818", "rel": "self"}], "stack_status_reason": "Resource DELETE failed: BadRequest: Expecting to find username or userId in passwordCredentials - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400)", "stack_name": "c1-1-621-147933-16-2-transient", "creation_time": "2015-01-24T14:07:27Z", "updated_time": null, "stack_owner": null, "stack_status": "DELETE_FAILED", "id": "ae5fa4a4-e8a3-4ad0-b8e6-4640369c3818"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-1-621-147933-16-1-transient/52e0b63e-cf78-4cfd-94f4-8191c018c160", "rel": "self"}], "stack_status_reason": "Resource DELETE failed: BadRequest: Expecting to find username or userId in passwordCredentials - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400)", "stack_name": "c1-1-621-147933-16-1-transient", "creation_time": "2015-01-24T14:07:24Z", "updated_time": null, "stack_owner": null, "stack_status": "DELETE_FAILED", "id": "52e0b63e-cf78-4cfd-94f4-8191c018c160"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-6-656-147933-16-vanilla-v2/d0e954a7-7571-4ce8-bf45-f51183fdd77e", "rel": "self"}], "stack_status_reason": "Stack successfully updated", "stack_name": "c1-2-6-656-147933-16-vanilla-v2", "creation_time": "2015-01-24T13:50:20Z", "updated_time": "2015-01-24T14:03:16Z", "stack_owner": null, "stack_status": "UPDATE_COMPLETE", "id": "d0e954a7-7571-4ce8-bf45-f51183fdd77e"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-4-681-149714-2-vanilla-v2/886be276-fbd6-49e1-b933-f24360d29fa4", "rel": "self"}], "stack_status_reason": "Stack DELETE started", "stack_name": "c1-2-4-681-149714-2-vanilla-v2", "creation_time": "2015-01-24T09:22:42Z", "updated_time": "2015-01-24T09:33:48Z", "stack_owner": null, "stack_status": "DELETE_IN_PROGRESS", "id": "886be276-fbd6-49e1-b933-f24360d29fa4"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-4-679-147933-15-vanilla-v2/6cfad38e-549a-4349-b58c-0506080ffcef", "rel": "self"}], "stack_status_reason": "Stack DELETE started", "stack_name": "c1-2-4-679-147933-15-vanilla-v2", "creation_time": "2015-01-24T07:27:44Z", "updated_time": "2015-01-24T07:38:57Z", "stack_owner": null, "stack_status": "DELETE_IN_PROGRESS", "id": "6cfad38e-549a-4349-b58c-0506080ffcef"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-6-651-147933-14-vanilla-v2/9cea4721-cc6f-4891-8732-e8381e97786b", "rel": "self"}], "stack_status_reason": "Stack DELETE started", "stack_name": "c1-2-6-651-147933-14-vanilla-v2", "creation_time": "2015-01-24T06:21:18Z", "updated_time": "2015-01-24T06:33:26Z", "stack_owner": null, "stack_status": "DELETE_IN_PROGRESS", "id": "9cea4721-cc6f-4891-8732-e8381e97786b"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-4-675-146447-3-vanilla-v2/e7d0ab67-2933-4aee-a0af-18267ae6066b", "rel": "self"}], "stack_status_reason": "Stack DELETE started", "stack_name": "c1-2-4-675-146447-3-vanilla-v2", "creation_time": "2015-01-24T02:56:24Z", "updated_time": "2015-01-24T03:07:15Z", "stack_owner": null, "stack_status": "DELETE_IN_PROGRESS", "id": "e7d0ab67-2933-4aee-a0af-18267ae6066b"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-6-647-149714-2-vanilla-v2/7524f8a1-78f7-4eb4-853f-e7e3bbae3421", "rel": "self"}], "stack_status_reason": "Stack DELETE started", "stack_name": "c1-2-6-647-149714-2-vanilla-v2", "creation_time": "2015-01-24T02:09:44Z", "updated_time": "2015-01-24T02:21:48Z", "stack_owner": null, "stack_status": "DELETE_IN_PROGRESS", "id": "7524f8a1-78f7-4eb4-853f-e7e3bbae3421"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-4-670-149714-2-vanilla-v2/d27428fb-3c7f-4481-ba14-edbe3d06b38a", "rel": "self"}], "stack_status_reason": "Stack DELETE started", "stack_name": "c1-2-4-670-149714-2-vanilla-v2", "creation_time": "2015-01-23T20:48:05Z", "updated_time": "2015-01-23T21:00:13Z", "stack_owner": null, "stack_status": "DELETE_IN_PROGRESS", "id": "d27428fb-3c7f-4481-ba14-edbe3d06b38a"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-4-669-149716-1-vanilla-v2/e6ddfb22-58c3-4450-8e2c-416d61f5e36e", "rel": "self"}], "stack_status_reason": "Stack DELETE started", "stack_name": "c1-2-4-669-149716-1-vanilla-v2", "creation_time": "2015-01-23T20:22:56Z", "updated_time": "2015-01-23T20:34:16Z", "stack_owner": null, "stack_status": "DELETE_IN_PROGRESS", "id": "e6ddfb22-58c3-4450-8e2c-416d61f5e36e"}, {"parent": null, "description": "Data Processing Cluster by Sahara", "links": [{"href": "http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-4-667-149714-2-vanilla-v2/38b8a82c-7667-41e4-98bc-2493895d06b2", "rel": "self"}], "stack_status_reason": "Stack DELETE started", "stack_name": "c1-2-4-667-149714-2-vanilla-v2", "creation_time": "2015-01-23T19:30:03Z", "updated_time": "2015-01-23T19:41:42Z", "stack_owner": null, "stack_status": "DELETE_IN_PROGRESS", "id": "38b8a82c-7667-41e4-98bc-2493895d06b2"}]}
 log_http_response /usr/local/lib/python2.7/dist-packages/heatclient/common/http.py:133
2015-01-24 14:27:45.394 4953 DEBUG heatclient.common.http [-] curl -i -X GET -H 'X-Auth-Token: {SHA1}85d735c5bc6df5b397d8269c3244eb08fb4c49b3' -H 'Content-Type: application/json' -H 'Accept: application/json' -H 'User-Agent: python-heatclient' http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/a69fcf95-1343-41ab-a642-32bba6c1be08 log_curl_request /usr/local/lib/python2.7/dist-packages/heatclient/common/http.py:120
2015-01-24 14:27:45.459 4953 DEBUG heatclient.common.http [-]
HTTP/1.1 302 Found
content-length: 215
connection: keep-alive
location: http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-6-51-149821-1-vanilla-v2/a69fcf95-1343-41ab-a642-32bba6c1be08
date: Sat, 24 Jan 2015 14:28:00 GMT
content-type: text/plain; charset=UTF-8
x-openstack-request-id: req-afddd643-8869-4338-a93b-fa73509bdfb1

302 Found

The resource was found at http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-6-51-149821-1-vanilla-v2/a69fcf95-1343-41ab-a642-32bba6c1be08; you should be redirected automatically.
 log_http_response /usr/local/lib/python2.7/dist-packages/heatclient/common/http.py:133
2015-01-24 14:27:45.460 4953 DEBUG heatclient.common.http [-] curl -i -X GET -H 'X-Auth-Token: {SHA1}85d735c5bc6df5b397d8269c3244eb08fb4c49b3' -H 'Content-Type: application/json' -H 'Accept: application/json' -H 'User-Agent: python-heatclient' http://172.18.168.42:8004/v1/79677dd162484831b6b582e9cd50d9cf/stacks/c1-2-6-51-149821-1-vanilla-v2%2Fa69fcf95-1343-41ab-a642-32bba6c1be08/resources/c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001 log_curl_request /usr/local/lib/python2.7/dist-packages/heatclient/common/http.py:120
2015-01-24 14:27:45.625 4953 DEBUG heatclient.common.http [-]
HTTP/1.1 404 Not Found
date: Sat, 24 Jan 2015 14:28:00 GMT
connection: keep-alive
content-type: application/json; charset=UTF-8
content-length: 852
x-openstack-request-id: req-20420a16-fcc3-46b7-bc47-c024971d6926

{"explanation": "The resource could not be found.", "code": 404, "error": {"message": "The Resource (c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001) could not be found in Stack c1-2-6-51-149821-1-vanilla-v2.", "traceback": "Traceback (most recent call last):\n\n File \"/opt/stack/heat/heat/engine/service.py\", line 72, in wrapped\n return func(self, ctx, *args, **kwargs)\n\n File \"/opt/stack/heat/heat/engine/service.py\", line 1031, in describe_stack_resource\n self._verify_stack_resource(stack, resource_name)\n\n File \"/opt/stack/heat/heat/engine/service.py\", line 1014, in _verify_stack_resource\n stack_name=stack.name)\n\nResourceNotFound: The Resource (c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001) could not be found in Stack c1-2-6-51-149821-1-vanilla-v2.\n", "type": "ResourceNotFound"}, "title": "Not Found"}
 log_http_response /usr/local/lib/python2.7/dist-packages/heatclient/common/http.py:133
2015-01-24 14:27:45.762 4953 ERROR sahara.service.ops [-] Error during operating cluster 'c1-2-4-55-149821-1-vanilla-v2' (reason: ERROR: The Resource (c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001) could not be found in Stack c1-2-6-51-149821-1-vanilla-v2.)
2015-01-24 14:27:45.762 4953 TRACE sahara.service.ops Traceback (most recent call last):
2015-01-24 14:27:45.762 4953 TRACE sahara.service.ops File "/usr/local/lib/python2.7/dist-packages/sahara/service/ops.py", line 157, in wrapper
2015-01-24 14:27:45.762 4953 TRACE sahara.service.ops f(cluster_id, *args, **kwds)
2015-01-24 14:27:45.762 4953 TRACE sahara.service.ops File "/usr/local/lib/python2.7/dist-packages/sahara/service/ops.py", line 282, in _provision_scaled_cluster
2015-01-24 14:27:45.762 4953 TRACE sahara.service.ops instance_ids = INFRA.scale_cluster(cluster, node_group_id_map)
2015-01-24 14:27:45.762 4953 TRACE sahara.service.ops File "/usr/local/lib/python2.7/dist-packages/sahara/service/heat_engine.py", line 87, in scale_cluster
2015-01-24 14:27:45.762 4953 TRACE sahara.service.ops launcher.launch_instances(cluster, target_count)
2015-01-24 14:27:45.762 4953 TRACE sahara.service.ops File "/usr/local/lib/python2.7/dist-packages/sahara/service/heat_engine.py", line 211, in launch_instances
2015-01-24 14:27:45.762 4953 TRACE sahara.service.ops self.inst_ids = self._populate_cluster(cluster, stack)
2015-01-24 14:27:45.762 4953 TRACE sahara.service.ops File "/usr/local/lib/python2.7/dist-packages/sahara/service/heat_engine.py", line 137, in _populate_cluster
2015-01-24 14:27:45.762 4953 TRACE sahara.service.ops nova_ids = stack.get_node_group_instances(node_group)
2015-01-24 14:27:45.762 4953 TRACE sahara.service.ops File "/usr/local/lib/python2.7/dist-packages/sahara/utils/openstack/heat.py", line 356, in get_node_group_instances
2015-01-24 14:27:45.762 4953 TRACE sahara.service.ops res = heat.resources.get(self.heat_stack.id, name)
2015-01-24 14:27:45.762 4953 TRACE sahara.service.ops File "/usr/local/lib/python2.7/dist-packages/heatclient/v1/resources.py", line 61, in get
2015-01-24 14:27:45.762 4953 TRACE sahara.service.ops resp, body = self.client.json_request('GET', url_str)
2015-01-24 14:27:45.762 4953 TRACE sahara.service.ops File "/usr/local/lib/python2.7/dist-packages/heatclient/common/http.py", line 254, in json_request
2015-01-24 14:27:45.762 4953 TRACE sahara.service.ops resp = self._http_request(url, method, **kwargs)
2015-01-24 14:27:45.762 4953 TRACE sahara.service.ops File "/usr/local/lib/python2.7/dist-packages/heatclient/common/http.py", line 209, in _http_request
2015-01-24 14:27:45.762 4953 TRACE sahara.service.ops raise exc.from_response(resp)
2015-01-24 14:27:45.762 4953 TRACE sahara.service.ops HTTPNotFound: ERROR: The Resource (c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001) could not be found in Stack c1-2-6-51-149821-1-vanilla-v2.
2015-01-24 14:27:45.762 4953 TRACE sahara.service.ops
2015-01-24 14:27:45.908 4953 INFO sahara.service.heat_engine [-] Cluster 'c1-2-4-55-149821-1-vanilla-v2' scaling rollback (reason: ERROR: The Resource (c1-2-4-55-149821-1-vanilla-v2-new-worker-node-dn-001) could not be found in Stack c1-2-6-51-149821-1-vanilla-v2.)
2015-01-24 14:27:46.187 4953 INFO sahara.utils.general [-] Cluster status has been changed: id=34c32482-1a9e-4271-a060-e2d5d7b8d790, New status=Rollback: Spawning
2015-01-24 14:27:46.188 4953 DEBUG neutronclient.client [-]