SM provisioning of 1OS + 3CC fails @ pre_exec_vnc_galera_started

Bug #1540775 reported by Sarath
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
Trunk
Fix Committed
Critical
Thilak Raj

Bug Description

SM provisioning of 1OS + 3CC fails @ pre_exec_vnc_galera_started.

Target-node syslog ( OS )
####

Feb 1 22:59:58 a5d11e36 kernel: [14759.540613] init: neutron-server main process ended, respawning
Feb 1 22:59:58 a5d11e36 kernel: [14760.211987] init: neutron-server main process (3000) terminated with status 1
Feb 1 22:59:58 a5d11e36 kernel: [14760.212004] init: neutron-server main process ended, respawning
Feb 1 22:59:59 a5d11e36 kernel: [14760.877334] init: neutron-server main process (3018) terminated with status 1
Feb 1 22:59:59 a5d11e36 kernel: [14760.877351] init: neutron-server main process ended, respawning
Feb 1 23:00:00 a5d11e36 kernel: [14761.544575] init: neutron-server main process (3027) terminated with status 1
Feb 1 23:00:00 a5d11e36 kernel: [14761.544592] init: neutron-server main process ended, respawning
Feb 1 23:00:00 a5d11e36 kernel: [14762.209093] init: neutron-server main process (3045) terminated with status 1
Feb 1 23:00:00 a5d11e36 kernel: [14762.209110] init: neutron-server main process ended, respawning
Feb 1 23:00:01 a5d11e36 kernel: [14762.876183] init: neutron-server main process (3063) terminated with status 1
Feb 1 23:00:01 a5d11e36 kernel: [14762.876200] init: neutron-server main process ended, respawning
Feb 1 23:00:01 a5d11e36 CRON[3089]: (neutron) CMD (if [ -x /usr/bin/neutron-netns-cleanup ] ; then /usr/bin/neutron-netns-cleanup --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/l3_agent.ini >/dev/null 2>&1; fi)
Feb 1 23:00:01 a5d11e36 CRON[3091]: (root) CMD (/opt/contrail/bin/contrail-token-clean.sh)
Feb 1 23:00:02 a5d11e36 kernel: [14763.555350] init: neutron-server main process (3072) terminated with status 1
Feb 1 23:00:02 a5d11e36 kernel: [14763.555362] init: neutron-server main process ended, respawning
Feb 1 23:00:02 a5d11e36 kernel: [14764.232677] init: neutron-server main process (3156) terminated with status 1
Feb 1 23:00:02 a5d11e36 kernel: [14764.232695] init: neutron-server main process ended, respawning
Feb 1 23:00:03 a5d11e36 kernel: [14764.899928] init: neutron-server main process (3177) terminated with status 1
Feb 1 23:00:03 a5d11e36 kernel: [14764.899945] init: neutron-server main process ended, respawning
Feb 1 23:00:04 a5d11e36 kernel: [14765.574234] init: neutron-server main process (3186) terminated with status 1
Feb 1 23:00:04 a5d11e36 kernel: [14765.574252] init: neutron-server main process ended, respawning
Feb 1 23:00:04 a5d11e36 kernel: [14766.241280] init: neutron-server main process (3204) terminated with status 1
Feb 1 23:00:04 a5d11e36 kernel: [14766.241297] init: neutron-server main process ended, respawning
Feb 1 23:00:05 a5d11e36 kernel: [14766.914322] init: neutron-server main process (3222) terminated with status 1
Feb 1 23:00:05 a5d11e36 kernel: [14766.914339] init: neutron-server main process ended, respawning
Feb 1 23:00:06 a5d11e36 kernel: [14767.587258] init: neutron-server main process (3231) terminated with status 1
Feb 1 23:00:06 a5d11e36 kernel: [14767.587275] init: neutron-server main process ended, respawning
Feb 1 23:00:06 a5d11e36 kernel: [14768.265221] init: neutron-server main process (3249) terminated with status 1
Feb 1 23:00:06 a5d11e36 kernel: [14768.265244] init: neutron-server main process ended, respawning

Provisioing configs
#######

{
    "server": [
        {
            "id": "a5d11e36",
            "ip_address": "10.87.143.84",
            "roles": [
                "openstack"
            ],
            "status": "reimage_completed"
        },
        {
            "id": "a5d11e14",
            "ip_address": "10.87.143.90",
            "roles": [],
            "status": "reimage_completed"
        },
        {
            "id": "a5d11e13",
            "ip_address": "10.87.143.92",
            "roles": [
                "config",
                "control",
                "collector",
                "webui",
                "database"
            ],
            "status": "reimage_completed"
        },
        {
            "id": "a5d11e12",
            "ip_address": "10.87.143.94",
            "roles": [
                "config",
                "control",
                "collector",
                "webui",
                "database"
            ],
            "status": "reimage_completed"
        },
        {
            "id": "a5d11e10",
            "ip_address": "10.87.143.98",
            "roles": [
                "config",
                "control",
                "collector",
                "webui",
                "database"
            ],
            "status": "reimage_completed"
        },
        {
            "id": "a5d11e09",
            "ip_address": "10.87.143.100",
            "roles": [
                "compute"
            ],
            "status": "reimage_completed"
        }
    ]
}

Provisioning status
###

root@Blaster-nsarath-004:~#
root@Blaster-nsarath-004:~# server-manager status server
{
    "server": [
        {
            "id": "a5d11e36",
            "ip_address": "10.87.143.84",
            "mac_address": "00:E0:81:CA:59:11",
            "status": "pre_exec_vnc_galera_started"
        },
        {
            "id": "a5d11e14",
            "ip_address": "10.87.143.90",
            "mac_address": "00:E0:81:CA:5A:87",
            "status": "reimage_completed"
        },
        {
            "id": "a5d11e13",
            "ip_address": "10.87.143.92",
            "mac_address": "00:E0:81:CA:55:13",
            "status": "database_completed"
        },
        {
            "id": "a5d11e12",
            "ip_address": "10.87.143.94",
            "mac_address": "00:E0:81:C5:81:95",
            "status": "database_completed"
        },
        {
            "id": "a5d11e10",
            "ip_address": "10.87.143.98",
            "mac_address": "00:E0:81:CA:59:59",
            "status": "database_completed"
        },
        {
            "id": "a5d11e09",
            "ip_address": "10.87.143.100",
            "mac_address": "00:E0:81:CA:59:D3",
            "status": "reimage_completed"
        }
    ]
}
root@Blaster-nsarath-004:~#

contrail-version
Package Version Build-ID | Repo | Package Name
-------------------------------------- ------------------------------ ----------------------------------
contrail-analytics 3.0-2697 2697
contrail-config 3.0-2697 2697
contrail-config-openstack 3.0-2697 2697
contrail-control 3.0-2697 2697
contrail-dns 3.0-2697 2697
contrail-docs 3.0-2697 2697
contrail-f5 3.0-2697 2697
contrail-fabric-utils 3.0-2697 2697
contrail-heat 3.0-2697 2697
contrail-lib 3.0-2697 2697
contrail-nodemgr 3.0-2697 2697
contrail-nova-networkapi 3.0-2697 2697
contrail-openstack 3.0-2697 2697
contrail-openstack-analytics 3.0-2697 2697
contrail-openstack-config 3.0-2697 2697
contrail-openstack-control 3.0-2697 2697
contrail-openstack-dashboard 3.0-2697 2697
contrail-openstack-database 3.0-2697 2697
contrail-openstack-ha 3.0-2697 2697
contrail-openstack-webui 3.0-2697 2697
contrail-setup 3.0-2697 2697
contrail-utils 3.0-2697 2697
contrail-web-controller 3.0-2697 2697
contrail-web-core 3.0-2697 2697
ifmap-python-client 0.1-2 2697
ifmap-server 0.3.2-1contrail2 2697
neutron-plugin-contrail 3.0-2697 2697
nova-api 1:2014.2.3-0ubuntu1~cloud0.3contrail2697
nova-common 1:2014.2.3-0ubuntu1~cloud0.3contrail2697
nova-conductor 1:2014.2.3-0ubuntu1~cloud0.3contrail2697
nova-console 1:2014.2.3-0ubuntu1~cloud0.3contrail2697
nova-consoleauth 1:2014.2.3-0ubuntu1~cloud0.3contrail2697
nova-novncproxy 1:2014.2.3-0ubuntu1~cloud0.3contrail2697
nova-objectstore 1:2014.2.3-0ubuntu1~cloud0.3contrail2697
nova-scheduler 1:2014.2.3-0ubuntu1~cloud0.3contrail2697
python-contrail 3.0-2697 2697
python-neutronclient 1:2.3.8-0ubuntu1~cloud0.2contrail2697
python-nova 1:2014.2.3-0ubuntu1~cloud0.3contrail2697

Revision history for this message
Sarath (nsarath) wrote :

Please find below the logs on Target Node and Server-manager

-bash-4.1$
-bash-4.1$ hostname
centos-build02
-bash-4.1$
-bash-4.1$ pwd
/users/nsarath/PR/PR-1540775
-bash-4.1$
-bash-4.1$ ls -l
total 2008884
-rwxrwxrwx 1 nsarath test 1048453120 Feb 1 23:11 SMlog.tar*
-rwxrwxrwx 1 nsarath test 2744320 Feb 1 23:11 SMRunlog.tar*
-rwxrwxrwx 1 nsarath test 997826560 Feb 1 23:10 TargetNode-1-log.tar*
-bash-4.1$

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/16848
Submitter: Thilak Raj (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/16848
Committed: http://github.org/Juniper/contrail-puppet/commit/f53824edd69d1d05fb088bd527d840e8d2c15182
Submitter: Zuul
Branch: master

commit f53824edd69d1d05fb088bd527d840e8d2c15182
Author: tsurendra <email address hidden>
Date: Wed Feb 3 16:20:00 2016 -0800

Closes-Bug: #1540775
SM provisioning of 1OS + 3CC fails @ pre_exec_vnc_galera_started

Fixed the re-declaration .

Change-Id: Ifccf819a5f98673953d9a622dc3ec4c95332517a

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.