SM:R3.1.1 build38:centos: Multi interface provisioning stuck at zoo config

Bug #1640187 reported by sundarkh
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R3.1
Fix Committed
Critical
kamlesh parmar
R3.2
Fix Committed
Critical
kamlesh parmar
Trunk
Fix Committed
Critical
kamlesh parmar

Bug Description

SM:R3.1.1 build38:centos: Multi interface provisioning stuck at zoo config errors

With build R3.1.1 centos build 38 liberty, Multi interface provisioning stuck at zoo config errors

1) Install SM build 3.1.1 build 38 Liberty
2) Reimage the target with centos 72 (multi interface setup). Reimage happens succesfully (After working around the bug 1640064 SM: R3.1.1 build 38 After reimage , nodes are unable to connect to the SM in multi interface setup)
3) Initiate Provision with centos liberty contrail package build 38
4) Observe that the provision stuck with database_completed with following error

Nov 8 06:01:09 nodec35 puppet-agent[16929]: (/Stage[config]/Contrail::Config_cassandra/Exec[cassandra-env-update]/returns) executed successfully
Nov 8 06:01:09 nodec35 puppet-agent[16929]: executed setup-quantum-server-setup
Nov 8 06:01:09 nodec35 puppet-agent[16929]: (/Stage[config]/Contrail::Config::Setup_quantum_server_setup/Notify[executed setup-quantum-server-setup]/message) defined 'message' as 'executed setup-quantum-server-setup'
Nov 8 06:01:10 nodec35 puppet-agent[16929]: Could not start Service[zookeeper]: Execution of '/usr/bin/systemctl start zookeeper' returned 6: Failed to start zookeeper.service: Unit zookeeper.service failed to load: No such file or directory.
Nov 8 06:01:10 nodec35 puppet-agent[16929]: Wrapped exception:
Nov 8 06:01:10 nodec35 puppet-agent[16929]: Execution of '/usr/bin/systemctl start zookeeper' returned 6: Failed to start zookeeper.service: Unit zookeeper.service failed to load: No such file or directory.
Nov 8 06:01:10 nodec35 puppet-agent[16929]: (/Stage[config]/Contrail::Config::Database_service/Service[zookeeper]/ensure) change from stopped to running failed: Could not start Service[zookeeper]: Execution of '/usr/bin/systemctl start zookeeper' returned 6: Failed to start zookeeper.service: Unit zookeeper.service failed to load: No such file or directory.

Notes :
------
1) Provisioning with build 38 centos in single node is completed and does not hit the above issue
2) With previous build (Build 37) , bug https://bugs.launchpad.net/juniperopenstack/r3.1/+bug/1638814 was seen

Setup

SM : 10.204.217.160
host1 = 'root@10.204.221.58'
host2 = 'root@10.204.221.59'
host3 = 'root@10.204.221.60'
host4 = 'root@10.204.221.61'

env.roledefs = {
    'all': [host1, host2, host3, host4],
    'cfgm': [host1],
    'openstack': [host1],
    'control': [host1,host2],
    'compute': [host3,host4],
    'collector': [host2],
    'webui': [host2],
    'database': [host2],
    'build': [host_build],
}

env.hostnames = {
    'all': [ 'nodec35', 'nodec33', 'nodea4', 'nodec57']
}

Jeba Paulaiyan (jebap)
tags: added: blocker
Jeba Paulaiyan (jebap)
Changed in juniperopenstack:
importance: Undecided → Critical
assignee: nobody → kamlesh parmar (kparmar)
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.1

Review in progress for https://review.opencontrail.org/25963
Submitter: kamlesh parmar (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/25963
Committed: http://github.org/Juniper/contrail-puppet/commit/c10e5b177ffe976db28eaa716eeb893790c87fe1
Submitter: Zuul
Branch: R3.1

commit c10e5b177ffe976db28eaa716eeb893790c87fe1
Author: Kamlesh Parmar <email address hidden>
Date: Thu Nov 10 11:43:12 2016 -0800

Closes-Bug: #1640187
explicitly perform chkconfig on for zookeeper service for centos.
This is exposed after making cassandra DB default for config node.

Change-Id: Ia65ad5f09d5c43f878dcd7ce5d60e8baee72e1ac

Revision history for this message
sundarkh (sundar-kh) wrote :

Seen with R3.2 Build 8

sundarkh (sundar-kh)
Changed in juniperopenstack:
milestone: none → r4.0
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.2

Review in progress for https://review.opencontrail.org/26832
Submitter: kamlesh parmar (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/26833
Submitter: kamlesh parmar (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/26832
Committed: http://github.org/Juniper/contrail-puppet/commit/2cd4dbdf128dd5dfe06e17b1bedf91f339b92537
Submitter: Zuul (<email address hidden>)
Branch: R3.2

commit 2cd4dbdf128dd5dfe06e17b1bedf91f339b92537
Author: Kamlesh Parmar <email address hidden>
Date: Thu Nov 10 11:43:12 2016 -0800

Closes-Bug: #1640187
explicitly perform chkconfig on for zookeeper service for centos.
This is exposed after making cassandra DB default for config node.

Change-Id: Ia65ad5f09d5c43f878dcd7ce5d60e8baee72e1ac
(cherry picked from commit c10e5b177ffe976db28eaa716eeb893790c87fe1)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/26833
Committed: http://github.org/Juniper/contrail-puppet/commit/6399ecf50d8de68037408a57ee77a4b9a81fbe7b
Submitter: Zuul (<email address hidden>)
Branch: master

commit 6399ecf50d8de68037408a57ee77a4b9a81fbe7b
Author: Kamlesh Parmar <email address hidden>
Date: Thu Nov 10 11:43:12 2016 -0800

Closes-Bug: #1640187
explicitly perform chkconfig on for zookeeper service for centos.
This is exposed after making cassandra DB default for config node.

Change-Id: Ia65ad5f09d5c43f878dcd7ce5d60e8baee72e1ac
(cherry picked from commit c10e5b177ffe976db28eaa716eeb893790c87fe1)

Revision history for this message
sundarkh (sundar-kh) wrote :

Issue seen with build R3.2 build 11

Revision history for this message
kamlesh parmar (kparmar) wrote :

This is fixed with following commit:

Reviewed: https://review.opencontrail.org/26931
Committed: http://github.org/Juniper/contrail-puppet/commit/5e39cd99786e3f1ccdb3aede21b5d6b1f4ea62f0
Submitter: Zuul (<email address hidden>)
Branch: R3.2

commit 5e39cd99786e3f1ccdb3aede21b5d6b1f4ea62f0
Author: nitishkrishna <email address hidden>
Date: Tue Dec 6 23:15:14 2016 -0800

Closes-Bug: #161526 - To fix Centos config db separation

Config DB separation in Centos will fail in database started.
This issue was fixed in Database role but not for Config Db provision in Centos

Change-Id: Ie3a01daff00bd11cbe43467bec77d309d6966dc7

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.