Juniper Openstack

[Openshift Enterprise] : [4.1 Build 5] Multiple process failure in analytics docker, failed to import sqlalchemy

Bug #1735055 reported by chhandak
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R4.1
Fix Committed
Critical
Arvind
Juniper Openstack r4.1.0.0-fcs "r4.1"
Trunk
Fix Committed
Critical
Arvind
Juniper Openstack r5.0.0

Bug Description

When bringing up contrail cluster on openshift enterprise node observed multiple process failure in analytics docker. Build 5 is running with patch for fix 1734553.
 Observed following log:

  File "/usr/lib64/python2.7/site-packages/gevent/builtins.py", line 93, in __import__
    result = _import(*args, **kwargs)
ImportError: No module named sqlalchemy

root@5b7s18(analytics):/# contrail-status
== Contrail Analytics ==
supervisor-analytics: active
contrail-alarm-gen failed
contrail-analytics-api initializing (UvePartitions:UVE-Aggregation[Partitions:0] connection down)
contrail-analytics-nodemgr initializing (NTP state unsynchronized.)
contrail-collector active
contrail-query-engine active
contrail-snmp-collector failed
contrail-topology failed

root@5b7s18(analytics):/# tail -f /var/log/contrail/contrail-alarm-gen-stdout.log
    result = _import(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/cfgm_common/vnc_object_db.py", line 10, in <module>
    import vnc_rdbms
  File "/usr/lib64/python2.7/site-packages/gevent/builtins.py", line 93, in __import__
    result = _import(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/cfgm_common/vnc_rdbms.py", line 11, in <module>
    from sqlalchemy import create_engine, ForeignKey
  File "/usr/lib64/python2.7/site-packages/gevent/builtins.py", line 93, in __import__
    result = _import(*args, **kwargs)
ImportError: No module named sqlalchemy

root@5b7s18(analytics):/# tail -f /var/log/contrail/contrail-analytics-api.log
11/28/2017 07:20:07 PM [contrail-analytics-api]: usr res are None
11/28/2017 07:20:07 PM [contrail-analytics-api]: usr res are None
11/28/2017 07:21:07 PM [contrail-analytics-api]: usr res are None
11/28/2017 07:21:07 PM [contrail-analytics-api]: usr res are None
11/28/2017 07:21:18 PM [contrail-analytics-api]: before res list is generator
11/28/2017 07:21:18 PM [contrail-analytics-api]: res list is None
11/28/2017 07:21:45 PM [contrail-analytics-api]: before res list is vrouter
11/28/2017 07:21:45 PM [contrail-analytics-api]: res list is None
11/28/2017 07:22:07 PM [contrail-analytics-api]: usr res are None
11/28/2017 07:22:07 PM [contrail-analytics-api]: usr res are None

Tags: blocker
chhandak (chhandak)
Changed in juniperopenstack:
importance: Undecided → Critical
assignee: nobody → Sachchidanand Vaidya (vaidyasd)
milestone: none → r4.1.0.0-fcs
information type: Proprietary → Public
summary: [Openshift Enterprise] : [4.1 Build 5] Multiple process failure in
- analytics docker
+ analytics docker, failed to import sqlalchemy
tags: added: blocker
Revision history for this message
Arvind (arvindv) wrote :

The complete tracebacks seen in alarm, topology and snmp are the following:

Traceback (most recent call last):
 File “/usr/bin/contrail-topology”, line 9, in <module>
   load_entry_point(‘contrail-topology==0.1.0’, ‘console_scripts’, ‘contrail-topology’)()
 File “/usr/lib/python2.7/site-packages/pkg_resources.py”, line 378, in load_entry_point
   return get_distribution(dist).load_entry_point(group, name)
 File “/usr/lib/python2.7/site-packages/pkg_resources.py”, line 2566, in load_entry_point
   return ep.load()
 File “/usr/lib/python2.7/site-packages/pkg_resources.py”, line 2260, in load
   entry = __import__(self.module_name, globals(),globals(), [‘__name__‘])
 File “/usr/lib/python2.7/site-packages/contrail_topology/main.py”, line 8, in <module>
   from controller import Controller
 File “/usr/lib64/python2.7/site-packages/gevent/builtins.py”, line 93, in __import__
   result = _import(*args, **kwargs)
 File “/usr/lib/python2.7/site-packages/contrail_topology/controller.py”, line 10, in <module>
   from topology_config_handler import TopologyConfigHandler
 File “/usr/lib64/python2.7/site-packages/gevent/builtins.py”, line 93, in __import__
   result = _import(*args, **kwargs)
 File “/usr/lib/python2.7/site-packages/contrail_topology/topology_config_handler.py”, line 8, in <module>
   from config_handler import ConfigHandler
 File “/usr/lib64/python2.7/site-packages/gevent/builtins.py”, line 93, in __import__
   result = _import(*args, **kwargs)
 File “/usr/lib/python2.7/site-packages/contrail_topology/config_handler.py”, line 9, in <module>
   from cfgm_common.vnc_object_db import VncObjectDBClient
 File “/usr/lib64/python2.7/site-packages/gevent/builtins.py”, line 93, in __import__
   result = _import(*args, **kwargs)
 File “/usr/lib/python2.7/site-packages/cfgm_common/vnc_object_db.py”, line 10, in <module>
   import vnc_rdbms
 File “/usr/lib64/python2.7/site-packages/gevent/builtins.py”, line 93, in __import__
   result = _import(*args, **kwargs)
 File “/usr/lib/python2.7/site-packages/cfgm_common/vnc_rdbms.py”, line 11, in <module>
   from sqlalchemy import create_engine, ForeignKey
 File “/usr/lib64/python2.7/site-packages/gevent/builtins.py”, line 93, in __import__
   result = _import(*args, **kwargs)
ImportError: No module named sqlalchemy
Traceback (most recent call last):

Revision history for this message
Arvind (arvindv) wrote :

Starting from 4.1 we decided to read config changes from cassandra as opposed to polling api periodically. To do so we import from cfgm_common.vnc_object_db import VncObjectDBClient which
has a dependency on python-sqlalchemy.

For ubuntu,in analytics container, python-sqlalchemy was provided by python-contrail
In redhat there was no dependency on python-sqlalchemy by python-contrail.

root@a6s9(analytics):/# aptitude why python-sqlalchemy
i contrail-openstack-analytics Depends python-contrail (>= 4.1.0.0-55)
i A python-contrail Depends python-sqlalchemy
root@a6s9(analytics):/# lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 16.04.2 LTS
Release: 16.04
Codename: xenial

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.1

Review in progress for https://review.opencontrail.org/38004
Submitter: Arvind (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/38005
Submitter: Arvind (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/38004
Committed: http://github.com/Juniper/contrail-packages/commit/b39b9b26d660ddf4bae80667b36b62ac71734e12
Submitter: Zuul (<email address hidden>)
Branch: R4.1

commit b39b9b26d660ddf4bae80667b36b62ac71734e12
Author: arvindvis <email address hidden>
Date: Wed Nov 29 15:02:28 2017 -0800

Adding dependency on python-sqlalchemy to python-contrail
Closes-Bug: #1735055

Change-Id: Iff762e9687745f96dbc56d303c5f5fe492ffc21e

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/38005
Committed: http://github.com/Juniper/contrail-packages/commit/3b33154d891c4c6a1be4949f8e5229e42305a01a
Submitter: Zuul (<email address hidden>)
Branch: master

commit 3b33154d891c4c6a1be4949f8e5229e42305a01a
Author: arvindvis <email address hidden>
Date: Wed Nov 29 15:02:28 2017 -0800

Adding dependency on python-sqlalchemy to python-contrail
Closes-Bug: #1735055

Change-Id: Iff762e9687745f96dbc56d303c5f5fe492ffc21e

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.