Neutron fails while executing ovs-vsctl

Bug #1553084 reported by Adam Heczko
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Mirantis OpenStack
Invalid
High
MOS Neutron
9.x
Invalid
High
MOS Neutron

Bug Description

Problem description:
After setting up MOS 8.0 GA OSTF test are not passing and Nova+Neutron throws errors.
Neutron is running in DVR mode, VLAN segmentation, physical network interface is Intel 10G.

<166>Mar 4 02:19:14 comp1 neutron-openvswitch-agent: 2016-03-04 02:19:14.383 15915 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [req-2a8ab7a1-8de4-433f-ab16-6d308dbf2089 - - - - -] Mapping physical network physnet2 to bridge br-prv
<163>Mar 4 02:19:14 comp1 neutron-openvswitch-agent: 2016-03-04 02:19:14.517 15915 ERROR neutron.agent.ovsdb.impl_vsctl [req-2a8ab7a1-8de4-433f-ab16-6d308dbf2089 - - - - -] Unable to execute ['ovs-vsctl', '--timeout=10', '--oneline', '--format=json', '--', '--columns=type', 'list', 'Interface', 'int-br-prv'].
2016-03-04 02:19:14.517 15915 ERROR neutron.agent.ovsdb.impl_vsctl Traceback (most recent call last):
2016-03-04 02:19:14.517 15915 ERROR neutron.agent.ovsdb.impl_vsctl File "/usr/lib/python2.7/dist-packages/neutron/agent/ovsdb/impl_vsctl.py", line 63, in run_vsctl
2016-03-04 02:19:14.517 15915 ERROR neutron.agent.ovsdb.impl_vsctl log_fail_as_error=False).rstrip()
2016-03-04 02:19:14.517 15915 ERROR neutron.agent.ovsdb.impl_vsctl File "/usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py", line 159, in execute
2016-03-04 02:19:14.517 15915 ERROR neutron.agent.ovsdb.impl_vsctl raise RuntimeError(m)
2016-03-04 02:19:14.517 15915 ERROR neutron.agent.ovsdb.impl_vsctl RuntimeError:
2016-03-04 02:19:14.517 15915 ERROR neutron.agent.ovsdb.impl_vsctl Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', '--oneline', '--format=json', '--', '--columns=type', 'list', 'Interface', 'int-br-prv']
2016-03-04 02:19:14.517 15915 ERROR neutron.agent.ovsdb.impl_vsctl Exit code: 1
2016-03-04 02:19:14.517 15915 ERROR neutron.agent.ovsdb.impl_vsctl
2016-03-04 02:19:14.517 15915 ERROR neutron.agent.ovsdb.impl_vsctl
<166>Mar 4 02:19:14 comp1 neutron-openvswitch-agent: 2016-03-04 02:19:14.733 15915 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [req-2a8ab7a1-8de4-433f-ab16-6d308dbf2089 - - - - -] Mapping physical network physnet1 to bridge br-floating
<163>Mar 4 02:19:14 comp1 neutron-openvswitch-agent: 2016-03-04 02:19:14.870 15915 ERROR neutron.agent.ovsdb.impl_vsctl [req-2a8ab7a1-8de4-433f-ab16-6d308dbf2089 - - - - -] Unable to execute ['ovs-vsctl', '--timeout=10', '--oneline', '--format=json', '--', '--columns=type', 'list', 'Interface', 'int-br-floating'].
2016-03-04 02:19:14.870 15915 ERROR neutron.agent.ovsdb.impl_vsctl Traceback (most recent call last):
2016-03-04 02:19:14.870 15915 ERROR neutron.agent.ovsdb.impl_vsctl File "/usr/lib/python2.7/dist-packages/neutron/agent/ovsdb/impl_vsctl.py", line 63, in run_vsctl
2016-03-04 02:19:14.870 15915 ERROR neutron.agent.ovsdb.impl_vsctl log_fail_as_error=False).rstrip()
2016-03-04 02:19:14.870 15915 ERROR neutron.agent.ovsdb.impl_vsctl File "/usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py", line 159, in execute
2016-03-04 02:19:14.870 15915 ERROR neutron.agent.ovsdb.impl_vsctl raise RuntimeError(m)
2016-03-04 02:19:14.870 15915 ERROR neutron.agent.ovsdb.impl_vsctl RuntimeError:
2016-03-04 02:19:14.870 15915 ERROR neutron.agent.ovsdb.impl_vsctl Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ovs-vsctl', '--timeout=10', '--oneline', '--format=json', '--', '--columns=type', 'list', 'Interface', 'int-br-floating']
2016-03-04 02:19:14.870 15915 ERROR neutron.agent.ovsdb.impl_vsctl Exit code: 1

Tags: area-neutron
Changed in mos:
milestone: none → 8.0-mu-1
importance: Undecided → High
Revision history for this message
Adam Heczko (aheczko-mirantis) wrote :
Dina Belova (dbelova)
Changed in mos:
status: New → Confirmed
assignee: nobody → MOS Neutron (mos-neutron)
milestone: 8.0-mu-1 → 8.0-updates
Dina Belova (dbelova)
tags: added: area-neutron
Revision history for this message
Oleg Bondarev (obondarev) wrote :

We have swarm and ostf tests running on regular basis so any failure would be reported immediately. In this case I suspect some issue with the setup itself, like ovs service not ready when neutron ovs agent is started.

From logs I see that ovs agent on compute node was restarted several times with success (no traces). I'd suggest to restart it on controller and see if issue still exists. Marking as incomplete for now.

Changed in mos:
status: Confirmed → Incomplete
Revision history for this message
Eugene Nikanorov (enikanorov) wrote :

Looks like those bridges were not set up during the deployment.

Revision history for this message
Dina Belova (dbelova) wrote :

More than a month in the incomplete state, moving to Invalid. Please move back to Confirmed if the issues is still reproducible.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.