Fuel for OpenStack

DPDK port creation fails

Bug #1664862 reported by Ruijing
18
This bug affects 3 people
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Committed
High
Michael Polenchuk
Fuel for OpenStack 11.0
Nominated for Ocata by Michael Polenchuk
Newton
Fix Released
High
Michael Polenchuk
Fuel for OpenStack 10.1

Bug Description

1. Configuration

ISO: fuel-10.0-community-1312-2017-02-14_23-14-00.iso

Node1 (controller):

eth0: Admin, storage, Management, private
eth1: Public

Node2, Node3 (compute)

eth0: admin, storage, managment
eth1:
eth2: private (DPDK is enabled)

Node Attributes:

  Nova CPU pinning: 1
  DPDK CPU pinning: 2

  Huge Pages:
    Nova
      2.0 MB: 512
    DPDK: 1024

Settings: KVM

2. Result

1) deployment success

2) dpdk port creation fails (not expected)
root@node-3:~# sudo ovs-vsctl show | grep dpdk
        Port "dpdk0"
            Interface "dpdk0"
                type: dpdk
                error: "could not open network device dpdk0 (Address family not supported by protocol)"

Michael Polenchuk (mpolenchuk)
Changed in fuel:
milestone: none → 11.0
status: New → Confirmed
importance: Undecided → High
assignee: nobody → Fuel Sustaining (fuel-sustaining-team)
Revision history for this message
Michael Polenchuk (mpolenchuk) wrote :

As a workaround on all the compute nodes run the following:
# update-alternatives --set ovs-vswitchd /usr/lib/openvswitch-switch-dpdk/ovs-vswitchd-dpdk
# sudo service openvswitch-switch restart

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/435454

Changed in fuel:
assignee: Fuel Sustaining (fuel-sustaining-team) → Michael Polenchuk (mpolenchuk)
status: Confirmed → In Progress
Revision history for this message
Michael Polenchuk (mpolenchuk) wrote :

root@node-64:~# lsof -n -p 4501
COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
ovs-vswit 4501 root cwd DIR 252,0 4096 2 /
ovs-vswit 4501 root rtd DIR 252,0 4096 2 /
ovs-vswit 4501 root txt REG 252,0 2323144 262425 /usr/lib/openvswitch-switch/ovs-vswitchd

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/435454
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=e0e195b1e65c8191fadb85b9eabed68ccb35e70d
Submitter: Jenkins
Branch: master

commit e0e195b1e65c8191fadb85b9eabed68ccb35e70d
Author: Michael Polenchuk <email address hidden>
Date: Fri Feb 17 17:42:32 2017 +0400

    Make ovs-vswitchd restart instead of stop/start

    ovs-vswitch daemon incorrecly doing serial stop -> start which affects
    proper restart handling and remains with non-dpdk binary in runtime.
    In order to mend the above issue make a restart action of daemon.

    Change-Id: I61dbdb91f7fb9924bba4119993cb696eb0a7b9e9
    Closes-Bug: #1664862

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (stable/newton)

Fix proposed to branch: stable/newton
Review: https://review.openstack.org/444167

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (stable/ocata)

Fix proposed to branch: stable/ocata
Review: https://review.openstack.org/444168

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (stable/newton)

Reviewed: https://review.openstack.org/444167
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=67d0edc73acc3e398bffbbe474b4b6224db9b250
Submitter: Jenkins
Branch: stable/newton

commit 67d0edc73acc3e398bffbbe474b4b6224db9b250
Author: Michael Polenchuk <email address hidden>
Date: Fri Feb 17 17:42:32 2017 +0400

    Make ovs-vswitchd restart instead of stop/start

    ovs-vswitch daemon incorrecly doing serial stop -> start which affects
    proper restart handling and remains with non-dpdk binary in runtime.
    In order to mend the above issue make a restart action of daemon.

    Change-Id: I61dbdb91f7fb9924bba4119993cb696eb0a7b9e9
    Closes-Bug: #1664862
    (cherry picked from commit e0e195b1e65c8191fadb85b9eabed68ccb35e70d)

Revision history for this message
Oleg Bondarev (obondarev) wrote :

Part of syslog on node-1 at the time it was considering agents as dead: http://paste.openstack.org/show/603776/ - some problem with mysql?

Revision history for this message
Oleg Bondarev (obondarev) wrote :

Please disregard the last comment, it's for another bug, sorry

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-library (stable/ocata)

Change abandoned by Andreas Jaeger (<email address hidden>) on branch: stable/ocata
Review: https://review.opendev.org/444168
Reason: This repo is retired now, no further work will get merged.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.