Contrail 3.1 : Need to upgrade the keepalived package to 1.2.20 or beyond

Bug #1725461 reported by vivekananda shenoy
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R2.21.x
Fix Committed
Critical
amudhar
R3.1
Fix Committed
High
amudhar
R3.2
Fix Committed
High
amudhar
R4.0
Fix Committed
High
amudhar
R4.1
Fix Committed
High
amudhar
Trunk
Fix Committed
High
amudhar

Bug Description

Customer ran into this issue of VRRP hello packet broadcast storm where they by mistake configured same VRRP VRID for both internal and external VIP subnet which resulted in broadcast storm.

Apparently keepalived 1.2.20 has a fix for this issue where it will ensure that VRRP VRID remains unique on different interfaces (search for "vrrp: Generate unique default VMAC interface names." in http://www.keepalived.org/changelog.html). And customer has asked to package 3.1 Contrail with the latest stable keeepalived (post 1.2.20) with our .deb.

Regards,
Vivek

Changed in juniperopenstack:
assignee: nobody → amudhar (amudha)
milestone: none → r3.1.4.0
information type: Proprietary → Public
description: updated
Revision history for this message
vivekananda shenoy (vshenoy83) wrote :
Download full text (10.1 KiB)

Hi Amudha,

This is the complete description of keepalived issue as described by NTTC. Please make sure that whatever keepalived version we are planning to use in the fixed build has the fix for this issue. Just want to be double sure.

===================

Hi Toby-san,

As for issue 1, I tested this in my lab, and confirmed VRRP flood was caused by the wrong definition in testbed.py like below.

----------------------------------------------------------------------------

env.roledefs = {

     'all': [host1, host2, host3, host4, host5, host6, host7, host8, host9],

     'cfgm': [host1, host2, host3],

     'control': [host1, host2, host3],

     'webui': [host1, host2, host3],

     'collector': [host4, host5, host6],

     'database': [host7, host8, host9],

     'openstack': [openstack],

     'compute': [tsn1, tsn2, compute1, compute2],

     'tsn': [tsn1, tsn2],

     'toragent': [tsn1, tsn2],

     'build': [host_build],

     :

}

control_data = {

     #host1: {'ip': '192.168.0.131/24', 'gw': '192.168.0.1', 'device': 'eth1'}, <<< commented out

     #host2: {'ip': '192.168.0.132/24', 'gw': '192.168.0.1', 'device': 'eth1'}, <<< commented out

     #host3: {'ip': '192.168.0.133/24', 'gw': '192.168.0.1', 'device': 'eth1'}, <<< commented out

     host4: {'ip': '192.168.0.134/24', 'gw': '192.168.0.1', 'device': 'eth1'},

     host5: {'ip': '192.168.0.135/24', 'gw': '192.168.0.1', 'device': 'eth1'},

     host6: {'ip': '192.168.0.136/24', 'gw': '192.168.0.1', 'device': 'eth1'},

     host7: {'ip': '192.168.0.137/24', 'gw': '192.168.0.1', 'device': 'eth1'},

     host8: {'ip': '192.168.0.138/24', 'gw': '192.168.0.1', 'device': 'eth1'},

     host9: {'ip': '192.168.0.139/24', 'gw': '192.168.0.1', 'device': 'eth1'},

     :

}

env.ha = {

     'contrail_internal_vip': '192.168.0.110',

     'contrail_external_vip': '10.0.0.110',

     'contrail_internal_virtual_router_id': 110,

     'contrail_external_virtual_router_id': 110,

}

----------------------------------------------------------------------------

With this testbed.py, setup_contrail_keepalived task passed wrong arguments to setup-vnc-keepalived.

Usually, self_ip and internal_vip address must be on the same network, but different with this case.

----------------------------------------------------------------------------

root@sv-31:/opt/contrail/utils# grep -E "setup_contrail_keepalived|setup-vnc-keepalived" setup_without_openstack_and_compute_2017_10_21_13_54_06_540732.log

2017-10-21 13:54:14:352328: [root@10.0.0.131] Executing task 'setup_contrail_keepalived'

2017-10-21 13:54:15:068439: [root@10.0.0.131] sudo: setup-vnc-keepalived --self_ip 10.0.0.131 --internal_vip 192.168.0.110 --mgmt_self_ip 10.0.0.131 --self_index 1 --num_nodes 3 --role cfgm --internal_virtual_router_id 110 --external_vip 10.0.0.110 --external_virtual_router_id 110

2017-10-21 13:54:16:991731: [root@10.0.0.132] Executing task 'setup_contrail_keepalived'

2017-10-21 13:54:19:794308: [root@10.0.0.132] sudo: setup-vnc-keepalived --self_ip 10.0.0.132 --internal_vip 192.168.0.110 --mgmt_self_ip 10.0.0.132 --self_index 2 --num_nodes 3 --role cfgm --internal_virtual_router_id 110 --external_vip 10.0.0...

Revision history for this message
vivekananda shenoy (vshenoy83) wrote :

As per the latest request by NTTC we need the fix in 2.21 as well.

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.1

Review in progress for https://review.opencontrail.org/37060
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R2.21.x

Review in progress for https://review.opencontrail.org/37062
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.1

Review in progress for https://review.opencontrail.org/37060
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R2.21.x

Review in progress for https://review.opencontrail.org/37062
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.1

Review in progress for https://review.opencontrail.org/37334
Submitter: Dheeraj Gautam (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/37334
Committed: http://github.com/Juniper/contrail-puppet/commit/8eef701ed805c17b66a9e635be41babd492afa13
Submitter: Zuul (<email address hidden>)
Branch: R3.1

commit 8eef701ed805c17b66a9e635be41babd492afa13
Author: Dheeraj Gautam <email address hidden>
Date: Wed Nov 8 17:05:29 2017 -0800

update keepalived package version

Change-Id: Ia345a0cc6916d0f61394a952db0cd0c4a01c4a57
Closes-Bug: #1725461

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.1

Review in progress for https://review.opencontrail.org/37477
Submitter: Dheeraj Gautam (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/37477
Committed: http://github.com/Juniper/contrail-puppet/commit/b5f6b7a74d83c912f5cee909c72914d431c71369
Submitter: Zuul (<email address hidden>)
Branch: R3.1

commit b5f6b7a74d83c912f5cee909c72914d431c71369
Author: dgautam <email address hidden>
Date: Mon Nov 13 06:47:44 2017 -0800

fix keepalived version again.

Change-Id: I738cf68b245aab77cf76cfb3f7478c6d3a88e52b
Closes-Bug: #1725461

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.1

Review in progress for https://review.opencontrail.org/37539
Submitter: Dheeraj Gautam (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/37539
Committed: http://github.com/Juniper/contrail-puppet/commit/0050c25da442c97b8df43056ec945a4d9659837e
Submitter: Zuul (<email address hidden>)
Branch: R3.1

commit 0050c25da442c97b8df43056ec945a4d9659837e
Author: dgautam <email address hidden>
Date: Wed Nov 15 08:24:17 2017 -0800

correct keepalived version again.

Change-Id: Iae40abbeab7ea0132cce83a817238d178cfb8f4a
Partial-Bug: #1725461

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/37060
Committed: http://github.com/Juniper/contrail-packaging/commit/f855aca9872ba81c763f29656fecba9d167a77a0
Submitter: Zuul (<email address hidden>)
Branch: R3.1

commit f855aca9872ba81c763f29656fecba9d167a77a0
Author: Amudha <email address hidden>
Date: Wed Nov 1 10:33:30 2017 -0700

Ubuntu14.04: Upgrade keepalived package to 1.2.23

Change-Id: I81d57d0bed5352294eeea3d4090f4592b9d05da2
Closes-Bug: #1725461

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/37062
Committed: http://github.com/Juniper/contrail-packaging/commit/05c137c9af9b96cf1b0567bbae1ed33acf4b0bda
Submitter: Zuul (<email address hidden>)
Branch: R2.21.x

commit 05c137c9af9b96cf1b0567bbae1ed33acf4b0bda
Author: Amudha <email address hidden>
Date: Wed Nov 1 11:08:09 2017 -0700

Ubuntu14.04: Upgrade keepalived package to 1.2.23

Change-Id: Ie21a60996a9531bc9b93c9fe43851e37810b0958
Closes-Bug: #1725461

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.2

Review in progress for https://review.opencontrail.org/38632
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.0

Review in progress for https://review.opencontrail.org/38633
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.1

Review in progress for https://review.opencontrail.org/38634
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/38635
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.0

Review in progress for https://review.opencontrail.org/38633
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.1

Review in progress for https://review.opencontrail.org/38634
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/38635
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.2

Review in progress for https://review.opencontrail.org/38837
Submitter: Dheeraj Gautam (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/38837
Committed: http://github.com/Juniper/contrail-puppet/commit/20216ca526e1574c1688dc0ff483c33a61475f8e
Submitter: Zuul (<email address hidden>)
Branch: R3.2

commit 20216ca526e1574c1688dc0ff483c33a61475f8e
Author: Dheeraj Gautam <email address hidden>
Date: Thu Jan 11 17:30:35 2018 -0800

use newer version of keepalived package

Change-Id: Ie2ebb0099e4ac4c64923c6a88755127f9a98d908
Closes-Bug: #1725461

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/38634
Committed: http://github.com/Juniper/contrail-packaging/commit/56369063726d546a0206795680cb0bc91afcff62
Submitter: Zuul (<email address hidden>)
Branch: R4.1

commit 56369063726d546a0206795680cb0bc91afcff62
Author: Amudha <email address hidden>
Date: Tue Jan 2 13:13:41 2018 -0800

Upgrade keepalived package to 1.2.23

Upgrade keepalived package for Ubuntu14.04 and Ubuntu16.04

Change-Id: Ia7cf4c025bd39a2907bf90738b62c3ee9eea2ce7
Closes-Bug: #1725461

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/38635
Committed: http://github.com/Juniper/contrail-packaging/commit/2b6cd2e805282e7b8b6969a12be1061ce8327f62
Submitter: Zuul (<email address hidden>)
Branch: master

commit 2b6cd2e805282e7b8b6969a12be1061ce8327f62
Author: Amudha <email address hidden>
Date: Tue Jan 2 13:13:41 2018 -0800

Upgrade keepalived package to 1.2.23

Upgrade keepalived package for Ubuntu14.04 and Ubuntu16.04

Change-Id: Ia7cf4c025bd39a2907bf90738b62c3ee9eea2ce7
Closes-Bug: #1725461

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R3.1

Review in progress for https://review.opencontrail.org/38957
Submitter: Nitish Krishna Kaveri (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/38632
Committed: http://github.com/Juniper/contrail-packaging/commit/d806eb89dc424678f81ba8f142a9579b3b64411e
Submitter: Zuul (<email address hidden>)
Branch: R3.2

commit d806eb89dc424678f81ba8f142a9579b3b64411e
Author: Amudha <email address hidden>
Date: Tue Jan 2 13:02:05 2018 -0800

Ubuntu14.04: Upgrade keepalived package to 1.2.23

Change-Id: Ie990dc2f9b1a34e6d722ee8d2e64919fbfea1768
Closes-Bug: #1725461

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/38957
Committed: http://github.com/Juniper/contrail-puppet/commit/6fca32d38a88291a5ddbfdd62e97fb89b0e61d89
Submitter: Zuul (<email address hidden>)
Branch: R3.1

commit 6fca32d38a88291a5ddbfdd62e97fb89b0e61d89
Author: nitishkrishna <email address hidden>
Date: Tue Jan 16 17:10:51 2018 -0800

Closes-Bug: #1725461 - Correct version for keepalived package

This package version was causing provision failure in HA

Change-Id: I5482db7db1ea78c851686995d2f3763ae25c2302

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/39025
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.0

Review in progress for https://review.opencontrail.org/39057
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.1

Review in progress for https://review.opencontrail.org/39058
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/39025
Committed: http://github.com/Juniper/contrail-docker/commit/a4725c132f16d4162dd623594a52cac632f8e6d9
Submitter: Zuul (<email address hidden>)
Branch: master

commit a4725c132f16d4162dd623594a52cac632f8e6d9
Author: Amudha <email address hidden>
Date: Thu Jan 18 20:48:31 2018 -0800

Ocata: Install of unauthenticated keepalived package

Allow install of unauthenticated keepalived package in kolla
container.

Change-Id: Id35e6cfcf439df4338ea706eabb709b5b2a41e62
Closes-Bug: #1725461

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/38633
Committed: http://github.com/Juniper/contrail-packaging/commit/6dd66b0368f8f0040effa48e74dfafe21aaf99b5
Submitter: Zuul (<email address hidden>)
Branch: R4.0

commit 6dd66b0368f8f0040effa48e74dfafe21aaf99b5
Author: Amudha <email address hidden>
Date: Tue Jan 2 13:13:41 2018 -0800

Upgrade keepalived package to 1.2.23

Upgrade keepalived package for Ubuntu14.04 and Ubuntu16.04

Change-Id: Ia7cf4c025bd39a2907bf90738b62c3ee9eea2ce7
Closes-Bug: #1725461

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/39058
Committed: http://github.com/Juniper/contrail-docker/commit/aeb15f0bc5d2279e9834e79709ba76a845145d22
Submitter: Zuul (<email address hidden>)
Branch: R4.1

commit aeb15f0bc5d2279e9834e79709ba76a845145d22
Author: Amudha <email address hidden>
Date: Thu Jan 18 20:48:31 2018 -0800

Ocata: Install of unauthenticated keepalived package

Allow install of unauthenticated keepalived package in kolla
container.

Change-Id: Id35e6cfcf439df4338ea706eabb709b5b2a41e62
Closes-Bug: #1725461

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/39057
Committed: http://github.com/Juniper/contrail-docker/commit/569b3ac4f0a88068e1df63655f0f0a5c440bdfa0
Submitter: Zuul (<email address hidden>)
Branch: R4.0

commit 569b3ac4f0a88068e1df63655f0f0a5c440bdfa0
Author: Amudha <email address hidden>
Date: Thu Jan 18 20:48:31 2018 -0800

Ocata: Install of unauthenticated keepalived package

Allow install of unauthenticated keepalived package in kolla
container.

Change-Id: Id35e6cfcf439df4338ea706eabb709b5b2a41e62
Closes-Bug: #1725461

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/39364
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.0

Review in progress for https://review.opencontrail.org/39367
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.1

Review in progress for https://review.opencontrail.org/39368
Submitter: amudha ramachandran (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/39364
Committed: http://github.com/Juniper/contrail-packaging/commit/1e768661fce9397195d4ebe6cece35c90ea69709
Submitter: Zuul v3 CI (<email address hidden>)
Branch: master

commit 1e768661fce9397195d4ebe6cece35c90ea69709
Author: Amudha <email address hidden>
Date: Wed Jan 31 10:19:39 2018 -0800

Ubuntu16.04: Update 16.04 keepalived package

Update keepalived package for Ubuntu16.04 as the same as Ubuntu14.04

Change-Id: I744c585a8069513f77b2a03b766a7652ee44302b
Closes-Bug: #1725461

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/39367
Committed: http://github.com/Juniper/contrail-packaging/commit/b02697206816e1a82fb75c88a9c893de766efbef
Submitter: Zuul (<email address hidden>)
Branch: R4.0

commit b02697206816e1a82fb75c88a9c893de766efbef
Author: Amudha <email address hidden>
Date: Wed Jan 31 10:19:39 2018 -0800

Ubuntu16.04: Update 16.04 keepalived package

Update keepalived package for Ubuntu16.04 as the same as Ubuntu14.04

Change-Id: I744c585a8069513f77b2a03b766a7652ee44302b
Closes-Bug: #1725461

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/39368
Committed: http://github.com/Juniper/contrail-packaging/commit/806a0125986c345ac2cc5cbcc4f69820347c49b4
Submitter: Zuul (<email address hidden>)
Branch: R4.1

commit 806a0125986c345ac2cc5cbcc4f69820347c49b4
Author: Amudha <email address hidden>
Date: Wed Jan 31 10:19:39 2018 -0800

Ubuntu16.04: Update 16.04 keepalived package

Update keepalived package for Ubuntu16.04 as the same as Ubuntu14.04

Change-Id: I744c585a8069513f77b2a03b766a7652ee44302b
Closes-Bug: #1725461

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.