RHOSP_R4.1-Build2-Ocata-Vrouter agent core : boost::_mfi::mf2<bool, AgentRouteWalker, DBTablePartBase*, DBEntryBase*>::operator()(AgentRouteWalker*, DBTablePartBase*, DBEntryBase*) const ()

Bug #1733412 reported by shajuvk
14
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R4.1
Fix Committed
High
Naveen N
Trunk
Fix Committed
High
Naveen N

Bug Description

[root@overcloud-novacompute-0 ~]# contrail-status
== Contrail vRouter ==
supervisor-vrouter: active
contrail-vrouter-agent active
contrail-vrouter-nodemgr active

========Run time service failures=============
/var/crashes/core.contrail-vroute.53864.overcloud-novacompute-0.1511206824
/var/crashes/core.contrail-vroute.72758.overcloud-novacompute-0.1511206857
/var/crashes/core.contrail-vroute.72801.overcloud-novacompute-0.1511206903
[root@overcloud-novacompute-0 ~]# gdb /usr/bin/contrail-vrouter-agent /var/crashes/core.contrail-vroute.53864.overcloud-novacompute-0.1511206824
GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-100.el7

[New LWP 53944]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Core was generated by `/usr/bin/contrail-vrouter-agent'.
Program terminated with signal 11, Segmentation fault.
#0 0x00002b6d76e7af70 in ?? ()
Missing separate debuginfos, use: debuginfo-install contrail-vrouter-agent-4.1.0.0-2.el7.x86_64
(gdb) bt
#0 0x00002b6d76e7af70 in ?? ()
#1 0x0000000001b106fc in boost::_mfi::mf2<bool, AgentRouteWalker, DBTablePartBase*, DBEntryBase*>::operator()(AgentRouteWalker*, DBTablePartBase*, DBEntryBase*) const ()
#2 0x0000000001b0ff25 in bool boost::_bi::list3<boost::_bi::value<AgentRouteWalker*>, boost::arg<1>, boost::arg<2> >::operator()<bool, boost::_mfi::mf2<bool, AgentRouteWalker, DBTablePartBase*, DBEntryBase*>, boost::_bi::list2<DBTablePartBase*&, DBEntryBase*&> >(boost::_bi::type<bool>, boost::_mfi::mf2<bool, AgentRouteWalker, DBTablePartBase*, DBEntryBase*>&, boost::_bi::list2<DBTablePartBase*&, DBEntryBase*&>&, long) ()
#3 0x0000000001b0f56c in bool boost::_bi::bind_t<bool, boost::_mfi::mf2<bool, AgentRouteWalker, DBTablePartBase*, DBEntryBase*>, boost::_bi::list3<boost::_bi::value<AgentRouteWalker*>, boost::arg<1>, boost::arg<2> > >::operator()<DBTablePartBase*, DBEntryBase*>(DBTablePartBase*&, DBEntryBase*&) ()
#4 0x0000000001b0e71d in boost::detail::function::function_obj_invoker2<boost::_bi::bind_t<bool, boost::_mfi::mf2<bool, AgentRouteWalker, DBTablePartBase*, DBEntryBase*>, boost::_bi::list3<boost::_bi::value<AgentRouteWalker*>, boost::arg<1>, boost::arg<2> > >, bool, DBTablePartBase*, DBEntryBase*>::invoke(boost::detail::function::function_buffer&, DBTablePartBase*, DBEntryBase*) ()
#5 0x000000000271433c in boost::function2<bool, DBTablePartBase*, DBEntryBase*>::operator()(DBTablePartBase*, DBEntryBase*) const ()
#6 0x00000000027135d5 in DBTableWalkMgr::InvokeWalkCb(DBTablePartBase*, DBEntryBase*) ()
#7 0x0000000002708519 in DBTable::InvokeWalkCb(DBTablePartBase*, DBEntryBase*) ()
#8 0x0000000002706eeb in DBTable::WalkWorker::Run() ()
#9 0x00000000028a3856 in TaskImpl::execute() ()
#10 0x00002b6d6e61e440 in tbb::internal::custom_scheduler<tbb::internal::IntelSchedulerTraits>::local_wait_for_all (this=0x2b6d90000900, parent=...,
    child=0x2b6d80001240) at /home/contrail-builder/workspace/Nightly-RedHat70-Build/sandbox/third_party/tbb40_20111130oss/src/tbb/custom_scheduler.h:449
#11 0x00002b6d6e6152e4 in tbb::internal::arena::process (this=0x3ac2600, s=...)
    at /home/contrail-builder/workspace/Nightly-RedHat70-Build/sandbox/third_party/tbb40_20111130oss/src/tbb/arena.cpp:99
#12 0x00002b6d6e613c24 in tbb::internal::market::process (this=0x3accb00, j=...)
    at /home/contrail-builder/workspace/Nightly-RedHat70-Build/sandbox/third_party/tbb40_20111130oss/src/tbb/market.cpp:393
#13 0x00002b6d6e60e9c2 in tbb::internal::rml::private_worker::run (this=0x3ac1880)
    at /home/contrail-builder/workspace/Nightly-RedHat70-Build/sandbox/third_party/tbb40_20111130oss/src/tbb/private_server.cpp:263
#14 0x00002b6d6e60e864 in tbb::internal::rml::private_worker::thread_routine (arg=0x3ac1880)
    at /home/contrail-builder/workspace/Nightly-RedHat70-Build/sandbox/third_party/tbb40_20111130oss/src/tbb/private_server.cpp:231
#15 0x00002b6d6e3d9e25 in start_thread () from /lib64/libpthread.so.0
#16 0x00002b6d6f15a34d in clone () from /lib64/libc.so.6

--====

[root@overcloud-novacompute-0 ~]# ontrail-version
bash: ontrail-version: command not found
[root@overcloud-novacompute-0 ~]# contrail-version
Package Version Build-ID | Repo | RPM Name
-------------------------------------- ------------------------------ ----------------------------------
contrail-lib 4.1.0.0-2.el7 @Contrail
contrail-nodemgr 4.1.0.0-2.el7 @Contrail
contrail-nova-vif 4.1.0.0-2.el7 @Contrail
contrail-setup 4.1.0.0-2.el7 @Contrail
contrail-tripleo-puppet 4.1.0.0-2.el7 @Contrail
contrail-utils 4.1.0.0-2.el7 @Contrail
contrail-vrouter 4.1.0.0-2.el7 @Contrail
contrail-vrouter-agent 4.1.0.0-2.el7 @Contrail
contrail-vrouter-common 4.1.0.0-2.el7 @Contrail
contrail-vrouter-init 4.1.0.0-2.el7 @Contrail
contrail-vrouter-utils 4.1.0.0-2.el7 @Contrail
puppet-contrail 4.1.0.0-2.el7 @Contrail
python-contrail 4.1.0.0-2.el7 @Contrail
python-contrail-vrouter-api 4.1.0.0-2.el7 @Contrail
python-opencontrail-vrouter-netns 4.1.0.0-2.el7 @Contrail

Revision history for this message
shajuvk (shajuvk) wrote :
shajuvk (shajuvk)
information type: Proprietary → Public
Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] R4.1

Review in progress for https://review.opencontrail.org/37857
Submitter: Naveen N (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : [Review update] master

Review in progress for https://review.opencontrail.org/37858
Submitter: Naveen N (<email address hidden>)

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote : A change has been merged

Reviewed: https://review.opencontrail.org/37858
Committed: http://github.com/Juniper/contrail-controller/commit/f45ef7ba51f2336906ce62af76a71304771a8261
Submitter: Zuul (<email address hidden>)
Branch: master

commit f45ef7ba51f2336906ce62af76a71304771a8261
Author: Naveen N <email address hidden>
Date: Sat Nov 25 12:50:53 2017 +0530

* Hold reference to AgentRouteWalker till walk completes

Steps to problem
1> VRF notify resulting in route table walk
2> Peer is decommisioned resulting in walker release
3> Route table walk due to step 1 is triggered which is accesing freed
pointer
Fix hold reference to walker till route walk completes
Test case for same.
Closes-bug: #1733412

Change-Id: I9ac9e5d1a67e594bc098ab765dee13cd4aa2b728

Revision history for this message
OpenContrail Admin (ci-admin-f) wrote :

Reviewed: https://review.opencontrail.org/37857
Committed: http://github.com/Juniper/contrail-controller/commit/843782b1a7377c0b51bb59b4dca5f37dff151b5e
Submitter: Zuul (<email address hidden>)
Branch: R4.1

commit 843782b1a7377c0b51bb59b4dca5f37dff151b5e
Author: Naveen N <email address hidden>
Date: Sat Nov 25 12:50:53 2017 +0530

* Hold reference to AgentRouteWalker till walk completes

Steps to problem
1> VRF notify resulting in route table walk
2> Peer is decommisioned resulting in walker release
3> Route table walk due to step 1 is triggered which is accesing freed
pointer
Fix hold reference to walker till route walk completes
Test case for same.
Closes-bug: #1733412

Change-Id: I9ac9e5d1a67e594bc098ab765dee13cd4aa2b728

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.