Patched the fix in this setup and verified,
NODEC1 CONTRAIL-ANSIBLE SERVICE LOGS: ====================================== Sep 21 00:04:54 nodec1 contrailctl[24799]: TASK [rabbitmq : Start rabbitmq-server in the leader node] ********************* Sep 21 00:04:54 nodec1 contrailctl[24799]: included: /contrail-ansible-internal/playbooks/roles/rabbitmq/tasks/service.yml for localhost Sep 21 00:04:54 nodec1 contrailctl[24799]: TASK [rabbitmq : Retry starting rabbitmq-server in RedHat platforms] *********** Sep 21 00:04:54 nodec1 contrailctl[24799]: skipping: [localhost] Sep 21 00:04:54 nodec1 contrailctl[24799]: TASK [rabbitmq : Make sure rabbitmq-server service is in desired state] ******** Sep 21 00:04:59 nodec1 contrailctl[24799]: changed: [localhost] Sep 21 00:04:59 nodec1 contrailctl[24799]: TASK [rabbitmq : Wait for master node to be up] ******************************** Sep 21 00:04:59 nodec1 contrailctl[24799]: skipping: [localhost] Sep 21 00:04:59 nodec1 contrailctl[24799]: TASK [rabbitmq : Check rabbitmq cluster] *************************************** Sep 21 00:04:59 nodec1 su[25542]: Successful su for rabbitmq by root Sep 21 00:04:59 nodec1 su[25542]: + ??? root:rabbitmq Sep 21 00:04:59 nodec1 su[25542]: pam_env(su:session): Unable to open env file: /etc/default/locale: No such file or directory Sep 21 00:04:59 nodec1 su[25542]: pam_unix(su:session): session opened for user rabbitmq by (uid=0) Sep 21 00:04:59 nodec1 su[25542]: pam_unix(su:session): session closed for user rabbitmq Sep 21 00:04:59 nodec1 contrailctl[24799]: changed: [localhost] Sep 21 00:04:59 nodec1 contrailctl[24799]: TASK [rabbitmq : join cluster] ************************************************* Sep 21 00:04:59 nodec1 contrailctl[24799]: skipping: [localhost] Sep 21 00:04:59 nodec1 contrailctl[24799]: TASK [rabbitmq : include] ****************************************************** Sep 21 00:04:59 nodec1 contrailctl[24799]: included: /contrail-ansible-internal/playbooks/roles/rabbitmq/tasks/service.yml for localhost Sep 21 00:05:00 nodec1 contrailctl[24799]: TASK [rabbitmq : Retry starting rabbitmq-server in RedHat platforms] *********** Sep 21 00:05:00 nodec1 contrailctl[24799]: skipping: [localhost] Sep 21 00:05:00 nodec1 contrailctl[24799]: TASK [rabbitmq : Make sure rabbitmq-server service is in desired state] ******** Sep 21 00:05:00 nodec1 contrailctl[24799]: ok: [localhost]
NODEC2 CONTRAIL-ANSIBLE SERVICE LOGS: ====================================== Sep 21 00:04:51 nodec2 contrailctl[25652]: TASK [rabbitmq : Start rabbitmq-server in the leader node] ********************* Sep 21 00:04:51 nodec2 contrailctl[25652]: skipping: [localhost] Sep 21 00:04:51 nodec2 contrailctl[25652]: TASK [rabbitmq : Wait for master node to be up] ******************************** Sep 21 00:05:02 nodec2 contrailctl[25652]: ok: [localhost] Sep 21 00:05:02 nodec2 contrailctl[25652]: TASK [rabbitmq : Check rabbitmq cluster] *************************************** Sep 21 00:05:02 nodec2 su[26121]: Successful su for rabbitmq by root Sep 21 00:05:02 nodec2 su[26121]: + ??? root:rabbitmq Sep 21 00:05:02 nodec2 su[26121]: pam_env(su:session): Unable to open env file: /etc/default/locale: No such file or directory Sep 21 00:05:02 nodec2 su[26121]: pam_unix(su:session): session opened for user rabbitmq by (uid=0) Sep 21 00:05:02 nodec2 su[26121]: pam_unix(su:session): session closed for user rabbitmq Sep 21 00:05:02 nodec2 contrailctl[25652]: changed: [localhost] Sep 21 00:05:02 nodec2 contrailctl[25652]: TASK [rabbitmq : join cluster] ************************************************* Sep 21 00:05:02 nodec2 contrailctl[25652]: skipping: [localhost] Sep 21 00:05:02 nodec2 contrailctl[25652]: TASK [rabbitmq : include] ****************************************************** Sep 21 00:05:02 nodec2 contrailctl[25652]: included: /contrail-ansible-internal/playbooks/roles/rabbitmq/tasks/service.yml for localhost Sep 21 00:05:02 nodec2 contrailctl[25652]: TASK [rabbitmq : Retry starting rabbitmq-server in RedHat platforms] *********** Sep 21 00:05:02 nodec2 contrailctl[25652]: skipping: [localhost] Sep 21 00:05:02 nodec2 contrailctl[25652]: TASK [rabbitmq : Make sure rabbitmq-server service is in desired state] ******** Sep 21 00:05:07 nodec2 contrailctl[25652]: changed: [localhost]
NODEC3 CONTRAIL-ANSIBLE SERVICE LOGS: ====================================== Sep 21 00:04:48 nodec3 contrailctl[14758]: TASK [rabbitmq : Start rabbitmq-server in the leader node] ********************* Sep 21 00:04:48 nodec3 contrailctl[14758]: skipping: [localhost] Sep 21 00:04:48 nodec3 contrailctl[14758]: TASK [rabbitmq : Wait for master node to be up] ******************************** Sep 21 00:05:00 nodec3 contrailctl[14758]: ok: [localhost] Sep 21 00:05:00 nodec3 contrailctl[14758]: TASK [rabbitmq : Check rabbitmq cluster] *************************************** Sep 21 00:05:00 nodec3 su[15258]: Successful su for rabbitmq by root Sep 21 00:05:00 nodec3 su[15258]: + ??? root:rabbitmq Sep 21 00:05:00 nodec3 su[15258]: pam_env(su:session): Unable to open env file: /etc/default/locale: No such file or directory Sep 21 00:05:00 nodec3 su[15258]: pam_unix(su:session): session opened for user rabbitmq by (uid=0) Sep 21 00:05:00 nodec3 su[15258]: pam_unix(su:session): session closed for user rabbitmq Sep 21 00:05:00 nodec3 contrailctl[14758]: changed: [localhost] Sep 21 00:05:00 nodec3 contrailctl[14758]: TASK [rabbitmq : join cluster] ************************************************* Sep 21 00:05:00 nodec3 contrailctl[14758]: skipping: [localhost] Sep 21 00:05:00 nodec3 contrailctl[14758]: TASK [rabbitmq : include] ****************************************************** Sep 21 00:05:00 nodec3 contrailctl[14758]: included: /contrail-ansible-internal/playbooks/roles/rabbitmq/tasks/service.yml for localhost Sep 21 00:05:00 nodec3 contrailctl[14758]: TASK [rabbitmq : Retry starting rabbitmq-server in RedHat platforms] *********** Sep 21 00:05:00 nodec3 contrailctl[14758]: skipping: [localhost] Sep 21 00:05:00 nodec3 contrailctl[14758]: TASK [rabbitmq : Make sure rabbitmq-server service is in desired state] ******** Sep 21 00:05:05 nodec3 contrailctl[14758]: changed: [localhost]
Patched the fix in this setup and verified,
NODEC1 CONTRAIL-ANSIBLE SERVICE LOGS: ======= ======= ======= ======= === ******* ******* ansible- internal/ playbooks/ roles/rabbitmq/ tasks/service. yml for localhost ******* ******* ******* **** ******* ******* ******* ******* **** su:session) : Unable to open env file: /etc/default/ locale: No such file or directory su:session) : session opened for user rabbitmq by (uid=0) su:session) : session closed for user rabbitmq ******* ******* ******* ******* ******* ******* ******* ******* ******* ******* ******* ******* ***** ansible- internal/ playbooks/ roles/rabbitmq/ tasks/service. yml for localhost
=======
Sep 21 00:04:54 nodec1 contrailctl[24799]: TASK [rabbitmq : Start rabbitmq-server in the leader node] *******
Sep 21 00:04:54 nodec1 contrailctl[24799]: included: /contrail-
Sep 21 00:04:54 nodec1 contrailctl[24799]: TASK [rabbitmq : Retry starting rabbitmq-server in RedHat platforms] ***********
Sep 21 00:04:54 nodec1 contrailctl[24799]: skipping: [localhost]
Sep 21 00:04:54 nodec1 contrailctl[24799]: TASK [rabbitmq : Make sure rabbitmq-server service is in desired state] ********
Sep 21 00:04:59 nodec1 contrailctl[24799]: changed: [localhost]
Sep 21 00:04:59 nodec1 contrailctl[24799]: TASK [rabbitmq : Wait for master node to be up] *******
Sep 21 00:04:59 nodec1 contrailctl[24799]: skipping: [localhost]
Sep 21 00:04:59 nodec1 contrailctl[24799]: TASK [rabbitmq : Check rabbitmq cluster] *******
Sep 21 00:04:59 nodec1 su[25542]: Successful su for rabbitmq by root
Sep 21 00:04:59 nodec1 su[25542]: + ??? root:rabbitmq
Sep 21 00:04:59 nodec1 su[25542]: pam_env(
Sep 21 00:04:59 nodec1 su[25542]: pam_unix(
Sep 21 00:04:59 nodec1 su[25542]: pam_unix(
Sep 21 00:04:59 nodec1 contrailctl[24799]: changed: [localhost]
Sep 21 00:04:59 nodec1 contrailctl[24799]: TASK [rabbitmq : join cluster] *******
Sep 21 00:04:59 nodec1 contrailctl[24799]: skipping: [localhost]
Sep 21 00:04:59 nodec1 contrailctl[24799]: TASK [rabbitmq : include] *******
Sep 21 00:04:59 nodec1 contrailctl[24799]: included: /contrail-
Sep 21 00:05:00 nodec1 contrailctl[24799]: TASK [rabbitmq : Retry starting rabbitmq-server in RedHat platforms] ***********
Sep 21 00:05:00 nodec1 contrailctl[24799]: skipping: [localhost]
Sep 21 00:05:00 nodec1 contrailctl[24799]: TASK [rabbitmq : Make sure rabbitmq-server service is in desired state] ********
Sep 21 00:05:00 nodec1 contrailctl[24799]: ok: [localhost]
NODEC2 CONTRAIL-ANSIBLE SERVICE LOGS: ======= ======= ======= ======= === ******* ******* ******* ******* ******* **** ******* ******* ******* ******* **** su:session) : Unable to open env file: /etc/default/ locale: No such file or directory su:session) : session opened for user rabbitmq by (uid=0) su:session) : session closed for user rabbitmq ******* ******* ******* ******* ******* ******* ******* ******* ******* ******* ******* ******* ***** ansible- internal/ playbooks/ roles/rabbitmq/ tasks/service. yml for localhost
=======
Sep 21 00:04:51 nodec2 contrailctl[25652]: TASK [rabbitmq : Start rabbitmq-server in the leader node] *******
Sep 21 00:04:51 nodec2 contrailctl[25652]: skipping: [localhost]
Sep 21 00:04:51 nodec2 contrailctl[25652]: TASK [rabbitmq : Wait for master node to be up] *******
Sep 21 00:05:02 nodec2 contrailctl[25652]: ok: [localhost]
Sep 21 00:05:02 nodec2 contrailctl[25652]: TASK [rabbitmq : Check rabbitmq cluster] *******
Sep 21 00:05:02 nodec2 su[26121]: Successful su for rabbitmq by root
Sep 21 00:05:02 nodec2 su[26121]: + ??? root:rabbitmq
Sep 21 00:05:02 nodec2 su[26121]: pam_env(
Sep 21 00:05:02 nodec2 su[26121]: pam_unix(
Sep 21 00:05:02 nodec2 su[26121]: pam_unix(
Sep 21 00:05:02 nodec2 contrailctl[25652]: changed: [localhost]
Sep 21 00:05:02 nodec2 contrailctl[25652]: TASK [rabbitmq : join cluster] *******
Sep 21 00:05:02 nodec2 contrailctl[25652]: skipping: [localhost]
Sep 21 00:05:02 nodec2 contrailctl[25652]: TASK [rabbitmq : include] *******
Sep 21 00:05:02 nodec2 contrailctl[25652]: included: /contrail-
Sep 21 00:05:02 nodec2 contrailctl[25652]: TASK [rabbitmq : Retry starting rabbitmq-server in RedHat platforms] ***********
Sep 21 00:05:02 nodec2 contrailctl[25652]: skipping: [localhost]
Sep 21 00:05:02 nodec2 contrailctl[25652]: TASK [rabbitmq : Make sure rabbitmq-server service is in desired state] ********
Sep 21 00:05:07 nodec2 contrailctl[25652]: changed: [localhost]
NODEC3 CONTRAIL-ANSIBLE SERVICE LOGS: ======= ======= ======= ======= === ******* ******* ******* ******* ******* **** ******* ******* ******* ******* **** su:session) : Unable to open env file: /etc/default/ locale: No such file or directory su:session) : session opened for user rabbitmq by (uid=0) su:session) : session closed for user rabbitmq ******* ******* ******* ******* ******* ******* ******* ******* ******* ******* ******* ******* ***** ansible- internal/ playbooks/ roles/rabbitmq/ tasks/service. yml for localhost
=======
Sep 21 00:04:48 nodec3 contrailctl[14758]: TASK [rabbitmq : Start rabbitmq-server in the leader node] *******
Sep 21 00:04:48 nodec3 contrailctl[14758]: skipping: [localhost]
Sep 21 00:04:48 nodec3 contrailctl[14758]: TASK [rabbitmq : Wait for master node to be up] *******
Sep 21 00:05:00 nodec3 contrailctl[14758]: ok: [localhost]
Sep 21 00:05:00 nodec3 contrailctl[14758]: TASK [rabbitmq : Check rabbitmq cluster] *******
Sep 21 00:05:00 nodec3 su[15258]: Successful su for rabbitmq by root
Sep 21 00:05:00 nodec3 su[15258]: + ??? root:rabbitmq
Sep 21 00:05:00 nodec3 su[15258]: pam_env(
Sep 21 00:05:00 nodec3 su[15258]: pam_unix(
Sep 21 00:05:00 nodec3 su[15258]: pam_unix(
Sep 21 00:05:00 nodec3 contrailctl[14758]: changed: [localhost]
Sep 21 00:05:00 nodec3 contrailctl[14758]: TASK [rabbitmq : join cluster] *******
Sep 21 00:05:00 nodec3 contrailctl[14758]: skipping: [localhost]
Sep 21 00:05:00 nodec3 contrailctl[14758]: TASK [rabbitmq : include] *******
Sep 21 00:05:00 nodec3 contrailctl[14758]: included: /contrail-
Sep 21 00:05:00 nodec3 contrailctl[14758]: TASK [rabbitmq : Retry starting rabbitmq-server in RedHat platforms] ***********
Sep 21 00:05:00 nodec3 contrailctl[14758]: skipping: [localhost]
Sep 21 00:05:00 nodec3 contrailctl[14758]: TASK [rabbitmq : Make sure rabbitmq-server service is in desired state] ********
Sep 21 00:05:05 nodec3 contrailctl[14758]: changed: [localhost]