Juniper Openstack

RHOSP10-newton-R4.0-build-33 webui login not working in HA multi-node setup

Bug #1713132 reported by shajuvk
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Juniper Openstack
Status tracked in Trunk
R4.0
Invalid
Critical
shajuvk
Juniper Openstack r4.0.2.0
R4.1
Invalid
High
shajuvk
Juniper Openstack r4.1.0.0-fcs "r4.1"
Trunk
Invalid
High
shajuvk
Juniper Openstack r5.0.0

Bug Description

Webui login not working in multi node setup with R4.0 build 33
Logs from /var/log/contrail/contrail-webui-stdout.log (R4.0 build)

08/25/2017 05:46:06 PM - debug: Job 274 completed by process: 8511
08/25/2017 05:46:06 PM - debug: Created a new Job with jobName:getVRoutersGenerators
08/25/2017 05:46:06 PM - debug: Job Got requeued with Job Type:getVRoutersGenerators
08/25/2017 05:46:11 PM - error: URL [http://10.0.0.41:8082/virtual-routers?detail=True] returned error [{"error":{"message":"The request you have made require
s authentication.","code":401,"title":"Unauthorized"}}]
Error: connect ECONNREFUSED
    at errnoException (net.js:905:11)
    at Object.afterConnect [as oncomplete] (net.js:896:19)
08/25/2017 05:46:11 PM - error: URL [http://192.0.2.13:5000/v2.0/tokens] returned error [{"code":"ECONNREFUSED","errno":"ECONNREFUSED","syscall":"connect"}]
08/25/2017 05:46:11 PM - error: authPostV2Req() error:REST Server Error: { [Error: connect ECONNREFUSED]
  code: 'ECONNREFUSED',
  errno: 'ECONNREFUSED',
  syscall: 'connect' }
08/25/2017 05:46:11 PM - error: Encountered broken link: /virtual-routers?detail=True
08/25/2017 05:46:11 PM - error: REST Server Error: User is not authenticated to available projects.
    at /usr/src/contrail/contrail-web-core/src/serverroot/orchestration/plugins/openstack/keystone.api.js:1377:23
    at /usr/src/contrail/contrail-web-core/src/serverroot/orchestration/plugins/openstack/keystone.api.js:937:17
    at getAuthData (/usr/src/contrail/contrail-web-core/src/serverroot/orchestration/plugins/openstack/keystone.api.js:490:9)
    at /usr/src/contrail/contrail-web-core/src/serverroot/orchestration/plugins/openstack/keystone.api.js:502:13
    at /usr/src/contrail/contrail-web-core/src/serverroot/orchestration/plugins/openstack/keystone.api.js:239:9
    at /usr/src/contrail/contrail-web-core/src/serverroot/orchestration/plugins/openstack/keystone.api.js:221:9
    at APIServer.retryMakeCall (/usr/src/contrail/contrail-web-core/src/serverroot/common/rest.api.js:209:5)
    at Request.<anonymous> (/usr/src/contrail/contrail-web-core/src/serverroot/common/rest.api.js:325:18)
    at Request.emit (events.js:98:17)
    at Request.mixin._fireError (/usr/lib64/node_modules/restler/lib/restler.js:204:10)
08/25/2017 05:46:11 PM - error: vRouter Config IP parse error:TypeError: Cannot read property 'virtual_router_ip_address' of undefined
08/25/2017 05:46:11 PM - debug: Got notified on Job Listener Channel:97544729-fd49-424f-b00f-e0c160bdb3e5
08/25/2017 05:46:11 PM - debug: We did not find this channel:97544729-fd49-424f-b00f-e0c160bdb3e5
08/25/2017 05:46:11 PM - debug: Job 273 completed by process: 8511
08/25/2017 05:46:11 PM - debug: Created a new Job with jobName:getVRoutersSummary
08/25/2017 05:46:11 PM - debug: Job Got requeued with Job Type:getVRoutersSummary

shajuvk (shajuvk)
information type: Proprietary → Public
Jeba Paulaiyan (jebap)
tags: added: provisioning
Revision history for this message
shajuvk (shajuvk) wrote :

[stack@undercloud ext]$ ssh heat-admin@192.0.2.13
Last login: Fri Aug 25 18:23:43 2017 from 192.0.2.1
[heat-admin@overcloud-controller-1 ~]$
[heat-admin@overcloud-controller-1 ~]$
[heat-admin@overcloud-controller-1 ~]$ netstat -nalp | grep 5000
(No info could be read for "-p": geteuid()=1000 but you should be root.)
tcp 0 0 10.87.67.15:5000 0.0.0.0:* LISTEN -
tcp 0 0 10.0.0.10:5000 0.0.0.0:* LISTEN -
tcp 0 0 10.0.0.21:5000 0.0.0.0:* LISTEN -
tcp 0 0 10.0.0.21:5000 10.0.0.21:52068 SYN_RECV -
[heat-admin@overcloud-controller-1 ~]$ netstat -nalp | grep 36357

[heat-admin@overcloud-controller-1 ~]$ netstat -nalp | grep 35357 | grep LIST
(No info could be read for "-p": geteuid()=1000 but you should be root.)
tcp 0 0 192.0.2.13:35357 0.0.0.0:* LISTEN -
tcp 0 0 10.87.67.15:35357 0.0.0.0:* LISTEN -
tcp 0 0 192.0.2.22:35357 0.0.0.0:* LISTEN -
[heat-admin@overcloud-controller-1 ~]$

Revision history for this message
alexey-mr (alexey-morlang) wrote :

Could you provide access to the environment?

Revision history for this message
shajuvk (shajuvk) wrote :

undercloud 10.87.67.42

Revision history for this message
Andrey Pavlov (apavlov-e) wrote :

Hi Shaju,

Here is problem in WebUI and then in ansible-internal scripts.

This deployment has many subnets.
keystone is listen admin connection on 10.0.0.10:5000 and other connections on 192.0.2.13:35357
All OpenStack services know about it and have different IP-s for these connections.
But ansible scripts has only one IP for both ports. ansible sets this IP with port 35357 to controller config and sets this IP to webui with port 5000.
So contrail works and webui is not.

I've changed a little config in controller contrainers - please check this issue now. If all in webui will work then we file other bugs for ansible-internal/contrailctl/webui to fix their functionality

shajuvk (shajuvk)
tags: added: analytics
removed: rhosp
Revision history for this message
Naga Kiran (nagakiran) wrote :

We have brought up HA setup with "4.1.0.0-41" and see the webui comes up fine.
Noticed that keystone listens on all interfaces in normal HA setup.

root@nodeg4:~# netstat -an | egrep "5000|35357" | grep LISTEN
tcp 0 0 0.0.0.0:5000 0.0.0.0:* LISTEN
tcp 0 0 0.0.0.0:35357 0.0.0.0:* LISTEN

It looks like a special case (keystone listening on different IP addresses for different ports( because of multiple subnets as Andrey also pointed.
Please share the setup details once it is up and will look at it.

Naga Kiran (nagakiran)
tags: added: ui
Revision history for this message
Jeba Paulaiyan (jebap) wrote :

From: "Shaju V.K" <email address hidden>
Date: Wednesday, October 4, 2017 at 12:41 AM
To: Jeba Paulaiyan <email address hidden>
Subject: Re: Bug #1713132 “RHOSP10-newton-R4.0-build-33 webui login not worki...” : Bugs : Juniper Openstack

No this is working now.
Sent from my iPhone

On Oct 3, 2017, at 9:20 PM, Jeba Paulaiyan <email address hidden> wrote:
https://bugs.launchpad.net/juniperopenstack/+bug/1713132

Does this happen now?

Thanks,
Jeba

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.