shellinaboxd progress can not be stopped on all conductors

Bug #1716878 reported by fupingxie
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Ironic
In Progress
Medium
Unassigned

Bug Description

my operations:
1. There are 3 conductors:conductor-1,conductor-2,conductor-3
2. first,I turn a BM console on, then conductor-1 start a shellinaboxd progress which use port 5900
3. second, I create a BM instance,then, the function _sync_local_state will start a shellinaboxd progress on conductor-2 and conductor-3.
4. third, I turn set the BM console off, the shellinaboxd progress on conductor-1 will be stopped,but the shellinaboxd progress on conductor-2 or conductor-3 will not be stopped.
5. last, I delete the BM instance and unenroll the BM. Then reenroll this BM. When I want to turn the BM console on, it would be fail if the request is allocated to conductor-2 or conductor-3,because the port 5900 is still being used.

fupingxie (fpxie)
Changed in ironic:
assignee: nobody → fupingxie (fpxie)
Changed in ironic:
importance: Undecided → Medium
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to ironic (master)

Fix proposed to branch: master
Review: https://review.openstack.org/511422

Changed in ironic:
status: New → In Progress
Revision history for this message
Vasyl Saienko (vsaienko) wrote :

I'm a bit lost here only one conductor should manage node at a time unless `hash_distribution_replicas` is set to non default value which is experimental.

_sync_local_state works only with nodes mapped to particular conductor https://github.com/openstack/ironic/blob/95cc0b110bbc3690335bf50e4468479aa356b315/ironic/conductor/manager.py#L1495
Could you please provide your ironic.conf?

Changed in ironic:
status: In Progress → Incomplete
Changed in ironic:
status: Incomplete → In Progress
Revision history for this message
fupingxie (fpxie) wrote :

@Vasyl, here is my config:
[DEFAULT]
auth_strategy = keystone
enabled_drivers = pxe_ipmitool
my_ip = 10.127.2.41
transport_url = rabbit://openstack:Abc12345@10.127.2.146
enabled_network_interfaces = neutron
default_network_interface = neutron
debug = True
use_stderr = False
hash_distribution_replicas = 3
[agent]
deploy_logs_local_path = /var/log/ironic/deploy
deploy_logs_collect = always
[amt]
[api]
port = 6386
api_workers = 5
enable_ssl_api = True
[audit]
[cimc]
[cisco_ucs]
[conductor]
api_url = https://10.0.202.41:6386
automated_clean = False
[console]
[cors]
[cors.subdomain]
[database]
connection=mysql+pymysql://ironic:Abc12345@10.127.2.146/ironic?charset=utf8
[deploy]
default_boot_option = local
[dhcp]
[disk_partitioner]
[disk_utils]
[drac]
[glance]
auth_url = https://10.127.2.146:35357
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = glance
password = glance
glance_host = $my_ip
glance_cafile=/etc/ironic/ssl/ca.crt
glance_protocol=https
glance_api_insecure=False
[iboot]
[ilo]
[inspector]
enabled = false
auth_url = https://10.127.2.146:35357
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = ironic_inspector
password = 123456
[ipmi]
[irmc]
[ironic_lib]
[iscsi]
[keystone]
[keystone_authtoken]
auth_url = https://10.127.2.146:35357
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = ironic
password = Abc12345
cafile=/etc/ironic/ssl/ca.crt
[matchmaker_redis]
[metrics]
[metrics_statsd]
[neutron]
auth_url = https://10.127.2.146:5000
cafile = /etc/ironic/ssl/ca.crt
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = neutron
password = neutron
provisioning_network_uuid = 8d5a74b3-3c43-46a2-a7de-0d5eb3d152c3
cleaning_network_uuid = 8d5a74b3-3c43-46a2-a7de-0d5eb3d152c3
[oneview]
[oslo_concurrency]
[oslo_messaging_amqp]
[oslo_messaging_notifications]
[oslo_messaging_rabbit]
amqp_durable_queues = True
[oslo_messaging_zmq]
[oslo_policy]
[pxe]
tftp_server = 10.0.202.41
images_path = /opt/imagecache/images
instance_master_path = /opt/imagecache/master_images
image_cache_size = 500
image_cache_ttl = 10080
pxe_append_params = nofb nomodeset vga=normal ipa-debug=1 ipa-insecure=1 coreos.autologin console=tty0 console=ttyS0,115200n8
[seamicro]
[service_catalog]
auth_url = http://10.127.2.146:35357
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = ironic
password = Abc12345
[snmp]
[ssh]
[ssl]
cert_file = /etc/ironic/ssl/server.crt
key_file = /etc/ironic/ssl/server.key
[swift]
[virtualbox]
You have new mail in /var/spool/mail/root

fupingxie (fpxie)
description: updated
description: updated
fupingxie (fpxie)
description: updated
description: updated
Revision history for this message
Sam Betts (sambetts) wrote :

Adding a node here for other people looking, this bug is for the case when:

   hash_distribution_replicas = >1

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Fix proposed to branch: master
Review: https://review.openstack.org/546877

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on ironic (master)

Change abandoned by fupingxie (<email address hidden>) on branch: master
Review: https://review.openstack.org/511422

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Change abandoned by fupingxie (<email address hidden>) on branch: master
Review: https://review.openstack.org/546877

fupingxie (fpxie)
Changed in ironic:
assignee: fupingxie (fpxie) → nobody
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.