Networks and subnet not displayed in local neutron until accessed directly

Hi,

When using Tricircle, users can create networks in "local" neutrons servers via the central neutron server

However those network are not displayed using neutron --os-region-name=RegionOne net-list, subnet-list, or the openstack commandline variant, until they are accessed directly by the "local" neutron, when the network is a provider one, when a vm is created or when the network is explicitly requested using neutron --os-region-name=RegionOne net-show $id.

If that's a expected behavior (for example because the "local" neutron only display network that it already "know") it may be a good idea to consider documenting it: I literally spend hours wondering why those network were not created, in fact they were, they were just not displayed !

Please find bellow a command line trace:
- net0 is displayed only after a vm is attached to it
- net1 is displayed only after being explicitly requested using neutron net-show
- net2 is displayed since the begging, possibly because its a provider network and that the local neutron is aware of it since its creation.

Tested branch: stable/queens, did not test master.

Cheers,

--- snip ---

geb@ubuntu-devstack-test:~/devstack$ git branch
* stable/queens
geb@ubuntu-devstack-test:~/devstack$ git pull
Already up-to-date.
geb@ubuntu-devstack-test:~/devstack$ cat local.conf
[[local|localrc]]
############################################################
# Customize the following HOST_IP based on your installation
############################################################
HOST_IP=10.0.0.200

ADMIN_PASSWORD=devstack
MYSQL_PASSWORD=$ADMIN_PASSWORD
RABBIT_PASSWORD=$ADMIN_PASSWORD
SERVICE_PASSWORD=$ADMIN_PASSWORD
SERVICE_TOKEN=$ADMIN_PASSWORD

BRANCH=stable/queens
#BRANCH=master

############################################################
# Customize the following section based on your installation
############################################################

# Neutron ML2 with OpenVSwitch
Q_PLUGIN=ml2
Q_AGENT=openvswitch

enable_plugin tricircle https://github.com/openstack/tricircle/ $BRANCH

# enable_service n-novnc
# enable_service n-cauth
# disable_service tempest

# Disable security groups
Q_USE_SECGROUP=False
LIBVIRT_FIREWALL_DRIVER=nova.virt.firewall.NoopFirewallDriver

geb@ubuntu-devstack-test:~/devstack$
geb@ubuntu-devstack-test:~/devstack$ source ~/devstack/openrc admin admin
WARNING: setting legacy OS_TENANT_NAME to support cli tools.
geb@ubuntu-devstack-test:~/devstack$ unset OS_REGION_NAME
geb@ubuntu-devstack-test:~/devstack$
geb@ubuntu-devstack-test:~/devstack$ openstack multiregion networking pod create --region-name CentralRegion
+-------------+--------------------------------------+
| Field | Value |
+-------------+--------------------------------------+
| az_name | |
| dc_name | |
| pod_az_name | |
| pod_id | 8c3f4777-f983-4c12-a4a6-a0294c19045d |
| region_name | CentralRegion |
+-------------+--------------------------------------+
geb@ubuntu-devstack-test:~/devstack$ openstack multiregion networking pod create --region-name RegionOne --availability-zone az1
+-------------+--------------------------------------+
| Field | Value |
+-------------+--------------------------------------+
| az_name | az1 |
| dc_name | |
| pod_az_name | |
| pod_id | d9405dec-9f96-4aac-b5e2-d8ed3032683c |
| region_name | RegionOne |
+-------------+--------------------------------------+
geb@ubuntu-devstack-test:~/devstack$
geb@ubuntu-devstack-test:~/devstack$ neutron --os-region-name=CentralRegion net-create net0 --availability-zone-hint RegionOne
neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead.
Created a new network:
+---------------------------+--------------------------------------+
| Field | Value |
+---------------------------+--------------------------------------+
| admin_state_up | True |
| availability_zone_hints | RegionOne |
| id | c1d574e8-34bc-4dc0-a3c3-e4a34dfbfd82 |
| name | net0 |
| project_id | 7356729e64dc4e19a9e63f6138ad9fed |
| provider:network_type | vxlan |
| provider:physical_network | |
| provider:segmentation_id | 1040 |
| router:external | False |
| shared | False |
| status | ACTIVE |
| subnets | |
| tags | |
| tenant_id | 7356729e64dc4e19a9e63f6138ad9fed |
+---------------------------+--------------------------------------+
geb@ubuntu-devstack-test:~/devstack$ neutron --os-region-name=CentralRegion subnet-create --name subnet0 net0 10.0.0.0/24
neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead.
Created a new subnet:
+-------------------+--------------------------------------------+
| Field | Value |
+-------------------+--------------------------------------------+
| allocation_pools | {"start": "10.0.0.2", "end": "10.0.0.254"} |
| cidr | 10.0.0.0/24 |
| created_at | 2018-07-10T14:29:29Z |
| description | |
| dns_nameservers | |
| enable_dhcp | True |
| gateway_ip | 10.0.0.1 |
| host_routes | |
| id | 3c0d9239-ddc0-4230-a5ff-0f47583ce50c |
| ip_version | 4 |
| ipv6_address_mode | |
| ipv6_ra_mode | |
| name | subnet0 |
| network_id | c1d574e8-34bc-4dc0-a3c3-e4a34dfbfd82 |
| project_id | 7356729e64dc4e19a9e63f6138ad9fed |
| revision_number | 0 |
| subnetpool_id | |
| tags | |
| tenant_id | 7356729e64dc4e19a9e63f6138ad9fed |
| updated_at | 2018-07-10T14:29:29Z |
+-------------------+--------------------------------------------+
geb@ubuntu-devstack-test:~/devstack$
geb@ubuntu-devstack-test:~/devstack$ neutron --os-region-name=CentralRegion net-create net1 --availability-zone-hint RegionOne
neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead.
Created a new network:
+---------------------------+--------------------------------------+
| Field | Value |
+---------------------------+--------------------------------------+
| admin_state_up | True |
| availability_zone_hints | RegionOne |
| id | e02e4964-d42c-4910-a800-1d2b2265d0be |
| name | net1 |
| project_id | 7356729e64dc4e19a9e63f6138ad9fed |
| provider:network_type | vxlan |
| provider:physical_network | |
| provider:segmentation_id | 1096 |
| router:external | False |
| shared | False |
| status | ACTIVE |
| subnets | |
| tags | |
| tenant_id | 7356729e64dc4e19a9e63f6138ad9fed |
+---------------------------+--------------------------------------+
geb@ubuntu-devstack-test:~/devstack$ neutron --os-region-name=CentralRegion subnet-create --name subnet1 net1 10.0.1.0/24
neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead.
Created a new subnet:
+-------------------+--------------------------------------------+
| Field | Value |
+-------------------+--------------------------------------------+
| allocation_pools | {"start": "10.0.1.2", "end": "10.0.1.254"} |
| cidr | 10.0.1.0/24 |
| created_at | 2018-07-10T14:29:30Z |
| description | |
| dns_nameservers | |
| enable_dhcp | True |
| gateway_ip | 10.0.1.1 |
| host_routes | |
| id | 78e3456b-b9b5-4acd-89d9-638aa450a536 |
| ip_version | 4 |
| ipv6_address_mode | |
| ipv6_ra_mode | |
| name | subnet1 |
| network_id | e02e4964-d42c-4910-a800-1d2b2265d0be |
| project_id | 7356729e64dc4e19a9e63f6138ad9fed |
| revision_number | 0 |
| subnetpool_id | |
| tags | |
| tenant_id | 7356729e64dc4e19a9e63f6138ad9fed |
| updated_at | 2018-07-10T14:29:30Z |
+-------------------+--------------------------------------------+
geb@ubuntu-devstack-test:~/devstack$
geb@ubuntu-devstack-test:~/devstack$ neutron --os-region-name=CentralRegion net-create net2 --router:external --provider:network_type flat --provider:physical_network extern --availability-zone-hint RegionOne
neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead.
Created a new network:
+---------------------------+--------------------------------------+
| Field | Value |
+---------------------------+--------------------------------------+
| admin_state_up | True |
| availability_zone_hints | RegionOne |
| id | 40f77f33-54dc-45c9-a604-bcd47e2f9bb3 |
| name | net2 |
| project_id | 7356729e64dc4e19a9e63f6138ad9fed |
| provider:network_type | flat |
| provider:physical_network | extern |
| provider:segmentation_id | |
| router:external | True |
| shared | False |
| status | ACTIVE |
| subnets | |
| tags | |
| tenant_id | 7356729e64dc4e19a9e63f6138ad9fed |
+---------------------------+--------------------------------------+
geb@ubuntu-devstack-test:~/devstack$ neutron --os-region-name=CentralRegion subnet-create --name subnet2 net2 10.0.2.0/24
neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead.
Created a new subnet:
+-------------------+--------------------------------------------+
| Field | Value |
+-------------------+--------------------------------------------+
| allocation_pools | {"start": "10.0.2.2", "end": "10.0.2.254"} |
| cidr | 10.0.2.0/24 |
| created_at | 2018-07-10T14:29:33Z |
| description | |
| dns_nameservers | |
| enable_dhcp | True |
| gateway_ip | 10.0.2.1 |
| host_routes | |
| id | 48370b55-ecdc-43a8-84b0-a16de9b55751 |
| ip_version | 4 |
| ipv6_address_mode | |
| ipv6_ra_mode | |
| name | subnet2 |
| network_id | 40f77f33-54dc-45c9-a604-bcd47e2f9bb3 |
| project_id | 7356729e64dc4e19a9e63f6138ad9fed |
| revision_number | 0 |
| subnetpool_id | |
| tags | |
| tenant_id | 7356729e64dc4e19a9e63f6138ad9fed |
| updated_at | 2018-07-10T14:29:33Z |
+-------------------+--------------------------------------------+
geb@ubuntu-devstack-test:~/devstack$
geb@ubuntu-devstack-test:~/devstack$ neutron --os-region-name=CentralRegion net-list
neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead.
+--------------------------------------+------+----------------------------------+--------------------------------------------------+
| id | name | tenant_id | subnets |
+--------------------------------------+------+----------------------------------+--------------------------------------------------+
| 40f77f33-54dc-45c9-a604-bcd47e2f9bb3 | net2 | 7356729e64dc4e19a9e63f6138ad9fed | 48370b55-ecdc-43a8-84b0-a16de9b55751 10.0.2.0/24 |
| c1d574e8-34bc-4dc0-a3c3-e4a34dfbfd82 | net0 | 7356729e64dc4e19a9e63f6138ad9fed | 3c0d9239-ddc0-4230-a5ff-0f47583ce50c 10.0.0.0/24 |
| e02e4964-d42c-4910-a800-1d2b2265d0be | net1 | 7356729e64dc4e19a9e63f6138ad9fed | 78e3456b-b9b5-4acd-89d9-638aa450a536 10.0.1.0/24 |
+--------------------------------------+------+----------------------------------+--------------------------------------------------+
geb@ubuntu-devstack-test:~/devstack$ neutron --os-region-name=CentralRegion subnet-list
neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead.
+--------------------------------------+---------+----------------------------------+-------------+--------------------------------------------+
| id | name | tenant_id | cidr | allocation_pools |
+--------------------------------------+---------+----------------------------------+-------------+--------------------------------------------+
| 3c0d9239-ddc0-4230-a5ff-0f47583ce50c | subnet0 | 7356729e64dc4e19a9e63f6138ad9fed | 10.0.0.0/24 | {"start": "10.0.0.2", "end": "10.0.0.254"} |
| 48370b55-ecdc-43a8-84b0-a16de9b55751 | subnet2 | 7356729e64dc4e19a9e63f6138ad9fed | 10.0.2.0/24 | {"start": "10.0.2.2", "end": "10.0.2.254"} |
| 78e3456b-b9b5-4acd-89d9-638aa450a536 | subnet1 | 7356729e64dc4e19a9e63f6138ad9fed | 10.0.1.0/24 | {"start": "10.0.1.2", "end": "10.0.1.254"} |
+--------------------------------------+---------+----------------------------------+-------------+--------------------------------------------+
geb@ubuntu-devstack-test:~/devstack$
geb@ubuntu-devstack-test:~/devstack$ neutron --os-region-name=RegionOne net-list
neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead.
+--------------------------------------+--------------------------------------+----------------------------------+--------------------------------------------------+
| id | name | tenant_id | subnets |
+--------------------------------------+--------------------------------------+----------------------------------+--------------------------------------------------+
| 40f77f33-54dc-45c9-a604-bcd47e2f9bb3 | 40f77f33-54dc-45c9-a604-bcd47e2f9bb3 | 7356729e64dc4e19a9e63f6138ad9fed | 48370b55-ecdc-43a8-84b0-a16de9b55751 10.0.2.0/24 |
+--------------------------------------+--------------------------------------+----------------------------------+--------------------------------------------------+
geb@ubuntu-devstack-test:~/devstack$ neutron --os-region-name=RegionOne subnet-list
neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead.
+--------------------------------------+--------------------------------------+----------------------------------+-------------+--------------------------------------------+
| id | name | tenant_id | cidr | allocation_pools |
+--------------------------------------+--------------------------------------+----------------------------------+-------------+--------------------------------------------+
| 48370b55-ecdc-43a8-84b0-a16de9b55751 | 48370b55-ecdc-43a8-84b0-a16de9b55751 | 7356729e64dc4e19a9e63f6138ad9fed | 10.0.2.0/24 | {"start": "10.0.2.2", "end": "10.0.2.254"} |
+--------------------------------------+--------------------------------------+----------------------------------+-------------+--------------------------------------------+
geb@ubuntu-devstack-test:~/devstack$ nova --os-region-name=RegionOne boot --flavor 1 --image cirros-0.3.5-x86_64-disk --nic net-id=c1d574e8-34bc-4dc0-a3c3-e4a34dfbfd82 vm1
+--------------------------------------+-----------------------------------------------------------------+
| Property | Value |
+--------------------------------------+-----------------------------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | |
| OS-EXT-SRV-ATTR:host | - |
| OS-EXT-SRV-ATTR:hostname | vm1 |
| OS-EXT-SRV-ATTR:hypervisor_hostname | - |
| OS-EXT-SRV-ATTR:instance_name | |
| OS-EXT-SRV-ATTR:kernel_id | |
| OS-EXT-SRV-ATTR:launch_index | 0 |
| OS-EXT-SRV-ATTR:ramdisk_id | |
| OS-EXT-SRV-ATTR:reservation_id | r-28k92yf0 |
| OS-EXT-SRV-ATTR:root_device_name | - |
| OS-EXT-SRV-ATTR:user_data | - |
| OS-EXT-STS:power_state | 0 |
| OS-EXT-STS:task_state | scheduling |
| OS-EXT-STS:vm_state | building |
| OS-SRV-USG:launched_at | - |
| OS-SRV-USG:terminated_at | - |
| accessIPv4 | |
| accessIPv6 | |
| adminPass | aJrrsNok4JRF |
| config_drive | |
| created | 2018-07-10T14:30:38Z |
| description | - |
| flavor:disk | 1 |
| flavor:ephemeral | 0 |
| flavor:extra_specs | {} |
| flavor:original_name | m1.tiny |
| flavor:ram | 512 |
| flavor:swap | 0 |
| flavor:vcpus | 1 |
| hostId | |
| host_status | |
| id | 779e1f92-575f-4f2c-9383-d9f9067074b0 |
| image | cirros-0.3.5-x86_64-disk (0886a9e4-8ff8-4830-8f31-045a151bc3c0) |
| key_name | - |
| locked | False |
| metadata | {} |
| name | vm1 |
| os-extended-volumes:volumes_attached | [] |
| progress | 0 |
| security_groups | default |
| status | BUILD |
| tags | [] |
| tenant_id | 7356729e64dc4e19a9e63f6138ad9fed |
| updated | 2018-07-10T14:30:38Z |
| user_id | 3dbbc64227fd4484a06122b658c05d61 |
+--------------------------------------+-----------------------------------------------------------------+
geb@ubuntu-devstack-test:~/devstack$ neutron --os-region-name=RegionOne net-list
neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead.
+--------------------------------------+--------------------------------------+----------------------------------+--------------------------------------------------+
| id | name | tenant_id | subnets |
+--------------------------------------+--------------------------------------+----------------------------------+--------------------------------------------------+
| 40f77f33-54dc-45c9-a604-bcd47e2f9bb3 | 40f77f33-54dc-45c9-a604-bcd47e2f9bb3 | 7356729e64dc4e19a9e63f6138ad9fed | 48370b55-ecdc-43a8-84b0-a16de9b55751 10.0.2.0/24 |
| c1d574e8-34bc-4dc0-a3c3-e4a34dfbfd82 | net0 | 7356729e64dc4e19a9e63f6138ad9fed | 3c0d9239-ddc0-4230-a5ff-0f47583ce50c 10.0.0.0/24 |
+--------------------------------------+--------------------------------------+----------------------------------+--------------------------------------------------+
geb@ubuntu-devstack-test:~/devstack$ neutron --os-region-name=RegionOne subnet-list
neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead.
+--------------------------------------+--------------------------------------+----------------------------------+-------------+--------------------------------------------+
| id | name | tenant_id | cidr | allocation_pools |
+--------------------------------------+--------------------------------------+----------------------------------+-------------+--------------------------------------------+
| 3c0d9239-ddc0-4230-a5ff-0f47583ce50c | subnet0 | 7356729e64dc4e19a9e63f6138ad9fed | 10.0.0.0/24 | {"start": "10.0.0.1", "end": "10.0.0.2"} |
| | | | | {"start": "10.0.0.4", "end": "10.0.0.254"} |
| 48370b55-ecdc-43a8-84b0-a16de9b55751 | 48370b55-ecdc-43a8-84b0-a16de9b55751 | 7356729e64dc4e19a9e63f6138ad9fed | 10.0.2.0/24 | {"start": "10.0.2.2", "end": "10.0.2.254"} |
+--------------------------------------+--------------------------------------+----------------------------------+-------------+--------------------------------------------+
geb@ubuntu-devstack-test:~/devstack$ neutron --os-region-name=RegionOne net-show e02e4964-d42c-4910-a800-1d2b2265d0be
neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead.
+---------------------------+--------------------------------------+
| Field | Value |
+---------------------------+--------------------------------------+
| admin_state_up | True |
| availability_zone_hints | |
| availability_zones | nova |
| created_at | 2018-07-10T14:31:02Z |
| description | |
| id | e02e4964-d42c-4910-a800-1d2b2265d0be |
| ipv4_address_scope | |
| ipv6_address_scope | |
| mtu | 1450 |
| name | net1 |
| port_security_enabled | True |
| project_id | 7356729e64dc4e19a9e63f6138ad9fed |
| provider:network_type | vxlan |
| provider:physical_network | |
| provider:segmentation_id | 1096 |
| revision_number | 2 |
| router:external | False |
| shared | False |
| status | ACTIVE |
| subnets | 78e3456b-b9b5-4acd-89d9-638aa450a536 |
| tags | |
| tenant_id | 7356729e64dc4e19a9e63f6138ad9fed |
| updated_at | 2018-07-10T14:31:02Z |
+---------------------------+--------------------------------------+
geb@ubuntu-devstack-test:~/devstack$ neutron --os-region-name=RegionOne subnet-show 78e3456b-b9b5-4acd-89d9-638aa450a536
neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead.
+-------------------+--------------------------------------------+
| Field | Value |
+-------------------+--------------------------------------------+
| allocation_pools | {"start": "10.0.1.4", "end": "10.0.1.254"} |
| | {"start": "10.0.1.1", "end": "10.0.1.2"} |
| cidr | 10.0.1.0/24 |
| created_at | 2018-07-10T14:31:02Z |
| description | |
| dns_nameservers | |
| enable_dhcp | True |
| gateway_ip | 10.0.1.3 |
| host_routes | |
| id | 78e3456b-b9b5-4acd-89d9-638aa450a536 |
| ip_version | 4 |
| ipv6_address_mode | |
| ipv6_ra_mode | |
| name | subnet1 |
| network_id | e02e4964-d42c-4910-a800-1d2b2265d0be |
| project_id | 7356729e64dc4e19a9e63f6138ad9fed |
| revision_number | 0 |
| service_types | |
| subnetpool_id | |
| tags | |
| tenant_id | 7356729e64dc4e19a9e63f6138ad9fed |
| updated_at | 2018-07-10T14:31:02Z |
+-------------------+--------------------------------------------+
geb@ubuntu-devstack-test:~/devstack$ neutron --os-region-name=RegionOne net-list
neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead.
+--------------------------------------+--------------------------------------+----------------------------------+--------------------------------------------------+
| id | name | tenant_id | subnets |
+--------------------------------------+--------------------------------------+----------------------------------+--------------------------------------------------+
| 40f77f33-54dc-45c9-a604-bcd47e2f9bb3 | 40f77f33-54dc-45c9-a604-bcd47e2f9bb3 | 7356729e64dc4e19a9e63f6138ad9fed | 48370b55-ecdc-43a8-84b0-a16de9b55751 10.0.2.0/24 |
| c1d574e8-34bc-4dc0-a3c3-e4a34dfbfd82 | net0 | 7356729e64dc4e19a9e63f6138ad9fed | 3c0d9239-ddc0-4230-a5ff-0f47583ce50c 10.0.0.0/24 |
| e02e4964-d42c-4910-a800-1d2b2265d0be | net1 | 7356729e64dc4e19a9e63f6138ad9fed | 78e3456b-b9b5-4acd-89d9-638aa450a536 10.0.1.0/24 |
+--------------------------------------+--------------------------------------+----------------------------------+--------------------------------------------------+
geb@ubuntu-devstack-test:~/devstack$ neutron --os-region-name=RegionOne subnet-list
neutron CLI is deprecated and will be removed in the future. Use openstack CLI instead.
+--------------------------------------+--------------------------------------+----------------------------------+-------------+--------------------------------------------+
| id | name | tenant_id | cidr | allocation_pools |
+--------------------------------------+--------------------------------------+----------------------------------+-------------+--------------------------------------------+
| 3c0d9239-ddc0-4230-a5ff-0f47583ce50c | subnet0 | 7356729e64dc4e19a9e63f6138ad9fed | 10.0.0.0/24 | {"start": "10.0.0.4", "end": "10.0.0.254"} |
| | | | | {"start": "10.0.0.1", "end": "10.0.0.2"} |
| 48370b55-ecdc-43a8-84b0-a16de9b55751 | 48370b55-ecdc-43a8-84b0-a16de9b55751 | 7356729e64dc4e19a9e63f6138ad9fed | 10.0.2.0/24 | {"start": "10.0.2.2", "end": "10.0.2.254"} |
| 78e3456b-b9b5-4acd-89d9-638aa450a536 | subnet1 | 7356729e64dc4e19a9e63f6138ad9fed | 10.0.1.0/24 | {"start": "10.0.1.1", "end": "10.0.1.2"} |
| | | | | {"start": "10.0.1.4", "end": "10.0.1.254"} |
+--------------------------------------+--------------------------------------+----------------------------------+-------------+--------------------------------------------+

-- snip ---