max_pool_size is not dynamically allocated by the number of workers

Bug #1403138 reported by Nobuto Murata
12
This bug affects 2 people
Affects Status Importance Assigned to Milestone
nova-cloud-controller (Juju Charms Collection)
Fix Released
Low
Edward Hope-Morley

Bug Description

database.max_pool_size is not set for nova.conf by nova-cloud-controller charm. Therefore I can see "Remote error: TimeoutError QueuePool limit of size 5 overflow 10 reached, connection timed out" on nova-compute side.

It would be nice if the charm puts dynamically calculated max_pool_size for nova by the number of workers like neutron-api charm for neutron.
http://bazaar.launchpad.net/~openstack-charmers/charms/trusty/neutron-api/trunk/view/head:/templates/parts/section-database

Tags: openstack cts

Related branches

Nobuto Murata (nobuto)
tags: added: cts
Felipe Reyes (freyes)
tags: added: openstack
Revision history for this message
Edward Hope-Morley (hopem) wrote :

Nobuto, the nova-cloud-controller charm has a config option "neutron-alchemy-flags" that can be used to set arbitrary sqlalchemy config values. Having this value set dynamically might be nice but for now you should at least be able to set this parameter manually.

Revision history for this message
Nobuto Murata (nobuto) wrote : Re: [Bug 1403138] Re: max_pool_size is not dynamically allocated by the number of workers

Hi Edward,

> Nobuto, the nova-cloud-controller charm has a config option "neutron-
> alchemy-flags" that can be used to set arbitrary sqlalchemy config
> values. Having this value set dynamically might be nice but for now you
> should at least be able to set this parameter manually.

I know "neutron-alchemy-flags". But this time I mean alchemy settings for
*nova*. There is no way for it at this moment as far as I know.

Revision history for this message
Edward Hope-Morley (hopem) wrote :

Ah yes indeed, sorry. So we should add a 'nova-alchemy-flags' to allow sqlalchemy config options to be set for Nova as well. I'll get that queued up.

Changed in nova-cloud-controller (Juju Charms Collection):
status: New → Confirmed
importance: Undecided → Low
assignee: nobody → Edward Hope-Morley (hopem)
Changed in nova-cloud-controller (Juju Charms Collection):
status: Confirmed → In Progress
Revision history for this message
Nobuto Murata (nobuto) wrote :

@Edward,

I still prefer dynamic max_pool_size instead of *-alchemy-flags. Now that neutron-api charm is there, neutron-alchemy-flags is no longer used since no neutron service is running on nova-cloud-controller node. Besides, assuming the situation to adjust worker-multiplier, we need to tweak two configs(worker-multiplier and nova-alchemy-flags) at the same time if we adopt nova-alchemy-flags approach. Instead, max_pool_size={{ workers * X }} in nova [database] template makes our life easy like neutron-api charm, IMHO.

Revision history for this message
Edward Hope-Morley (hopem) wrote :

Nobuto, a *-alchemy-flags option is provided to allow any of the options in https://github.com/openstack/oslo.db/blob/master/oslo_db/options.py (when available in respective project) to be modified/set. Therefore I think it still make sense to add a nova-alchemy-flags option. What we could also do is if no nova-alchemy-flags are provided we could have max_pool_size set to num_cpu_cores * worker-multiplier by default. Would that work for you? That way you get your optimised default and you also get the option to override it.

Revision history for this message
Nobuto Murata (nobuto) wrote :

Yes, easy dynamic max_pool_size + expert mode with *-alchemy-flags sounds good to me.
When I requested a way to customize alchemy flags for neutron (maybe a year ago?), I thought some flags in addition to max_pool_size were needed. In the end, I realized just setting max_pool_size sufficed most of the cases.

Revision history for this message
Edward Hope-Morley (hopem) wrote :

Ok thanks, I'll get that done.

Changed in nova-cloud-controller (Juju Charms Collection):
status: In Progress → Fix Committed
James Page (james-page)
Changed in nova-cloud-controller (Juju Charms Collection):
milestone: none → 15.01
James Page (james-page)
Changed in nova-cloud-controller (Juju Charms Collection):
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.