sql backends have issues with multiple workers

Bug #1305332 reported by gordon chung
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Ceilometer
Fix Released
Medium
gordon chung

Bug Description

when enabling multiple workers against sql backend, we face occasional time out issues due to sessions taking too long to write[1].

currently, the writes to populate normalised tables (user, project, resources) take too long to commit so subsequent writes are waiting for the values to commit (they've been flushed but not commited)

this can be resolved by committing more frequently instead of a large batch or by dropping normalised tables.

this bug is related to bug #1257908. fixing one will probably fix the other.

[1] http://logs.openstack.org/42/83842/2/check/check-tempest-dsvm-full/2587cd0/logs/screen-ceilometer-collector.txt.gz?level=TRACE

gordon chung (chungg)
Changed in ceilometer:
assignee: nobody → gordon chung (chungg)
milestone: none → juno-1
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to ceilometer (master)

Fix proposed to branch: master
Review: https://review.openstack.org/94483

Changed in ceilometer:
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to ceilometer (master)

Reviewed: https://review.openstack.org/94483
Committed: https://git.openstack.org/cgit/openstack/ceilometer/commit/?id=ac26db7cfa42f751be63a406056f4ed3e828f56d
Submitter: Jenkins
Branch: master

commit ac26db7cfa42f751be63a406056f4ed3e828f56d
Author: Gordon Chung <email address hidden>
Date: Tue May 20 17:48:46 2014 -0400

    refactor sql backend to improve write speed

    - drop sourceassoc table as its data is not accessible via api
    - drop resource table since data can be retreive from sample table

    Change-Id: I2d4a5175734cafce6a439ad736c47691e6e7e847
    Implements: blueprint big-data-sql
    Closes-Bug: #1305332
    Closes-Bug: #1257908

Changed in ceilometer:
status: In Progress → Fix Committed
Thierry Carrez (ttx)
Changed in ceilometer:
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in ceilometer:
milestone: juno-1 → 2014.2
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.