Mirantis OpenStack

[Ceilometer] Transformers are not turned off by default

Bug #1537708 reported by Nadya Privalova
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Mirantis OpenStack
Fix Released
Critical
Nadya Privalova
Mirantis OpenStack 9.0
8.0.x
Fix Released
Critical
Nadya Privalova
Mirantis OpenStack 8.0-updates
9.x
Fix Released
Critical
Nadya Privalova
Mirantis OpenStack 9.0

Bug Description

In Liberty, we need to start notification agents more carefully.
We have several variants:

1. Start only one notification agent per cloud and support Transformer feature
2. Start several notification agents without coordination (as it is done now) and switch off Transformers support

We've chosen the second variant because:
1. one notification agent per cloud is not enough for good performance
2. Transformers work not good under high load

We will switch off transformers _by default_. If a customer wants to use it, it will be possible to do using Redis plugin which will allow to run notification agents in coordination mode.

See original description
Nadya Privalova (nprivalova)
Changed in mos:
status: New → Triaged
description: updated
Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix merged to openstack/ceilometer (openstack-ci/fuel-8.0/liberty)

Reviewed: https://review.fuel-infra.org/16294
Submitter: Pkgs Jenkins <email address hidden>
Branch: openstack-ci/fuel-8.0/liberty

Commit: 5861466ef4035cdd7f6d4dac8ebc30479637dfaa
Author: Nadya Shakhat <email address hidden>
Date: Mon Jan 25 12:16:58 2016

Remove transformers from pipeline.yaml

In Liberty we cannot run more then one notification agent in cloud
without coordination. So, we have several approaches how to
solve this problem:

1. Run one notification agent under pcs.
   pros: we keep transformers
   cons: one notification agent is not enough for big envs

2. Change config and not to gather "delta" and "util" by default
   pros: ok from performance PoV; no changes in puppet
   cons: transformer-based meters are not generated

We've chosen the second approach. If tranformers will be needed, we can
deploy our redis plugin, switch on coordination mode and add transformers
back to config.
Removed unit tests tested default pipeline.cfg, not the functionality.
That is why is is safe to remove them.

Closes-bug: #1537708
Change-Id: Ib3b21b0a967be34eda002820228aa4892d733d5d

Revision history for this message
Roman Podoliaka (rpodolyaka) wrote :

For some reason the bot didn't close the bug on merging of the commit ^

tags: added: area-ceilometer
Changed in mos:
status: Triaged → Fix Committed
Alexey Stepanov (astepanov-m)
tags: added: on-verification
Revision history for this message
Alexey Stepanov (astepanov-m) wrote :

fuel-8.0-518-2016-02-03_07-53-27.iso -> fix present.

Changed in mos:
status: Fix Committed → Fix Released
Nastya Urlapova (aurlapova)
tags: removed: on-verification
Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix proposed to openstack/ceilometer (9.0/mitaka)

Fix proposed to branch: 9.0/mitaka
Change author: Nadya Shakhat <email address hidden>
Review: https://review.fuel-infra.org/20280

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix merged to openstack/ceilometer (9.0/mitaka)

Reviewed: https://review.fuel-infra.org/20280
Submitter: Pkgs Jenkins <email address hidden>
Branch: 9.0/mitaka

Commit: 34d4701d0b56230119822fc0cefa7dda2741b5d5
Author: Nadya Shakhat <email address hidden>
Date: Fri Apr 29 13:26:18 2016

Remove transformers from pipeline.yaml

In Liberty we cannot run more then one notification agent in cloud
without coordination. So, we have several approaches how to
solve this problem:

1. Run one notification agent under pcs.
   pros: we keep transformers
   cons: one notification agent is not enough for big envs

2. Change config and not to gather "delta" and "util" by default
   pros: ok from performance PoV; no changes in puppet
   cons: transformer-based meters are not generated

We've chosen the second approach. If tranformers will be needed, we can
deploy our redis plugin, switch on coordination mode and add transformers
back to config.
Removed unit tests tested default pipeline.cfg, not the functionality.
That is why is is safe to remove them.

Closes-bug: #1537708
Change-Id: Ib3b21b0a967be34eda002820228aa4892d733d5d
(cherry picked from commit 5861466ef4035cdd7f6d4dac8ebc30479637dfaa)

Revision history for this message
Roman Podoliaka (rpodolyaka) wrote :

^ fix merged for 9.0

Revision history for this message
Artem Minasyan (aminasyan) wrote :

Verified on ISO:https://paste.mirantis.net/show/2265/

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix proposed to openstack/ceilometer (mcp/newton)

Fix proposed to branch: mcp/newton
Change author: Nadya Shakhat <email address hidden>
Review: https://review.fuel-infra.org/33184

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix proposed to openstack/ceilometer (11.0/ocata)

Fix proposed to branch: 11.0/ocata
Change author: Nadya Shakhat <email address hidden>
Review: https://review.fuel-infra.org/33771

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix proposed to openstack/ceilometer (mcp/ocata)

Fix proposed to branch: mcp/ocata
Change author: Nadya Shakhat <email address hidden>
Review: https://review.fuel-infra.org/34485

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change abandoned on openstack/ceilometer (mcp/ocata)

Change abandoned by Ilya Tyaptin <email address hidden> on branch: mcp/ocata
Review: https://review.fuel-infra.org/34485

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change restored on openstack/ceilometer (mcp/ocata)

Change restored by Ilya Tyaptin <email address hidden> on branch: mcp/ocata
Review: https://review.fuel-infra.org/34485

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change abandoned on openstack/ceilometer (11.0/ocata)

Change abandoned by Roman Podoliaka <email address hidden> on branch: 11.0/ocata
Review: https://review.fuel-infra.org/33771
Reason: we don't use 11.0/ocata anymore - mcp/ocata is the correct branch name

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix merged to openstack/ceilometer (mcp/newton)

Reviewed: https://review.fuel-infra.org/33184
Submitter: Pkgs Jenkins <email address hidden>
Branch: mcp/newton

Commit: 55d51f15f9f9edb6a69dd367858ae9d84aee3563
Author: Nadya Shakhat <email address hidden>
Date: Tue May 2 11:33:26 2017

Remove transformers from pipeline.yaml

In Liberty we cannot run more then one notification agent in cloud
without coordination. So, we have several approaches how to
solve this problem:

1. Run one notification agent under pcs.
   pros: we keep transformers
   cons: one notification agent is not enough for big envs

2. Change config and not to gather "delta" and "util" by default
   pros: ok from performance PoV; no changes in puppet
   cons: transformer-based meters are not generated

We've chosen the second approach. If tranformers will be needed, we can
deploy our redis plugin, switch on coordination mode and add transformers
back to config.
Removed unit tests tested default pipeline.cfg, not the functionality.
That is why is is safe to remove them.

Closes-bug: #1537708
Change-Id: Ib3b21b0a967be34eda002820228aa4892d733d5d
(cherry picked from commit 5861466ef4035cdd7f6d4dac8ebc30479637dfaa)

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change abandoned on openstack/ceilometer (mcp/ocata)

Change abandoned by Nadya Shakhat <email address hidden> on branch: mcp/ocata
Review: https://review.fuel-infra.org/34485
Reason: will be done as a part of reclass

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change restored on openstack/ceilometer (mcp/ocata)

Change restored by Ildar Svetlov <email address hidden> on branch: mcp/ocata
Review: https://review.fuel-infra.org/34485

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change abandoned on openstack/ceilometer (mcp/ocata)

Change abandoned by Ildar Svetlov <email address hidden> on branch: mcp/ocata
Review: https://review.fuel-infra.org/34485

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change restored on openstack/ceilometer (mcp/ocata)

Change restored by Ildar Svetlov <email address hidden> on branch: mcp/ocata
Review: https://review.fuel-infra.org/34485

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Change abandoned on openstack/ceilometer (mcp/ocata)

Change abandoned by Ildar Svetlov <email address hidden> on branch: mcp/ocata
Review: https://review.fuel-infra.org/34485

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.