Allow for increasing fluentd's request_timeout for elasticsearch requests

Bug #1896611 reported by Krzysztof Klimonda
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kolla-ansible
Fix Released
Wishlist
Krzysztof Klimonda
Victoria
In Progress
Wishlist
Krzysztof Klimonda

Bug Description

By default fluentd will timeout elasticsearch queries after 5 seconds, which may not be enough time for ES to process the request.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (master)

Fix proposed to branch: master
Review: https://review.opendev.org/753292

Changed in kolla-ansible:
assignee: nobody → Krzysztof Klimonda (kklimonda)
status: New → In Progress
Mark Goddard (mgoddard)
Changed in kolla-ansible:
importance: Undecided → Wishlist
Mark Goddard (mgoddard)
Changed in kolla-ansible:
milestone: 11.0.0 → none
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on kolla-ansible (master)

Change abandoned by "Radosław Piliszek <email address hidden>" on branch: master
Review: https://review.opendev.org/c/openstack/kolla-ansible/+/753292
Reason: goes in via https://review.opendev.org/c/openstack/kolla-ansible/+/851410

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (master)

Reviewed: https://review.opendev.org/c/openstack/kolla-ansible/+/851410
Committed: https://opendev.org/openstack/kolla-ansible/commit/ffb4767c05050b2078b56fea69d8f1c2d2182aff
Submitter: "Zuul (22348)"
Branch: master

commit ffb4767c05050b2078b56fea69d8f1c2d2182aff
Author: Stig Telfer <email address hidden>
Date: Thu Jul 28 14:54:12 2022 +0100

    Increase the Fluentd request timeout for ES

    Fluentd has a default timeout of 5s for flushing data to ElasticSearch.
    If there is a significant backlog of unsent log messages, this timeout
    can be exceeded, resulting in Fluentd failing to make further progress.

    Raise the default timeout to 60s.

    This patch adopts the configuration parameters previously proposed by
    Krzysztof Klimonda.

    Closes-Bug: #1983031
    Closes-Bug: #1896611
    Change-Id: I1aaab654a5a0752fccef2cfb8cc0bde4a0ee2562

Changed in kolla-ansible:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (stable/yoga)

Fix proposed to branch: stable/yoga
Review: https://review.opendev.org/c/openstack/kolla-ansible/+/857052

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (stable/xena)

Fix proposed to branch: stable/xena
Review: https://review.opendev.org/c/openstack/kolla-ansible/+/857053

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (stable/wallaby)

Fix proposed to branch: stable/wallaby
Review: https://review.opendev.org/c/openstack/kolla-ansible/+/857054

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (stable/wallaby)

Reviewed: https://review.opendev.org/c/openstack/kolla-ansible/+/857054
Committed: https://opendev.org/openstack/kolla-ansible/commit/bf85b5be3f27ea71639dabfe1ff888ecc6ef86b7
Submitter: "Zuul (22348)"
Branch: stable/wallaby

commit bf85b5be3f27ea71639dabfe1ff888ecc6ef86b7
Author: Stig Telfer <email address hidden>
Date: Thu Jul 28 14:54:12 2022 +0100

    Increase the Fluentd request timeout for ES

    Fluentd has a default timeout of 5s for flushing data to ElasticSearch.
    If there is a significant backlog of unsent log messages, this timeout
    can be exceeded, resulting in Fluentd failing to make further progress.

    Raise the default timeout to 60s.

    This patch adopts the configuration parameters previously proposed by
    Krzysztof Klimonda.

    Closes-Bug: #1983031
    Closes-Bug: #1896611
    Change-Id: I1aaab654a5a0752fccef2cfb8cc0bde4a0ee2562
    (cherry picked from commit ffb4767c05050b2078b56fea69d8f1c2d2182aff)

tags: added: in-stable-wallaby
tags: added: in-stable-yoga
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (stable/yoga)

Reviewed: https://review.opendev.org/c/openstack/kolla-ansible/+/857052
Committed: https://opendev.org/openstack/kolla-ansible/commit/0c746f1cbbdd0a1ae031baad9a33abf4360d589c
Submitter: "Zuul (22348)"
Branch: stable/yoga

commit 0c746f1cbbdd0a1ae031baad9a33abf4360d589c
Author: Stig Telfer <email address hidden>
Date: Thu Jul 28 14:54:12 2022 +0100

    Increase the Fluentd request timeout for ES

    Fluentd has a default timeout of 5s for flushing data to ElasticSearch.
    If there is a significant backlog of unsent log messages, this timeout
    can be exceeded, resulting in Fluentd failing to make further progress.

    Raise the default timeout to 60s.

    This patch adopts the configuration parameters previously proposed by
    Krzysztof Klimonda.

    Closes-Bug: #1983031
    Closes-Bug: #1896611
    Change-Id: I1aaab654a5a0752fccef2cfb8cc0bde4a0ee2562
    (cherry picked from commit ffb4767c05050b2078b56fea69d8f1c2d2182aff)

tags: added: in-stable-xena
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (stable/xena)

Reviewed: https://review.opendev.org/c/openstack/kolla-ansible/+/857053
Committed: https://opendev.org/openstack/kolla-ansible/commit/0e1ae5c343afaa6e3a7e2d4ba42341208906ada6
Submitter: "Zuul (22348)"
Branch: stable/xena

commit 0e1ae5c343afaa6e3a7e2d4ba42341208906ada6
Author: Stig Telfer <email address hidden>
Date: Thu Jul 28 14:54:12 2022 +0100

    Increase the Fluentd request timeout for ES

    Fluentd has a default timeout of 5s for flushing data to ElasticSearch.
    If there is a significant backlog of unsent log messages, this timeout
    can be exceeded, resulting in Fluentd failing to make further progress.

    Raise the default timeout to 60s.

    This patch adopts the configuration parameters previously proposed by
    Krzysztof Klimonda.

    Closes-Bug: #1983031
    Closes-Bug: #1896611
    Change-Id: I1aaab654a5a0752fccef2cfb8cc0bde4a0ee2562
    (cherry picked from commit ffb4767c05050b2078b56fea69d8f1c2d2182aff)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 12.8.0

This issue was fixed in the openstack/kolla-ansible 12.8.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 13.5.0

This issue was fixed in the openstack/kolla-ansible 13.5.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 14.5.0

This issue was fixed in the openstack/kolla-ansible 14.5.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 15.0.0.0rc1

This issue was fixed in the openstack/kolla-ansible 15.0.0.0rc1 release candidate.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.