Ironic

Unit tests freezing in DB class

Bug #2023316 reported by Jay Faulkner
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Ironic
Confirmed
High
Unassigned

Bug Description

We've been troubleshooting a gate issue where unit tests time out. This appears to be primarily due to tests getting "stuck", but they can complete eventually.

See discussion starting here: https://meetings.opendev.org/irclogs/%23openstack-ironic/%23openstack-ironic.2023-06-07.log.html#t2023-06-07T09:17:31 continuing through Thursday Jun 8 and beyond.

Revision history for this message
Jay Faulkner (jason-oldos) wrote :

https://review.opendev.org/c/openstack/ironic/+/885600 disables what we think is the test to blame for the failure; seeing if this provides temporary relief for CI while we troubleshoot.

Changed in ironic:
status: New → Confirmed
importance: Undecided → High
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to ironic (master)

Related fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/ironic/+/885661

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to ironic (master)

Reviewed: https://review.opendev.org/c/openstack/ironic/+/885600
Committed: https://opendev.org/openstack/ironic/commit/b4f8209b99af32d8d2a646591af9b62436aad3d8
Submitter: "Zuul (22348)"
Branch: master

commit b4f8209b99af32d8d2a646591af9b62436aad3d8
Author: Jay Faulkner <email address hidden>
Date: Thu Jun 8 10:01:35 2023 -0700

    Disabling test_upgrade_twice temporarily for CI fix

    This test has been taking an inordinate amount of time to complete. We
    should figure out the root cause and fix it, but in the meantime it only
    causes us harm to be unable to land patches.

    Related-Bug: 2023316
    Change-Id: I604369e000c80914cf0c584c9deab7245c66b1b4

Revision history for this message
Jay Faulkner (jason-oldos) wrote :

Stats show timeouts significantly down. It's possible the root cause was a transitive dependency; but we never found it. I'm reverting the previous commit and seeing if they continue to pass.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on ironic (master)

Change abandoned by "Jay Faulkner <email address hidden>" on branch: master
Review: https://review.opendev.org/c/openstack/ironic/+/885661
Reason: not useful

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.