[2.5, CI] MAAS takes too long to start-up causing failures

Bug #1789315 reported by Andres Rodriguez
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
MAAS
Fix Released
Critical
Blake Rouse

Bug Description

MAAS takes too long to start up that's causing failures to perform operations against the API. This test fails after about 5 minutes on it supposed to be working:

======================================================================
FAIL: maas-integration.TestMAASIntegration.test_set_http_proxy
----------------------------------------------------------------------
testtools.testresult.real._StringException: Empty attachments:
  stderr for maas maas ['maas', 'set-config', 'name=http_proxy', 'value=http://162.213.35.104:3128']

retcode for maas maas ['maas', 'set-config', 'name=http_proxy', 'value=http://xxxx:xxx']: {{{2}}}
stdout for maas maas ['maas', 'set-config', 'name=http_proxy', 'value=http://xxxx:xxx']: {{{
<html>
  <head><title>503 - MAAS is starting</title></head>
  <body>
    <h1>MAAS is starting</h1>
    <p>Please try again in a few seconds.</p>
  </body>
</html>
}}}

Traceback (most recent call last):
  File "/tmp/autopkgtest.GMSESi/build.3sF/real-tree/debian/tests/common.py", line 666, in test_set_http_proxy
    self.assertThat(output, Contains("OK"))
  File "/usr/lib/python3/dist-packages/testtools/testcase.py", line 498, in assertThat
    raise mismatch_error
testtools.matchers._impl.MismatchError: 'OK' not in '\n<html>\n <head><title>503 - MAAS is starting</title></head>\n <body>\n <h1>MAAS is starting</h1>\n <p>Please try again in a few seconds.</p>\n </body>\n</html>\n'

Tags: sprint track

Related branches

Changed in maas:
importance: Undecided → Critical
milestone: none → 2.5.0beta1
status: New → Triaged
summary: - [2.5] MAAS takes too long to start-up causing failures
+ [2.5, CI] MAAS takes too long to start-up causing failures
tags: added: track
Revision history for this message
Blake Rouse (blake-rouse) wrote :

It is also possible that a worker crashed, so the master started another worker. The worker was not ready for your request.

Either way we need to look into this. We should potentially not even open the socket on the worker until its ready to handle requests.

Changed in maas:
assignee: nobody → Blake Rouse (blake-rouse)
Changed in maas:
status: Triaged → In Progress
Changed in maas:
status: In Progress → Fix Committed
Revision history for this message
Andres Rodriguez (andreserl) wrote :

re-opening this one as the branch was reverted so we need to address this one later.

Changed in maas:
status: Fix Committed → Triaged
milestone: 2.5.0beta1 → 2.5.0beta2
tags: added: sprint
Changed in maas:
status: Triaged → In Progress
Changed in maas:
status: In Progress → Fix Committed
Changed in maas:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.