OpenStack Identity (keystone)

IdentityError in TokensV3TestJSON.test_rescope_token

Bug #1351026 reported by Davanum Srinivas (DIMS)
48
This bug affects 11 people
Affects Status Importance Assigned to Milestone
OpenStack Identity (keystone)
Fix Released
Undecided
Brant Knudson
tempest
Fix Released
Undecided
Christopher Yeoh

Bug Description

2014-07-31 19:07:29.894 | tempest.api.identity.admin.v3.test_tokens.TokensV3TestJSON.test_rescope_token[gate]
2014-07-31 19:07:29.894 | -----------------------------------------------------------------------------------
2014-07-31 19:07:29.895 |
2014-07-31 19:07:29.895 | Captured traceback:
2014-07-31 19:07:29.895 | ~~~~~~~~~~~~~~~~~~~
2014-07-31 19:07:29.895 | Traceback (most recent call last):
2014-07-31 19:07:29.895 | File "tempest/api/identity/admin/v3/test_tokens.py", line 145, in test_rescope_token
2014-07-31 19:07:29.895 | domain='Default')
2014-07-31 19:07:29.895 | File "tempest/services/identity/v3/json/identity_client.py", line 587, in auth
2014-07-31 19:07:29.895 | resp, body = self.post(self.auth_url, body=body)
2014-07-31 19:07:29.895 | File "tempest/common/rest_client.py", line 218, in post
2014-07-31 19:07:29.895 | return self.request('POST', url, extra_headers, headers, body)
2014-07-31 19:07:29.895 | File "tempest/services/identity/v3/json/identity_client.py", line 613, in request
2014-07-31 19:07:29.895 | 'Unexpected status code {0}'.format(resp.status))
2014-07-31 19:07:29.896 | IdentityError: Got identity error
2014-07-31 19:07:29.896 | Details: Unexpected status code 404

The following logstash query has 24 hits in last 48 hours:
"IdentityError: Got identity error" AND build_name:"check-tempest-dsvm-postgres-full"

Revision history for this message
Igor Milovanović (igormilovanovic) wrote :

Full console log here: http://logs.openstack.org/11/110811/3/check/check-tempest-dsvm-postgres-full/69da923/console.html

Revision history for this message
Brant Knudson (blk-u) wrote :

I think this is essentially a duplicate of https://bugs.launchpad.net/keystone/+bug/1347961 , and is caused by

a) fixes that have gone in for revocation events
b) that 1347961 hasn't been fixed

Revision history for this message
Brant Knudson (blk-u) wrote :

Also, I'll take a look at how postgres handles revocation events. Maybe it's like MySQL or maybe it's like DB2.

Revision history for this message
Brant Knudson (blk-u) wrote :

Here's the changes that went in recently:

 https://review.openstack.org/#/c/109819/4 - Correct revocation event test for domain_id (shouldn't have any effect)
 https://review.openstack.org/#/c/109747/2 - Fix for V2 token issued_at time changing (possible culprit)
  https://review.openstack.org/#/c/109602/3 - Add tests related to V2 token issued_at time changing (probably not)

Revision history for this message
Brant Knudson (blk-u) wrote :

It's probably this one that's needed: https://review.openstack.org/#/c/109389/

Revision history for this message
Brant Knudson (blk-u) wrote :

But then I wonder why it doesn't fail all the time?

Revision history for this message
Brant Knudson (blk-u) wrote :

I proposed a revert of a4c73e4382cb062aa9f30fe1960d5014d3c49cc2 in https://review.openstack.org/#/c/111116/ so hopefully that one was the problem. Not sure how postgres tempest worked for it.

Changed in keystone:
assignee: nobody → Brant Knudson (blk-u)
Changed in tempest:
status: New → Opinion
status: Opinion → Invalid
Changed in keystone:
status: New → In Progress
Revision history for this message
Brant Knudson (blk-u) wrote :

Well, the revert failed just as badly... now I don't know what caused it.

Revision history for this message
Brant Knudson (blk-u) wrote :

I looked through the recent commits to keystone and I don't see anything obvious if it wasn't https://review.openstack.org/#/c/109389/

Revision history for this message
Brant Knudson (blk-u) wrote :

So my plan now is to remove the test and then we'll add it back in later once Keystone is fixed.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tempest (master)

Fix proposed to branch: master
Review: https://review.openstack.org/111131

Changed in tempest:
assignee: nobody → Brant Knudson (blk-u)
status: Invalid → In Progress
Revision history for this message
Brant Knudson (blk-u) wrote :

I was able to recreate this locally... still not sure how it could have worked at some point and now it doesn't work. I tried the test with this change in keytone https://review.openstack.org/#/c/109389/ and it passes now.

So once the revert is merged in tempest (https://review.openstack.org/111131 ), and https://review.openstack.org/#/c/109389/ is merged in Keystone then the revert can be reverted.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on keystone (master)

Change abandoned by Brant Knudson (<email address hidden>) on branch: master
Review: https://review.openstack.org/111116
Reason: I thought this was causing the tempest postgres issue but obviously it's not.

OpenStack Infra (hudson-openstack)
Changed in tempest:
assignee: Brant Knudson (blk-u) → Christopher Yeoh (cyeoh-0)
Revision history for this message
Matt Riedemann (mriedem) wrote :

e-r query patch: https://review.openstack.org/#/c/111115/

Abhishek Kekane (abhishek-kekane)
no longer affects: glance
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tempest (master)

Reviewed: https://review.openstack.org/111131
Committed: https://git.openstack.org/cgit/openstack/tempest/commit/?id=7eefef6125b07a44851823a02a75853937dcb377
Submitter: Jenkins
Branch: master

commit 7eefef6125b07a44851823a02a75853937dcb377
Author: Brant Knudson <email address hidden>
Date: Thu Jul 31 20:25:55 2014 -0500

    Skip test_rescope_token

    There are several problems with revocation events in Keystone and
    the test is currently failing on postgres. There's several fixes
    proposed in Keystone to fix these but until they're merged this
    test isn't working.

    Change-Id: I9182d542fae0b4a5280dc482300203f84c8f4d8c
    Closes-Bug: #1351026

Changed in tempest:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tempest (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/121575

Revision history for this message
Brant Knudson (blk-u) wrote :

this is fixed in keystone since https://review.openstack.org/#/c/109389/ is merged.

Changed in keystone:
status: In Progress → Fix Committed
Revision history for this message
Ken'ichi Ohmichi (oomichi) wrote :

 https://review.openstack.org/#/c/109389/ has fixed this problem.

Changed in keystone:
status: Fix Committed → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tempest (master)

Reviewed: https://review.openstack.org/121575
Committed: https://git.openstack.org/cgit/openstack/tempest/commit/?id=4ac02456d26d0a04c36eaf4f7af8872bea8c4c45
Submitter: Jenkins
Branch: master

commit 4ac02456d26d0a04c36eaf4f7af8872bea8c4c45
Author: Matthew Treinish <email address hidden>
Date: Mon Sep 15 10:12:34 2014 -0400

    Unskip test_rescope_token()

    test_rescope_token() was skipped because of bug 1351026 which is now
    in a state which should allow us to unskip it.

    Change-Id: Ia0fd713fea041c24f4ff1f041a48d9bac7fef6e7
    Related-Bug: #1351026

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.