ceilometer compute cannot collection memory.usage meter for all vm in one compute node
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Ceilometer |
In Progress
|
Undecided
|
xiexianbin | ||
Ubuntu Cloud Archive |
Fix Released
|
Undecided
|
Unassigned | ||
Queens |
Incomplete
|
Low
|
Unassigned | ||
libvirt (Ubuntu) |
Fix Released
|
Undecided
|
Unassigned | ||
Bionic |
Incomplete
|
Low
|
Unassigned |
Bug Description
when shutdown vm which long time, the libvirt while
raise libvirtError: Timed out during operation: cannot
acquire state change lock (held by
remoteDispatchD
the Physics host can not get memory.usage meter anymore!
2018-05-03 07:57:02.211 82162 ERROR ceilometer.
2018-05-03 07:57:32.474 82162 ERROR ceilometer.
2018-05-03 07:57:32.474 82162 ERROR ceilometer.
2018-05-03 07:57:32.474 82162 ERROR ceilometer.
2018-05-03 07:57:32.474 82162 ERROR ceilometer.
2018-05-03 07:57:32.474 82162 ERROR ceilometer.
2018-05-03 07:57:32.474 82162 ERROR ceilometer.
2018-05-03 07:57:32.474 82162 ERROR ceilometer.
2018-05-03 07:57:32.474 82162 ERROR ceilometer.
2018-05-03 07:57:32.474 82162 ERROR ceilometer.
2018-05-03 07:57:32.474 82162 ERROR ceilometer.
2018-05-03 07:57:32.474 82162 ERROR ceilometer.
2018-05-03 07:57:32.474 82162 ERROR ceilometer.
2018-05-03 07:57:35.142 82162 ERROR ceilometer.
2018-05-03 07:58:34.602 82162 WARNING ceilometer.
2018-05-03 07:58:34.606 82162 ERROR ceilometer.
Changed in ceilometer: | |
status: | New → In Progress |
Changed in ceilometer: | |
assignee: | nobody → xiexianbin (xianbin) |
Changed in cloud-archive: | |
status: | New → Fix Released |
Seems to be a related bug in libvirt:
https:/ /bugzilla. redhat. com/show_ bug.cgi? id=1530346
My own data:
lsb_release -d
Description: Ubuntu 18.04.3 LTS
libvirtd -v --version
libvirtd (libvirt) 4.0.0
virsh list ------- ------- ------- ------- ------- ------- ---
Id Name State
-------
8 … running
virsh shutdown 8 omainSuspend)
error: Failed to shutdown domain 8
error: Timed out during operation: cannot acquire state change lock (held by remoteDispatchD
Excerpts from the bug at https:/ /bugzilla. redhat. com/show_ bug.cgi? id=1530346 :
"I am able to reproduce with [libvirt] 3.7.0 but unable to reproduce with current master (v4.2.0- 457-gda613819e9 ). … I'm running bisect now to see which commit fixed this."
"My bisect points at this commit 72adaf2f10509c3 682f2c65ffad417 6e00e5a2fb (v4.1.0-rc1~337) which is supposed to fix this bug 1536461 which follows my investigation and suspicion. So basically, 4.1.0 is fixed, the problematic commit that introduced the bug is v3.4.0-rc1~119."
Libvirt git for your convenience: https:/ /libvirt. org/git/ ?p=libvirt. git