[Bug 1885430] Update Released
Chris MacNaughton
1885430 at bugs.launchpad.net
Mon Apr 26 13:34:02 UTC 2021
The verification of the Stable Release Update for ceilometer has
completed successfully and the package has now been released to
-updates. In the event that you encounter a regression using the package
from -updates please report a new bug using ubuntu-bug and tag the bug
report regression-update so we can easily find any regressions.
--
You received this bug notification because you are a member of Ubuntu
OpenStack, which is subscribed to Ubuntu Cloud Archive.
https://bugs.launchpad.net/bugs/1885430
Title:
[Bionic/Stein] Ceilometer-agent fails to collect metrics after restart
Status in OpenStack ceilometer-agent charm:
Confirmed
Status in Ubuntu Cloud Archive:
Fix Committed
Status in Ubuntu Cloud Archive stein series:
Fix Released
Status in Ubuntu Cloud Archive train series:
Fix Released
Status in Ubuntu Cloud Archive ussuri series:
Fix Released
Status in Ubuntu Cloud Archive victoria series:
Fix Released
Status in ceilometer package in Ubuntu:
Fix Released
Status in ceilometer source package in Focal:
Fix Released
Status in ceilometer source package in Groovy:
Fix Released
Status in ceilometer source package in Hirsute:
Fix Released
Bug description:
Bionic/Stein - stable 20.05 charms
Juju 2.7.6
I am aware of: https://bugs.launchpad.net/charm-ceilometer-agent/+bug/1850846
Decided to open a new bug since there was no activity on the previous one and it expired.
After rebooting my cloud (rack-by-rack), I got into a situation where
I could not collect memory.usage from VMs anymore.
Looking into: openstack metric resource --type instance <ID>
I could not see memory.usage there.
Access to ceilometer-agent and I could see the services were on active/running status, but following log was present:
Jun 27 22:34:09 sgdemr0114bp033 ceilometer-agent-compute[2244]: Deprecated: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Jun 27 22:34:09 sgdemr0114bp033 ceilometer-agent-compute[2244]: libvirt: XML-RPC error : Failed to connect socket to '/var/run/libvirt/libvirt-sock-ro': No such file or directory
Jun 27 22:34:09 sgdemr0114bp033 ceilometer-agent-compute[2244]: message repeated 33 times: [ libvirt: XML-RPC error : Failed to connect socket to '/var/run/libvirt/libvirt-sock-ro': No such file or directory]
stat on that /var/run file shows me:
stat /var/run/libvirt/libvirt-sock-ro
File: /var/run/libvirt/libvirt-sock-ro
Size: 0 Blocks: 0 IO Block: 4096 socket
Device: 17h/23d Inode: 1289 Links: 1
Access: (0777/srwxrwxrwx) Uid: ( 0/ root) Gid: ( 118/ libvirt)
Access: 2020-06-28 14:28:47.292838669 +0000
Modify: 2020-06-27 22:34:11.010520529 +0000
Change: 2020-06-27 22:34:11.010520529 +0000
Birth: -
So, I guess there is a race-condition here, where libvirt is opening the socket after ceilometer-agent-compute tried to reach out for it; which gives up and stop working.
Restarting it restores memory.usage back to normal.
However, I still cannot see all the metrics as shown in:
https://bugzilla.redhat.com/show_bug.cgi?id=1437927
To manage notifications about this bug go to:
https://bugs.launchpad.net/charm-ceilometer-agent/+bug/1885430/+subscriptions
More information about the Ubuntu-openstack-bugs
mailing list