[Bug 1839592] Re: Open vSwitch (Version 2.9.2) goes into deadlocked state
Juul Spies
1839592 at bugs.launchpad.net
Thu Nov 28 14:27:33 UTC 2019
Here a similar portion from the ovs log and gdb trace running openvswitch 2.11.0-0ubuntu2:
Thu Oct 31 18:20:23 2019-2019-10-31T17:20:23.521Z|00001|ovs_rcu(urcu4)|WARN|blocked 1000 ms waiting for revalidator124 to quiesce
Thu Oct 31 18:20:24 2019-2019-10-31T17:20:24.521Z|00002|ovs_rcu(urcu4)|WARN|blocked 2000 ms waiting for revalidator124 to quiesce
Thu Oct 31 18:20:59 2019-2019-10-31T17:20:26.520Z|00003|ovs_rcu(urcu4)|WARN|blocked 4000 ms waiting for revalidator124 to quiesce
In the trace:
29 Thread 0x7f72f97fa700 (LWP 26608) "revalidator124" 0x00007f734aee237b in futex_abstimed_wait (private=<optimized out>, abstime=0x0, expected=10, futex_word=0x5577bab397c0 <rwlock>) at ../sysdeps/unix/sysv/linux/futex-internal.h:172
Full trace attached in gdbwrap.1572542426.log.gz
The traces are a bit hocus to me, I really don't have a clue whats going
on there but I guess it might help you make sense of whats going on
here.
** Attachment added: "GDB trace ovs 2.11.0 during when it hangs"
https://bugs.launchpad.net/ubuntu/+source/openvswitch/+bug/1839592/+attachment/5308469/+files/gdbwrap.1572542426.log.gz
--
You received this bug notification because you are a member of Ubuntu
OpenStack, which is subscribed to openvswitch in Ubuntu.
https://bugs.launchpad.net/bugs/1839592
Title:
Open vSwitch (Version 2.9.2) goes into deadlocked state
Status in glibc package in Ubuntu:
Confirmed
Status in openvswitch package in Ubuntu:
Confirmed
Bug description:
Description: Ubuntu 18.04.2 LTS
Release: 18.04
root at kv02:~# apt-cache policy openvswitch-common
openvswitch-common:
Installed: 2.9.2-0ubuntu0.18.04.3
Candidate: 2.9.2-0ubuntu0.18.04.3
Version table:
*** 2.9.2-0ubuntu0.18.04.3 500
Randomly ovs-vswitchd service is locked waiting for handler thread to quiesce. Here is the log tail:
ovs-vswitchd.log:
2019-08-07T04:25:01.687Z|00101|vlog|INFO|opened log file /var/log/openvswitch/ovs-vswitchd.log
2019-08-07T08:48:23.885Z|00012|ovs_rcu(urcu5)|WARN|blocked 1000 ms waiting for revalidator127 to quiesce
2019-08-07T08:48:24.884Z|00102|ovs_rcu|WARN|blocked 1000 ms waiting for revalidator127 to quiesce
2019-08-07T08:48:24.885Z|00013|ovs_rcu(urcu5)|WARN|blocked 2000 ms waiting for revalidator127 to quiesce
2019-08-07T08:48:25.883Z|00103|ovs_rcu|WARN|blocked 2000 ms waiting for revalidator127 to quiesce
2019-08-07T08:48:26.886Z|00014|ovs_rcu(urcu5)|WARN|blocked 4001 ms waiting for revalidator127 to quiesce
2019-08-07T08:48:27.884Z|00104|ovs_rcu|WARN|blocked 4000 ms waiting for revalidator127 to quiesce
2019-08-07T08:48:30.886Z|00015|ovs_rcu(urcu5)|WARN|blocked 8001 ms waiting for revalidator127 to quiesce
2019-08-07T08:48:31.883Z|00105|ovs_rcu|WARN|blocked 8000 ms waiting for revalidator127 to quiesce
2019-08-07T08:48:38.886Z|00016|ovs_rcu(urcu5)|WARN|blocked 16001 ms waiting for revalidator127 to quiesce
2019-08-07T08:48:39.883Z|00106|ovs_rcu|WARN|blocked 16000 ms waiting for revalidator127 to quiesce
2019-08-07T08:48:54.885Z|00017|ovs_rcu(urcu5)|WARN|blocked 32000 ms waiting for revalidator127 to quiesce
2019-08-07T08:48:55.883Z|00107|ovs_rcu|WARN|blocked 32000 ms waiting for revalidator127 to quiesce
2019-08-07T08:49:26.885Z|00018|ovs_rcu(urcu5)|WARN|blocked 64000 ms waiting for revalidator127 to quiesce
2019-08-07T08:49:27.883Z|00108|ovs_rcu|WARN|blocked 64000 ms waiting for revalidator127 to quiesce
2019-08-07T08:50:30.885Z|00019|ovs_rcu(urcu5)|WARN|blocked 128000 ms waiting for revalidator127 to quiesce
2019-08-07T08:50:31.883Z|00109|ovs_rcu|WARN|blocked 128000 ms waiting for revalidator127 to quiesce
2019-08-07T08:52:38.885Z|00020|ovs_rcu(urcu5)|WARN|blocked 256000 ms waiting for revalidator127 to quiesce
This cause the commands blocks and does not generate any output.
ovs-ofctl show sw0
ovs-ofctl dump-flows sw0
Is necesary restart ovs-vswitchd service, to recover it.
Related https://github.com/openvswitch/ovs-issues/issues/153
¿You are planning updating openvswitch service to 2.9.5 version?
https://www.openvswitch.org/releases/NEWS-2.9.5.txt
Ubuntu 18.04 is stuck in 2.9.2.
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/glibc/+bug/1839592/+subscriptions
More information about the Ubuntu-openstack-bugs
mailing list