[Bug 1931275] [NEW] ovn-controller fails to start

[Giuseppe Petralia]

Public bug reported:

When using Openstack Ussuri with OVN 20.03 in Bionic and starting an
ovn-controller this sometime fails with the following:

2021-06-07T14:13:34.803Z|00001|vlog|INFO|opened log file /var/log/ovn/ovn-controller.log
2021-06-07T14:13:34.805Z|00002|reconnect|INFO|unix:/var/run/openvswitch/db.sock: connecting...
2021-06-07T14:13:34.805Z|00003|reconnect|INFO|unix:/var/run/openvswitch/db.sock: connected
2021-06-07T14:13:34.808Z|00004|main|INFO|OVS IDL reconnected, force recompute.
2021-06-07T14:13:34.810Z|00005|reconnect|INFO|ssl:10.216.241.118:6642: connecting...
2021-06-07T14:13:34.810Z|00006|main|INFO|OVNSB IDL reconnected, force recompute.
2021-06-07T14:13:34.814Z|00007|reconnect|INFO|ssl:10.216.241.118:6642: connected
2021-06-07T14:13:34.886Z|00008|ofctrl|INFO|unix:/var/run/openvswitch/br-int.mgmt: connecting to switch
2021-06-07T14:13:34.886Z|00009|rconn|INFO|unix:/var/run/openvswitch/br-int.mgmt: connecting...
2021-06-07T14:13:34.886Z|00010|rconn|INFO|unix:/var/run/openvswitch/br-int.mgmt: connected
2021-06-07T14:13:34.888Z|00011|ovsdb_idl|WARN|transaction error: {"details":"RBAC rules for client \"juju-a79b06-5-lxd-16.maas\" role \"ovn-controller\" prohibit modification of table \"Chassis\".","error":"permission error"}
2021-06-07T14:13:34.888Z|00012|main|INFO|OVNSB commit failed, force recompute next time.
2021-06-07T14:13:34.888Z|00001|pinctrl(ovn_pinctrl0)|INFO|unix:/var/run/openvswitch/br-int.mgmt: connecting to switch
2021-06-07T14:13:34.889Z|00002|rconn(ovn_pinctrl0)|INFO|unix:/var/run/openvswitch/br-int.mgmt: connecting...
2021-06-07T14:13:34.889Z|00013|ovsdb_idl|WARN|transaction error: {"details":"RBAC rules for client \"juju-a79b06-5-lxd-16.maas\" role \"ovn-controller\" prohibit modification of table \"Chassis\".","error":"permission error"}
2021-06-07T14:13:34.889Z|00014|main|INFO|OVNSB commit failed, force recompute next time.
2021-06-07T14:13:34.890Z|00003|rconn(ovn_pinctrl0)|INFO|unix:/var/run/openvswitch/br-int.mgmt: connected
2021-06-07T14:13:34.891Z|00015|ovsdb_idl|WARN|transaction error: {"details":"RBAC rules for client \"juju-a79b06-5-lxd-16.maas\" role \"ovn-controller\" prohibit modification of table \"Chassis\".","error":"permission error"}
2021-06-07T14:13:34.891Z|00016|main|INFO|OVNSB commit failed, force recompute next time.
2021-06-07T14:13:34.901Z|00017|ovsdb_idl|WARN|transaction error: {"details":"RBAC rules for client \"juju-a79b06-5-lxd-16.maas\" role \"ovn-controller\" prohibit modification of table \"Chassis\".","error":"permission error"}
2021-06-07T14:13:34.901Z|00018|main|INFO|OVNSB commit failed, force recompute next time.
2021-06-07T14:13:34.921Z|00019|ovsdb_idl|WARN|transaction error: {"details":"RBAC rules for client \"juju-a79b06-5-lxd-16.maas\" role \"ovn-controller\" prohibit modification of table \"Chassis\".","error":"permission error"}
2021-06-07T14:13:34.922Z|00020|main|INFO|OVNSB commit failed, force recompute next time.
2021-06-07T14:13:34.942Z|00021|main|INFO|OVNSB commit failed, force recompute next time.
2021-06-07T14:13:34.966Z|00022|main|INFO|OVNSB commit failed, force recompute next time.
2021-06-07T14:13:35.028Z|00023|main|INFO|OVNSB commit failed, force recompute next time.
2021-06-07T14:13:35.257Z|00024|main|INFO|OVNSB commit failed, force recompute next time.
2021-06-07T14:13:35.505Z|00025|main|INFO|OVNSB commit failed, force recompute next time.
2021-06-07T14:13:35.760Z|00026|main|INFO|OVNSB commit failed, force recompute next time.
2021-06-07T14:13:35.934Z|00027|main|INFO|OVNSB commit failed, force recompute next time.
2021-06-07T14:13:36.004Z|00028|main|INFO|OVNSB commit failed, force recompute next time.
2021-06-07T14:13:36.251Z|00029|main|INFO|OVNSB commit failed, force recompute next time.
2021-06-07T14:13:36.727Z|00030|main|INFO|OVNSB commit failed, force recompute next time.
2021-06-07T14:13:36.976Z|00031|main|INFO|OVNSB commit failed, force recompute next time.


The commit failed is logged constantly. As a workaround you need to restart multiple times ovn-controller until the errors are gone from the log or remove all the ACTIVE ports bound to the host, either migrating or stopping any running VMs and restart the ovn-controller.

** Affects: ovn (Ubuntu)
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Ubuntu
OpenStack, which is subscribed to ovn in Ubuntu.
https://bugs.launchpad.net/bugs/1931275

Title:
  ovn-controller fails to start

Status in ovn package in Ubuntu:
  New

Bug description:
  When using Openstack Ussuri with OVN 20.03 in Bionic and starting an
  ovn-controller this sometime fails with the following:

  2021-06-07T14:13:34.803Z|00001|vlog|INFO|opened log file /var/log/ovn/ovn-controller.log
  2021-06-07T14:13:34.805Z|00002|reconnect|INFO|unix:/var/run/openvswitch/db.sock: connecting...
  2021-06-07T14:13:34.805Z|00003|reconnect|INFO|unix:/var/run/openvswitch/db.sock: connected
  2021-06-07T14:13:34.808Z|00004|main|INFO|OVS IDL reconnected, force recompute.
  2021-06-07T14:13:34.810Z|00005|reconnect|INFO|ssl:10.216.241.118:6642: connecting...
  2021-06-07T14:13:34.810Z|00006|main|INFO|OVNSB IDL reconnected, force recompute.
  2021-06-07T14:13:34.814Z|00007|reconnect|INFO|ssl:10.216.241.118:6642: connected
  2021-06-07T14:13:34.886Z|00008|ofctrl|INFO|unix:/var/run/openvswitch/br-int.mgmt: connecting to switch
  2021-06-07T14:13:34.886Z|00009|rconn|INFO|unix:/var/run/openvswitch/br-int.mgmt: connecting...
  2021-06-07T14:13:34.886Z|00010|rconn|INFO|unix:/var/run/openvswitch/br-int.mgmt: connected
  2021-06-07T14:13:34.888Z|00011|ovsdb_idl|WARN|transaction error: {"details":"RBAC rules for client \"juju-a79b06-5-lxd-16.maas\" role \"ovn-controller\" prohibit modification of table \"Chassis\".","error":"permission error"}
  2021-06-07T14:13:34.888Z|00012|main|INFO|OVNSB commit failed, force recompute next time.
  2021-06-07T14:13:34.888Z|00001|pinctrl(ovn_pinctrl0)|INFO|unix:/var/run/openvswitch/br-int.mgmt: connecting to switch
  2021-06-07T14:13:34.889Z|00002|rconn(ovn_pinctrl0)|INFO|unix:/var/run/openvswitch/br-int.mgmt: connecting...
  2021-06-07T14:13:34.889Z|00013|ovsdb_idl|WARN|transaction error: {"details":"RBAC rules for client \"juju-a79b06-5-lxd-16.maas\" role \"ovn-controller\" prohibit modification of table \"Chassis\".","error":"permission error"}
  2021-06-07T14:13:34.889Z|00014|main|INFO|OVNSB commit failed, force recompute next time.
  2021-06-07T14:13:34.890Z|00003|rconn(ovn_pinctrl0)|INFO|unix:/var/run/openvswitch/br-int.mgmt: connected
  2021-06-07T14:13:34.891Z|00015|ovsdb_idl|WARN|transaction error: {"details":"RBAC rules for client \"juju-a79b06-5-lxd-16.maas\" role \"ovn-controller\" prohibit modification of table \"Chassis\".","error":"permission error"}
  2021-06-07T14:13:34.891Z|00016|main|INFO|OVNSB commit failed, force recompute next time.
  2021-06-07T14:13:34.901Z|00017|ovsdb_idl|WARN|transaction error: {"details":"RBAC rules for client \"juju-a79b06-5-lxd-16.maas\" role \"ovn-controller\" prohibit modification of table \"Chassis\".","error":"permission error"}
  2021-06-07T14:13:34.901Z|00018|main|INFO|OVNSB commit failed, force recompute next time.
  2021-06-07T14:13:34.921Z|00019|ovsdb_idl|WARN|transaction error: {"details":"RBAC rules for client \"juju-a79b06-5-lxd-16.maas\" role \"ovn-controller\" prohibit modification of table \"Chassis\".","error":"permission error"}
  2021-06-07T14:13:34.922Z|00020|main|INFO|OVNSB commit failed, force recompute next time.
  2021-06-07T14:13:34.942Z|00021|main|INFO|OVNSB commit failed, force recompute next time.
  2021-06-07T14:13:34.966Z|00022|main|INFO|OVNSB commit failed, force recompute next time.
  2021-06-07T14:13:35.028Z|00023|main|INFO|OVNSB commit failed, force recompute next time.
  2021-06-07T14:13:35.257Z|00024|main|INFO|OVNSB commit failed, force recompute next time.
  2021-06-07T14:13:35.505Z|00025|main|INFO|OVNSB commit failed, force recompute next time.
  2021-06-07T14:13:35.760Z|00026|main|INFO|OVNSB commit failed, force recompute next time.
  2021-06-07T14:13:35.934Z|00027|main|INFO|OVNSB commit failed, force recompute next time.
  2021-06-07T14:13:36.004Z|00028|main|INFO|OVNSB commit failed, force recompute next time.
  2021-06-07T14:13:36.251Z|00029|main|INFO|OVNSB commit failed, force recompute next time.
  2021-06-07T14:13:36.727Z|00030|main|INFO|OVNSB commit failed, force recompute next time.
  2021-06-07T14:13:36.976Z|00031|main|INFO|OVNSB commit failed, force recompute next time.

  
  The commit failed is logged constantly. As a workaround you need to restart multiple times ovn-controller until the errors are gone from the log or remove all the ACTIVE ports bound to the host, either migrating or stopping any running VMs and restart the ovn-controller.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/ovn/+bug/1931275/+subscriptions