[Bug 2011340] [NEW] neutron-linuxbridge-cleanup fails to start on boot

Heni Nechi 2011340 at bugs.launchpad.net
Sun Mar 12 15:44:59 UTC 2023 

Public bug reported:

1)

Description:	Ubuntu 22.04.1 LTS
Release:	22.04

2)

neutron-linuxbridge-agent:
  Installed: 2:20.2.0-0ubuntu1

3)

neutron-linuxbridge-agent to be up and for neutron-linuxbridge-cleanup
to start on boot.


4)

neutron-linuxbridge-agent keeps going down and after checking
/var/log/neutron/neutron-linuxbridge-agent.log I found this :

2023-03-12 15:52:49.414 33866 CRITICAL neutron [-] Unhandled error: neutron.privileged.agent.linux.ip_lib.InterfaceOperationNotSupported: Operation not supported on interface vxlan-524, namespace None.
2023-03-12 15:52:49.414 33866 ERROR neutron Traceback (most recent call last):
2023-03-12 15:52:49.414 33866 ERROR neutron   File "/usr/bin/neutron-linuxbridge-agent", line 10, in <module>
2023-03-12 15:52:49.414 33866 ERROR neutron     sys.exit(main())
2023-03-12 15:52:49.414 33866 ERROR neutron   File "/usr/lib/python3/dist-packages/neutron/cmd/eventlet/plugins/linuxbridge_neutron_agent.py", line 28, in main
2023-03-12 15:52:49.414 33866 ERROR neutron     agent_main.main()
2023-03-12 15:52:49.414 33866 ERROR neutron   File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 1039, in main
2023-03-12 15:52:49.414 33866 ERROR neutron     manager = LinuxBridgeManager(bridge_mappings, interface_mappings)
2023-03-12 15:52:49.414 33866 ERROR neutron   File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 92, in __init__
2023-03-12 15:52:49.414 33866 ERROR neutron     self.check_vxlan_support()
2023-03-12 15:52:49.414 33866 ERROR neutron   File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 729, in check_vxlan_support
2023-03-12 15:52:49.414 33866 ERROR neutron     if self.vxlan_ucast_supported():
2023-03-12 15:52:49.414 33866 ERROR neutron   File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 705, in vxlan_ucast_supported
2023-03-12 15:52:49.414 33866 ERROR neutron     self.delete_interface(test_iface)
2023-03-12 15:52:49.414 33866 ERROR neutron   File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 670, in delete_interface
2023-03-12 15:52:49.414 33866 ERROR neutron     device.link.delete()
2023-03-12 15:52:49.414 33866 ERROR neutron   File "/usr/lib/python3/dist-packages/neutron/agent/linux/ip_lib.py", line 482, in delete
2023-03-12 15:52:49.414 33866 ERROR neutron     privileged.delete_interface(self.name, self._parent.namespace)
2023-03-12 15:52:49.414 33866 ERROR neutron   File "/usr/lib/python3/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
2023-03-12 15:52:49.414 33866 ERROR neutron     return self.channel.remote_call(name, args, kwargs,
2023-03-12 15:52:49.414 33866 ERROR neutron   File "/usr/lib/python3/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
2023-03-12 15:52:49.414 33866 ERROR neutron     raise exc_type(*result[2])
2023-03-12 15:52:49.414 33866 ERROR neutron neutron.privileged.agent.linux.ip_lib.InterfaceOperationNotSupported: Operation not supported on interface vxlan-524, namespace None.
2023-03-12 15:52:49.414 33866 ERROR neutron

it's keeps on repeating and adding vxlan interfaces.


and this in the boot logs:

16:02:26 controller ModemManager[1106]: <info>  [base-manager] couldn't check support for device '/sys/devices/pci0000:00/0000:00:11.0/0000:02:01.0': not supported by any plugin
مارس 12 16:02:26 controller systemd[1]: neutron-linuxbridge-cleanup.service: Main process exited, code=exited, status=1/FAILURE
مارس 12 16:02:26 controller systemd[1]: neutron-linuxbridge-cleanup.service: Failed with result 'exit-code'.
مارس 12 16:02:26 controller systemd[1]: Failed to start OpenStack Neutron Linux bridge cleanup.
مارس 12 16:02:26 controller systemd[1]: Dependency failed for Openstack Neutron Linux Bridge Agent.
مارس 12 16:02:26 controller systemd[1]: neutron-linuxbridge-agent.service: Job neutron-linuxbridge-agent.service/start failed with result 'dependency'.
مارس 12 16:02:26 controller systemd[1]: neutron-linuxbridge-cleanup.service: Consumed 9.509s CPU time.

openstack network agent list
+--------------------------------------+--------------------+------------+-------------------+-------+-------+---------------------------+
| ID                                   | Agent Type         | Host       | Availability Zone | Alive | State | Binary                    |
+--------------------------------------+--------------------+------------+-------------------+-------+-------+---------------------------+
| 059b6417-3f10-4a57-9eda-b0866f6a0060 | Linux bridge agent | compute1   | None              | XXX   | UP    | neutron-linuxbridge-agent |
| 1549645e-5dbe-4ca1-9eb7-661f1cce5849 | DHCP agent         | controller | nova              | :-)   | UP    | neutron-dhcp-agent        |
| 3045523c-b1d4-4256-bae4-d6909a47af4a | Linux bridge agent | compute5   | None              | XXX   | UP    | neutron-linuxbridge-agent |
| 74a24664-cee4-4a87-95cf-303f44cc522e | Linux bridge agent | compute4   | None              | XXX   | UP    | neutron-linuxbridge-agent |
| 7df2b9e8-7afb-41b4-b2c7-a5a44e95ff2e | Linux bridge agent | compute2   | None              | XXX   | UP    | neutron-linuxbridge-agent |
| c253c2ef-8b17-490a-8bbc-957baac919ad | Metadata agent     | controller | None              | :-)   | UP    | neutron-metadata-agent    |
| e121813a-3305-4d53-b3c9-6631f8b77a38 | Linux bridge agent | controller | None              | XXX   | UP    | neutron-linuxbridge-agent |
| e1d79173-c06d-4be0-aa81-40845390ca07 | Linux bridge agent | compute3   | None              | XXX   | UP    | neutron-linuxbridge-agent |
| f55768c2-7ca1-428c-b393-a63f7ff73e55 | L3 agent           | controller | nova              | :-)   | UP    | neutron-l3-agent          |
+--------------------------------------+--------------------+------------+-------------------+-------+-------+---------------------------+

** Affects: neutron (Ubuntu)
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Ubuntu
OpenStack, which is subscribed to neutron in Ubuntu.
https://bugs.launchpad.net/bugs/2011340

Title:
  neutron-linuxbridge-cleanup fails to start on boot

Status in neutron package in Ubuntu:
  New

Bug description:
  1)

  Description:	Ubuntu 22.04.1 LTS
  Release:	22.04

  2)

  neutron-linuxbridge-agent:
    Installed: 2:20.2.0-0ubuntu1

  3)

  neutron-linuxbridge-agent to be up and for neutron-linuxbridge-cleanup
  to start on boot.

  
  4)

  neutron-linuxbridge-agent keeps going down and after checking
  /var/log/neutron/neutron-linuxbridge-agent.log I found this :

  2023-03-12 15:52:49.414 33866 CRITICAL neutron [-] Unhandled error: neutron.privileged.agent.linux.ip_lib.InterfaceOperationNotSupported: Operation not supported on interface vxlan-524, namespace None.
  2023-03-12 15:52:49.414 33866 ERROR neutron Traceback (most recent call last):
  2023-03-12 15:52:49.414 33866 ERROR neutron   File "/usr/bin/neutron-linuxbridge-agent", line 10, in <module>
  2023-03-12 15:52:49.414 33866 ERROR neutron     sys.exit(main())
  2023-03-12 15:52:49.414 33866 ERROR neutron   File "/usr/lib/python3/dist-packages/neutron/cmd/eventlet/plugins/linuxbridge_neutron_agent.py", line 28, in main
  2023-03-12 15:52:49.414 33866 ERROR neutron     agent_main.main()
  2023-03-12 15:52:49.414 33866 ERROR neutron   File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 1039, in main
  2023-03-12 15:52:49.414 33866 ERROR neutron     manager = LinuxBridgeManager(bridge_mappings, interface_mappings)
  2023-03-12 15:52:49.414 33866 ERROR neutron   File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 92, in __init__
  2023-03-12 15:52:49.414 33866 ERROR neutron     self.check_vxlan_support()
  2023-03-12 15:52:49.414 33866 ERROR neutron   File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 729, in check_vxlan_support
  2023-03-12 15:52:49.414 33866 ERROR neutron     if self.vxlan_ucast_supported():
  2023-03-12 15:52:49.414 33866 ERROR neutron   File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 705, in vxlan_ucast_supported
  2023-03-12 15:52:49.414 33866 ERROR neutron     self.delete_interface(test_iface)
  2023-03-12 15:52:49.414 33866 ERROR neutron   File "/usr/lib/python3/dist-packages/neutron/plugins/ml2/drivers/linuxbridge/agent/linuxbridge_neutron_agent.py", line 670, in delete_interface
  2023-03-12 15:52:49.414 33866 ERROR neutron     device.link.delete()
  2023-03-12 15:52:49.414 33866 ERROR neutron   File "/usr/lib/python3/dist-packages/neutron/agent/linux/ip_lib.py", line 482, in delete
  2023-03-12 15:52:49.414 33866 ERROR neutron     privileged.delete_interface(self.name, self._parent.namespace)
  2023-03-12 15:52:49.414 33866 ERROR neutron   File "/usr/lib/python3/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
  2023-03-12 15:52:49.414 33866 ERROR neutron     return self.channel.remote_call(name, args, kwargs,
  2023-03-12 15:52:49.414 33866 ERROR neutron   File "/usr/lib/python3/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
  2023-03-12 15:52:49.414 33866 ERROR neutron     raise exc_type(*result[2])
  2023-03-12 15:52:49.414 33866 ERROR neutron neutron.privileged.agent.linux.ip_lib.InterfaceOperationNotSupported: Operation not supported on interface vxlan-524, namespace None.
  2023-03-12 15:52:49.414 33866 ERROR neutron

  it's keeps on repeating and adding vxlan interfaces.

  
  and this in the boot logs:

  16:02:26 controller ModemManager[1106]: <info>  [base-manager] couldn't check support for device '/sys/devices/pci0000:00/0000:00:11.0/0000:02:01.0': not supported by any plugin
  مارس 12 16:02:26 controller systemd[1]: neutron-linuxbridge-cleanup.service: Main process exited, code=exited, status=1/FAILURE
  مارس 12 16:02:26 controller systemd[1]: neutron-linuxbridge-cleanup.service: Failed with result 'exit-code'.
  مارس 12 16:02:26 controller systemd[1]: Failed to start OpenStack Neutron Linux bridge cleanup.
  مارس 12 16:02:26 controller systemd[1]: Dependency failed for Openstack Neutron Linux Bridge Agent.
  مارس 12 16:02:26 controller systemd[1]: neutron-linuxbridge-agent.service: Job neutron-linuxbridge-agent.service/start failed with result 'dependency'.
  مارس 12 16:02:26 controller systemd[1]: neutron-linuxbridge-cleanup.service: Consumed 9.509s CPU time.

  openstack network agent list
  +--------------------------------------+--------------------+------------+-------------------+-------+-------+---------------------------+
  | ID                                   | Agent Type         | Host       | Availability Zone | Alive | State | Binary                    |
  +--------------------------------------+--------------------+------------+-------------------+-------+-------+---------------------------+
  | 059b6417-3f10-4a57-9eda-b0866f6a0060 | Linux bridge agent | compute1   | None              | XXX   | UP    | neutron-linuxbridge-agent |
  | 1549645e-5dbe-4ca1-9eb7-661f1cce5849 | DHCP agent         | controller | nova              | :-)   | UP    | neutron-dhcp-agent        |
  | 3045523c-b1d4-4256-bae4-d6909a47af4a | Linux bridge agent | compute5   | None              | XXX   | UP    | neutron-linuxbridge-agent |
  | 74a24664-cee4-4a87-95cf-303f44cc522e | Linux bridge agent | compute4   | None              | XXX   | UP    | neutron-linuxbridge-agent |
  | 7df2b9e8-7afb-41b4-b2c7-a5a44e95ff2e | Linux bridge agent | compute2   | None              | XXX   | UP    | neutron-linuxbridge-agent |
  | c253c2ef-8b17-490a-8bbc-957baac919ad | Metadata agent     | controller | None              | :-)   | UP    | neutron-metadata-agent    |
  | e121813a-3305-4d53-b3c9-6631f8b77a38 | Linux bridge agent | controller | None              | XXX   | UP    | neutron-linuxbridge-agent |
  | e1d79173-c06d-4be0-aa81-40845390ca07 | Linux bridge agent | compute3   | None              | XXX   | UP    | neutron-linuxbridge-agent |
  | f55768c2-7ca1-428c-b393-a63f7ff73e55 | L3 agent           | controller | nova              | :-)   | UP    | neutron-l3-agent          |
  +--------------------------------------+--------------------+------------+-------------------+-------+-------+---------------------------+

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/neutron/+bug/2011340/+subscriptions

More information about the Ubuntu-openstack-bugs mailing list