[Bug 1614837] Re: ovn:Multi nodes devstack, controller node losts ovs port when computer node starts

XuRong xu.rong at zte.com.cn
Fri Aug 19 07:47:38 UTC 2016


2016-08-19T04:05:26.374Z|00001|vlog|INFO|opened log file /opt/stack/logs/ovs-vswitchd.log
2016-08-19T04:05:26.376Z|00002|ovs_numa|INFO|Discovered 16 CPU cores on NUMA node 0
2016-08-19T04:05:26.376Z|00003|ovs_numa|INFO|Discovered 16 CPU cores on NUMA node 1
2016-08-19T04:05:26.376Z|00004|ovs_numa|INFO|Discovered 2 NUMA nodes and 32 CPU cores
2016-08-19T04:05:26.376Z|00005|reconnect|INFO|unix:/usr/local/var/run/openvswitch/db.sock: connecting...
2016-08-19T04:05:26.376Z|00006|reconnect|INFO|unix:/usr/local/var/run/openvswitch/db.sock: connected
2016-08-19T04:05:26.391Z|00007|ofproto_dpif|INFO|system at ovs-system: Datapath supports recirculation
2016-08-19T04:05:26.391Z|00008|ofproto_dpif|INFO|system at ovs-system: MPLS label stack length probed as 1
2016-08-19T04:05:26.391Z|00009|ofproto_dpif|INFO|system at ovs-system: Datapath supports truncate action
2016-08-19T04:05:26.391Z|00010|ofproto_dpif|INFO|system at ovs-system: Datapath supports unique flow ids
2016-08-19T04:05:26.391Z|00011|ofproto_dpif|INFO|system at ovs-system: Datapath supports ct_state
2016-08-19T04:05:26.391Z|00012|ofproto_dpif|INFO|system at ovs-system: Datapath supports ct_zone
2016-08-19T04:05:26.391Z|00013|ofproto_dpif|INFO|system at ovs-system: Datapath supports ct_mark
2016-08-19T04:05:26.391Z|00014|ofproto_dpif|INFO|system at ovs-system: Datapath supports ct_label
2016-08-19T04:05:26.391Z|00015|ofproto_dpif|INFO|system at ovs-system: Datapath supports ct_state_nat
2016-08-19T04:05:26.433Z|00001|ofproto_dpif_upcall(handler1)|INFO|received packet on unassociated datapath port 0
2016-08-19T04:05:26.457Z|00016|bridge|INFO|bridge br-int: added interface br-int on port 65534
2016-08-19T04:05:26.457Z|00017|bridge|INFO|bridge br-int: using datapath ID 00006a16bb663b49
2016-08-19T04:05:26.458Z|00018|connmgr|INFO|br-int: added service controller "punix:/usr/local/var/run/openvswitch/br-int.mgmt"
2016-08-19T04:05:26.461Z|00019|bridge|INFO|ovs-vswitchd (Open vSwitch) 2.6.90
2016-08-19T04:05:36.462Z|00020|memory|INFO|15292 kB peak resident set size after 10.1 seconds
2016-08-19T04:05:36.462Z|00021|memory|INFO|handlers:23 ports:1 revalidators:9 rules:4
2016-08-19T04:14:53.300Z|00022|connmgr|INFO|br-int<->unix: 4 flow_mods 10 s ago (3 adds, 1 deletes)
2016-08-19T04:16:01.075Z|00023|connmgr|INFO|br-int<->unix: 23 flow_mods 10 s ago (23 adds)
2016-08-19T04:16:05.363Z|00024|bridge|INFO|bridge br-int: added interface patch-lrp-8541b3a4-8cc2-41c4-af11-27f581f044af-to-8541b3a4-8cc2-41c4-af11-27f581f044af on port 1
2016-08-19T04:16:05.364Z|00025|bridge|INFO|bridge br-int: added interface patch-8541b3a4-8cc2-41c4-af11-27f581f044af-to-lrp-8541b3a4-8cc2-41c4-af11-27f581f044af on port 2
2016-08-19T04:16:15.342Z|00026|bridge|INFO|bridge br-int: added interface patch-lrp-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21-to-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21 on port 3
2016-08-19T04:16:15.342Z|00027|bridge|INFO|bridge br-int: added interface patch-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21-to-lrp-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21 on port 4
2016-08-19T04:17:01.075Z|00028|connmgr|INFO|br-int<->unix: 647 flow_mods in the 10 s starting 56 s ago (645 adds, 2 deletes)
2016-08-19T05:17:56.341Z|00029|bridge|INFO|bridge br-int: added interface ovn-87892d-0 on port 5
2016-08-19T05:17:56.362Z|00030|dpif|WARN|system at ovs-system: failed to query port patch-lrp-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21-to-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21: Invalid argument
2016-08-19T05:17:56.362Z|00031|dpif|WARN|system at ovs-system: failed to query port patch-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21-to-lrp-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21: Invalid argument
2016-08-19T05:17:56.362Z|00032|dpif|WARN|system at ovs-system: failed to query port patch-8541b3a4-8cc2-41c4-af11-27f581f044af-to-lrp-8541b3a4-8cc2-41c4-af11-27f581f044af: Invalid argument
2016-08-19T05:17:56.362Z|00033|dpif|WARN|system at ovs-system: failed to query port patch-lrp-8541b3a4-8cc2-41c4-af11-27f581f044af-to-8541b3a4-8cc2-41c4-af11-27f581f044af: Invalid argument
2016-08-19T05:18:06.337Z|00034|connmgr|INFO|br-int<->unix: 466 flow_mods 10 s ago (445 adds, 21 deletes)

-- 
You received this bug notification because you are a member of Ubuntu
OpenStack, which is subscribed to openvswitch in Ubuntu.
https://bugs.launchpad.net/bugs/1614837

Title:
  ovn:Multi nodes devstack, controller node losts ovs port when computer
  node starts

Status in openvswitch package in Ubuntu:
  New

Bug description:
  I have two nodes, one is devstack-152(192.168.1.152) which is controller and computer node, the other is devstack-167(192.168.1.167) which is computer node only.
  Fist, I starts devstack-152, when it is ready, the data are as follows:
  [root at devstack-152 devstack]# nova service-list
  +----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
  | Id | Binary           | Host         | Zone     | Status  | State | Updated_at                 | Disabled Reason |
  +----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
  | 6  | nova-conductor   | devstack-152 | internal | enabled | up    | 2016-08-19T05:48:52.000000 | -               |
  | 8  | nova-scheduler   | devstack-152 | internal | enabled | up    | 2016-08-19T05:48:57.000000 | -               |
  | 9  | nova-consoleauth | devstack-152 | internal | enabled | up    | 2016-08-19T05:48:53.000000 | -               |
  | 10 | nova-compute     | devstack-152 | nova     | enabled | up    | 2016-08-19T05:48:57.000000 | -               |
  | 11 | nova-compute     | devstack-167 | nova     | enabled | up    | 2016-08-19T05:48:56.000000 | -               |
  +----+------------------+--------------+----------+---------+-------+----------------------------+-----------------+
  [root at devstack-152 devstack]# neutron port-list
  +--------------------------------------+------+-------------------+--------------------------------------------------+
  | id                                   | name | mac_address       | fixed_ips                                        |
  +--------------------------------------+------+-------------------+--------------------------------------------------+
  | 57498ca8-a9a3-4fc2-b08c-339f8fcf4c21 |      | fa:16:3e:62:c7:38 | {"subnet_id": "8176d1ef-                         |
  |                                      |      |                   | 6e68-4b5d-a475-ebc015e14106", "ip_address":      |
  |                                      |      |                   | "fd8a:5f:b56b::1"}                               |
  | 8541b3a4-8cc2-41c4-af11-27f581f044af |      | fa:16:3e:2f:6a:4b | {"subnet_id": "1d32f1ca-3805-494d-               |
  |                                      |      |                   | ab25-f8a8c96804c5", "ip_address": "10.0.0.1"}    |
  | 9b334b65-c631-44bf-8338-02b0e3e63444 |      | fa:16:3e:43:b6:89 | {"subnet_id":                                    |
  |                                      |      |                   | "51db7655-51c4-468c-8452-c2bbada20c86",          |
  |                                      |      |                   | "ip_address": "172.24.4.4"}                      |
  |                                      |      |                   | {"subnet_id": "25a70542-a098-4b6d-989f-          |
  |                                      |      |                   | b20f5cacd0d0", "ip_address": "2001:db8::c"}      |
  +--------------------------------------+------+-------------------+--------------------------------------------------[root at devstack-152 devstack]# ovn-nbctl list logical_switch_port
  _uuid               : b75e9e58-4ab0-42e8-994c-6fc0c1c344dd
  addresses           : ["fa:16:3e:2f:6a:4b 10.0.0.1"]
  dhcpv4_options      : 30428d9c-678c-4c1d-b762-45b3e4617237
  dhcpv6_options      : []
  dynamic_addresses   : []
  enabled             : true
  external_ids        : {"neutron:port_name"=""}
  name                : "8541b3a4-8cc2-41c4-af11-27f581f044af"
  options             : {router-port="lrp-8541b3a4-8cc2-41c4-af11-27f581f044af"}
  parent_name         : []
  port_security       : []
  tag                 : []
  type                : router
  up                  : true

  _uuid               : 1d825431-83c5-456a-a6d9-2257afddc9cb
  addresses           : ["fa:16:3e:43:b6:89 172.24.4.4 2001:db8::c"]
  dhcpv4_options      : []
  dhcpv6_options      : []
  dynamic_addresses   : []
  enabled             : true
  external_ids        : {"neutron:port_name"=""}
  name                : "9b334b65-c631-44bf-8338-02b0e3e63444"
  options             : {}
  parent_name         : []
  port_security       : []
  tag                 : []
  type                : ""
  up                  : false

  _uuid               : 0076f185-3789-47bf-95ac-a742195596d2
  addresses           : ["fa:16:3e:62:c7:38 fd8a:5f:b56b::1"]
  dhcpv4_options      : []
  dhcpv6_options      : []
  dynamic_addresses   : []
  enabled             : true
  external_ids        : {"neutron:port_name"=""}
  name                : "57498ca8-a9a3-4fc2-b08c-339f8fcf4c21"
  options             : {router-port="lrp-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21"}
  parent_name         : []
  port_security       : []
  tag                 : []
  type                : router
  up                  : true
  [root at devstack-152 ~]# ovs-vsctl show
  a9a63a12-af0c-420d-a847-ebb6fd62a1ea
      Bridge br-int
          fail_mode: secure
          Port "patch-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21-to-lrp-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21"
              Interface "patch-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21-to-lrp-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21"
                  type: patch
                  options: {peer="patch-lrp-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21-to-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21"}
          Port "patch-8541b3a4-8cc2-41c4-af11-27f581f044af-to-lrp-8541b3a4-8cc2-41c4-af11-27f581f044af"
              Interface "patch-8541b3a4-8cc2-41c4-af11-27f581f044af-to-lrp-8541b3a4-8cc2-41c4-af11-27f581f044af"
                  type: patch
                  options: {peer="patch-lrp-8541b3a4-8cc2-41c4-af11-27f581f044af-to-8541b3a4-8cc2-41c4-af11-27f581f044af"}
          Port br-int
              Interface br-int
                  type: internal
          Port "patch-lrp-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21-to-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21"
              Interface "patch-lrp-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21-to-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21"
                  type: patch
                  options: {peer="patch-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21-to-lrp-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21"}
          Port "patch-lrp-8541b3a4-8cc2-41c4-af11-27f581f044af-to-8541b3a4-8cc2-41c4-af11-27f581f044af"
              Interface "patch-lrp-8541b3a4-8cc2-41c4-af11-27f581f044af-to-8541b3a4-8cc2-41c4-af11-27f581f044af"
                  type: patch
                  options: {peer="patch-8541b3a4-8cc2-41c4-af11-27f581f044af-to-lrp-8541b3a4-8cc2-41c4-af11-27f581f044af"}

  
  Then, I starts devstack-167, data in devstack-152 is changed
  [root at devstack-152 ~]# ovs-vsctl show
  a9a63a12-af0c-420d-a847-ebb6fd62a1ea
      Bridge br-int
          fail_mode: secure
          Port br-int
              Interface br-int
                  type: internal
          Port "ovn-87892d-0"
              Interface "ovn-87892d-0"
                  type: geneve
                  options: {csum="true", key=flow, remote_ip="10.43.166.167"}

  But devstack-167 data is correct
  [root at devstack-167 logs]# ovs-vsctl show
  0dbad5c3-c326-4d59-b295-1e8ee6d6bfac
      Bridge br-int
          fail_mode: secure
          Port "patch-8541b3a4-8cc2-41c4-af11-27f581f044af-to-lrp-8541b3a4-8cc2-41c4-af11-27f581f044af"
              Interface "patch-8541b3a4-8cc2-41c4-af11-27f581f044af-to-lrp-8541b3a4-8cc2-41c4-af11-27f581f044af"
                  type: patch
                  options: {peer="patch-lrp-8541b3a4-8cc2-41c4-af11-27f581f044af-to-8541b3a4-8cc2-41c4-af11-27f581f044af"}
          Port "patch-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21-to-lrp-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21"
              Interface "patch-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21-to-lrp-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21"
                  type: patch
                  options: {peer="patch-lrp-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21-to-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21"}
          Port "patch-lrp-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21-to-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21"
              Interface "patch-lrp-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21-to-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21"
                  type: patch
                  options: {peer="patch-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21-to-lrp-57498ca8-a9a3-4fc2-b08c-339f8fcf4c21"}
          Port "patch-lrp-8541b3a4-8cc2-41c4-af11-27f581f044af-to-8541b3a4-8cc2-41c4-af11-27f581f044af"
              Interface "patch-lrp-8541b3a4-8cc2-41c4-af11-27f581f044af-to-8541b3a4-8cc2-41c4-af11-27f581f044af"
                  type: patch
                  options: {peer="patch-8541b3a4-8cc2-41c4-af11-27f581f044af-to-lrp-8541b3a4-8cc2-41c4-af11-27f581f044af"}
          Port br-int
              Interface br-int
                  type: internal
          Port "ovn-2b2d12-0"
              Interface "ovn-2b2d12-0"
                  type: geneve
                  options: {csum="true", key=flow, remote_ip="192.168.1.152"}

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/openvswitch/+bug/1614837/+subscriptions



More information about the Ubuntu-openstack-bugs mailing list