[Bug 1716709] Re: Deploying VRRP enabled Openstack with trusty-updates/mitaka results in a split-brained HA setup

[Liam Young]

I think this is where we are:

1) OpenStack with vrrp using trusty/liberty cloud archive works
2) OpenStack with vrrp using trusty/mitaka cloud archive fails
3) OpenStack with vrrp using trusty/mitaka cloud archive and HWE kernel works
4) OpenStack without vrrp using trusty/mitaka cloud archive works
5) OpenStack with vrrp using xenial/mitaka cloud archive works

So, this seems to be a mismatch between the trusty/mitaka CA version of
OVS with the trusty kernel

-- 
You received this bug notification because you are a member of Ubuntu
OpenStack, which is subscribed to Ubuntu Cloud Archive.
https://bugs.launchpad.net/bugs/1716709

Title:
  Deploying VRRP enabled Openstack with trusty-updates/mitaka results in
  a split-brained HA setup

Status in Ubuntu Cloud Archive:
  New

Bug description:
  I have been testing enabling router HA using the enable-l3ha neutron-api config option with the
  trusty-updates/mitaka cloud archive. Once the deployment is complete creating a HA router should result in a network namespace for the router being present on two neutron-gateway units. One should be the master and have the routers IP and the other a slave. However, both namespaces appear to house the router IP and both think they are the master. I can see the VRRP multicast traffic leave the netns and looking at the openflow rules it appears to be sent down the vxlan tunnels but it never arrives at the other end from what I can tell.

  The only error I have been able to see logged is constant stream of issues
  in the ovs-vswitchd.log:

  
  2017-09-12T15:19:48.060Z|05672|dpif(handler1)|WARN|system at ovs-system: failed to put[create] (Invalid argument) ufid:ab3d5620-e108-42da-bc76-1c77239371a3 skb_priority(0x6/0),in_port(6),skb_mark(0/0),eth(src=fa:16:3e:e5:80:66,dst=01:00:5e:00:00:12),eth_type(0x0800),ipv4(src=169.254.192.1/0.0.0.0,dst=224.0.0.18/0.0.0.0,proto=112/0,tos=0xc0/0x3,ttl=255/0,frag=no), actions:set(tunnel(tun_id=0x437,src=10.5.0.26,dst=10.5.0.27,ttl=64,tp_dst=4789,flags(df|key))),4,set(tunnel(tun_id=0x437,src=10.5.0.26,dst=10.5.0.38,ttl=64,tp_dst=4789,flags(df|key))),4,set(tunnel(tun_id=0x437,src=10.5.0.26,dst=10.5.0.33,ttl=64,tp_dst=4789,flags(df|key))),4,set(tunnel(tun_id=0x437,src=10.5.0.26,dst=10.5.0.39,ttl=64,tp_dst=4789,flags(df|key))),4,push_vlan(vid=2,pcp=0),1
  2017-09-12T15:19:48.060Z|05673|dpif(handler1)|WARN|system at ovs-system: execute set(tunnel(tun_id=0x437,src=10.5.0.26,dst=10.5.0.27,ttl=64,tp_dst=4789,flags(df|key))),4,set(tunnel(tun_id=0x437,src=10.5.0.26,dst=10.5.0.38,ttl=64,tp_dst=4789,flags(df|key))),4,set(tunnel(tun_id=0x437,src=10.5.0.26,dst=10.5.0.33,ttl=64,tp_dst=4789,flags(df|key))),4,set(tunnel(tun_id=0x437,src=10.5.0.26,dst=10.5.0.39,ttl=64,tp_dst=4789,flags(df|key))),4,push_vlan(vid=2,pcp=0),1 failed (Invalid argument) on packet ip,vlan_tci=0x0000,dl_src=fa:16:3e:e5:80:66,dl_dst=01:00:5e:00:00:12,nw_src=169.254.192.1,nw_dst=224.0.0.18,nw_proto=112,nw_tos=192,nw_ecn=0,nw_ttl=255
   mtu 0
  2017-09-12T15:19:50.064Z|05674|dpif(handler1)|WARN|system at ovs-system: failed to put[create] (Invalid argument) ufid:ab3d5620-e108-42da-bc76-1c77239371a3 skb_priority(0x6/0),in_port(6),skb_mark(0/0),eth(src=fa:16:3e:e5:80:66,dst=01:00:5e:00:00:12),eth_type(0x0800),ipv4(src=169.254.192.1/0.0.0.0,dst=224.0.0.18/0.0.0.0,proto=112/0,tos=0xc0/0x3,ttl=255/0,frag=no), actions:set(tunnel(tun_id=0x437,src=10.5.0.26,dst=10.5.0.27,ttl=64,tp_dst=4789,flags(df|key))),4,set(tunnel(tun_id=0x437,src=10.5.0.26,dst=10.5.0.38,ttl=64,tp_dst=4789,flags(df|key))),4,set(tunnel(tun_id=0x437,src=10.5.0.26,dst=10.5.0.33,ttl=64,tp_dst=4789,flags(df|key))),4,set(tunnel(tun_id=0x437,src=10.5.0.26,dst=10.5.0.39,ttl=64,tp_dst=4789,flags(df|key))),4,push_vlan(vid=2,pcp=0),1
  2017-09-12T15:19:50.064Z|05675|dpif(handler1)|WARN|system at ovs-system: execute set(tunnel(tun_id=0x437,src=10.5.0.26,dst=10.5.0.27,ttl=64,tp_dst=4789,flags(df|key))),4,set(tunnel(tun_id=0x437,src=10.5.0.26,dst=10.5.0.38,ttl=64,tp_dst=4789,flags(df|key))),4,set(tunnel(tun_id=0x437,src=10.5.0.26,dst=10.5.0.33,ttl=64,tp_dst=4789,flags(df|key))),4,set(tunnel(tun_id=0x437,src=10.5.0.26,dst=10.5.0.39,ttl=64,tp_dst=4789,flags(df|key))),4,push_vlan(vid=2,pcp=0),1 failed (Invalid argument) on packet ip,vlan_tci=0x0000,dl_src=fa:16:3e:e5:80:66,dl_dst=01:00:5e:00:00:12,nw_src=169.254.192.1,nw_dst=224.0.0.18,nw_proto=112,nw_tos=192,nw_ecn=0,nw_ttl=255
   mtu 0

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1716709/+subscriptions