[Bug 2067889] Re: DPDK 23.11.1 / OVS 3.3.0 cause test failures

[Christian Ehrhardt ]

Here the differences I spot on a high level:

4. OVS-DPDK - ping vhost-user ports
 - testpmd.log - not much difference
 - ovsdb-server.log
   ovsdb-server is killed (sig 15) in the bad case 7 seconds after starting
   that kill is after the test log ends, so it could be cleanup
 - ovs-vswitchd.log
   dpdk|ERR|TELEMETRY: Socket write base info to client failed  (likely red herring)
   in addition to all-same messages like the good case, the bad case shows
   dpdk|ERR|remove_xdp_program(): bpf_xdp_query_id failed
   dpdk|ERR|eth_dev_close(): Error while removing XDP program.
 - system-dpdk-testsuite.log
   differs at the end, good case seems to enter cleanup while bad case does lots of things
   bad case has more content as it reports detailed steps
   can't cleanup testpmd (pid already gone)

16. OVS-DPDK - MTU increase vport port
17. OVS-DPDK - MTU decrease vport port (same)
20. OVS-DPDK - MTU upper bound vport port (same)
21. OVS-DPDK - MTU lower bound vport port (same)
 - testpmd.log
   good case sees ports going down and stopping
 - ovsdb-server.log
      ovsdb-server is killed (sig 15) in the bad case a few seconds after starting
      that kill is after the test log ends, so it could be cleanup
 - ovs-vswitchd.log
      dpdk|ERR|TELEMETRY: Socket write base info to client failed  (likely red herring)
 - system-dpdk-testsuite.log
   differs at the end, good case seems to enter cleanup while bad case does lots of things
   bad case has more content as it reports detailed steps
   can't cleanup testpmd (pid already gone)


So on case 4 it could be the xdp error which is new.
On the other cases only the telemetry is odd, but that seemed (see above) like a false positive.
Yet there are chances a component I didn't see yet tests on no ERR messages.
Worth a rebuild with this reverted?

-- 
You received this bug notification because you are a member of Ubuntu
OpenStack, which is subscribed to openvswitch in Ubuntu.
https://bugs.launchpad.net/bugs/2067889

Title:
  DPDK 23.11.1 / OVS 3.3.0 cause test failures

Status in dpdk package in Ubuntu:
  New
Status in openvswitch package in Ubuntu:
  New

Bug description:
  https://autopkgtest.ubuntu.com/packages/o/openvswitch/oracular/amd64

  Bad
  Oracular OVS test with DPDK 23.11.1-1
  https://autopkgtest.ubuntu.com/results/autopkgtest-oracular/oracular/amd64/o/openvswitch/20240531_100906_6f957@/log.gz

  Good
  Oracular OVS test with DPDK 23.11-1
  https://autopkgtest.ubuntu.com/results/autopkgtest-oracular/oracular/amd64/o/openvswitch/20240529_111623_6f8db@/log.gz

  The logs are messy to read if not used to it, this is a try at debugging what is going wrong.
  So far it seems other people have retried 14 times, and 14714 fail at the same tests - I think there is a real issue.

  As shown below, one can find always these fail:
  4: OVS-DPDK - ping vhost-user ports                FAILED (system-dpdk.at:148)
  5: OVS-DPDK - ping vhost-user-client ports         FAILED (system-dpdk.at:224)
  16: OVS-DPDK - MTU increase vport port              FAILED (system-dpdk.at:609)
  17: OVS-DPDK - MTU decrease vport port              FAILED (system-dpdk.at:651)
  20: OVS-DPDK - MTU upper bound vport port           FAILED (system-dpdk.at:767)
  21: OVS-DPDK - MTU lower bound vport port           FAILED (system-dpdk.at:809)

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/dpdk/+bug/2067889/+subscriptions