[B][SRU][PATCH 0/1] Fix the return value for skipped tests in kselftest/net/rtnetlink.sh

Po-Hsu Lin po-hsu.lin at canonical.com
Fri Sep 11 08:55:06 UTC 2020


BugLink: https://bugs.launchpad.net/bugs/1895258

== SRU Justification ==
The rtnetlink.sh in kselftest/net from 4.15 kernel will fail with:
 selftests: rtnetlink.sh
 ========================================
 PASS: policy routing
 PASS: route get
 PASS: preferred_lft addresses have expired
 PASS: tc htb hierarchy
 PASS: gre tunnel endpoint
 PASS: bridge setup
 PASS: ipv6 addrlabel
 PASS: set ifalias e1dfde61-e5a7-415f-8bd9-924e9796038f for test-dummy0
 PASS: vrf
 PASS: vxlan
 SKIP: fou: iproute2 too old
 SKIP: macsec: iproute2 too old
 not ok 1..10 selftests: rtnetlink.sh [FAIL]

The return value for this script is 1.

Look into the code, it's the kci_test_encap_fou() test that causes
this issue:

      ip fou help 2>&1 |grep -q 'Usage: ip fou'
      if [ $? -ne 0 ];then
            echo "SKIP: fou: iproute2 too old"
            return 1
      fi

It should at least return ksft_skip=4 (or 0 with older release that
does not support this skip code in kselftest framework)

== Fix ==
* 57aefc7c226d ("selftests: net: return Kselftest Skip code for
skipped tests")

This patch needs to be backported into Bionic, as some newer tests
does not exist in Bionic.

== Test ==
Tested directly on the affected kernel, the test will be marked as:
not ok 1..10 selftests:  rtnetlink.sh [SKIP]

== Regression Potential ==
Low, changes limited to test scripts. And the kselftest framework in
Bionic can handle this ksft_skip=4 return code properly, tests won't
be marked as failed because of this.

Although IMO in this case the test should be marked as PASS instead of
SKIP in the end, as not all tests were skipped, but that's something
we could fix with upstream in the future.

Shuah Khan (Samsung OSG) (1):
  selftests: net: return Kselftest Skip code for skipped tests

 tools/testing/selftests/net/netdevice.sh    | 16 ++++++++++------
 tools/testing/selftests/net/psock_tpacket.c |  4 +++-
 tools/testing/selftests/net/rtnetlink.sh    | 15 +++++++++------
 3 files changed, 22 insertions(+), 13 deletions(-)

-- 
2.7.4




More information about the kernel-team mailing list