ACK: [ACT][PATCH] UBUNTU: SAUCE: ubuntu_ltp_syscalls: improve test granularity and remove blacklist feature

[Krzysztof Kozlowski]

On 09/09/2021 08:38, Po-Hsu Lin wrote:
> BugLink: https://bugs.launchpad.net/bugs/1942429
> 
> This is a major change to how we run the LTP syscalls test.
> 
> This patch will:
>   1. Make the test abort early if the setup() has failed.
>   2. Treat all sub tests (1358 tests for the moment) as different
>      individual test cases to make it easier to hint and debug.
> 
> Since we will run them one-by-one, the "== Summary ==" section will
> be removed. The blacklist feature is deprecated too. It's expected
> to see those tests we blacklisted before start failing again, but
> we can hint it with our result hinting system and this can help us
> to get a more consistent result across different kernels.
> 
> Note that the overall report size will increase from 2.6M to 180M,
> as more system information files will be collected. This will only
> affect our infrastructure storage.
> 
> This has been tested with a KVM node on our dev jenkins.
> 
> Signed-off-by: Po-Hsu Lin <po-hsu.lin at canonical.com>
> ---
>  ubuntu_ltp_syscalls/control                |  19 ++-
>  ubuntu_ltp_syscalls/testcase_blacklist.py  |  48 -------
>  ubuntu_ltp_syscalls/ubuntu_ltp_syscalls.py | 149 ++++++---------------
>  3 files changed, 55 insertions(+), 161 deletions(-)
>  delete mode 100644 ubuntu_ltp_syscalls/testcase_blacklist.py
> 

Acked-by: Krzysztof Kozlowski <krzysztof.kozlowski at canonical.com>

Best regards,
Krzysztof