[Bug 1075612] [NEW] coreutils autopkgtests do not fail correctly when a test fails

[Paul Larson]

Public bug reported:

When running the autopkgtests for coreutils I noticed that some tests
were getting marked as FAIL but the script was passing and exiting with
0 regardless.  The script is running with || { do some other things that
won't fail } so the set -e had no effect.  I'm not sure what the
recommended behaviour is for autopkgtests, but in general I usually like
to see all the test failures in one go, unless there was something
catastrophically wrong with the whole thing running.  So I left the -e
in, but updated it a bit to count the failures and exit with the total
count.

** Affects: coreutils (Ubuntu)
     Importance: Undecided
     Assignee: Martin Pitt (pitti)
         Status: New


** Tags: qa-manual-testing

** Branch linked: lp:~pwlars/ubuntu/raring/coreutils/fix-tests

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to coreutils in Ubuntu.
https://bugs.launchpad.net/bugs/1075612

Title:
  coreutils autopkgtests do not fail correctly when a test fails

Status in “coreutils” package in Ubuntu:
  New

Bug description:
  When running the autopkgtests for coreutils I noticed that some tests
  were getting marked as FAIL but the script was passing and exiting
  with 0 regardless.  The script is running with || { do some other
  things that won't fail } so the set -e had no effect.  I'm not sure
  what the recommended behaviour is for autopkgtests, but in general I
  usually like to see all the test failures in one go, unless there was
  something catastrophically wrong with the whole thing running.  So I
  left the -e in, but updated it a bit to count the failures and exit
  with the total count.

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/coreutils/+bug/1075612/+subscriptions