[Bug 1475679] Re: some tests tmpfail with: testbed auxverb failed with exit code 255

[Launchpad Bug Tracker]

This bug was fixed in the package autopkgtest - 3.16.2

---------------
autopkgtest (3.16.2) unstable; urgency=medium

  * Exit with code 4 ("test failure") if a test times out, instead of 16
    ("testbed failure").
  * Exit with code 12 ("erroneous package") if test dependencies are
    unsatisfiable and put badpkg/blame into summary, instead of exiting with
    code 20 ("other unexpected failures including bad usage").
  * Exit with code 12 ("erroneous package") and a proper error message if
    debian/tests/<testname> does not exist, instead of code 20 and a confusing
    message about chmod failing and *-stderr missing.
  * Exit with code 12 ("erroneous package") instead of 20 if test dependency
    package install fails.
  * adt-virt-ssh: If the executed command exits with 255, translate that to
    253 in the auxverb wrapper, as 255 is ssh's (and auxverb's) exit code if
    something with the connection failed. This avoids considering ordinary
    test failures as temporary testbed failures. (LP: #1475679)

 -- Martin Pitt <mpitt at debian.org>  Fri, 17 Jul 2015 17:08:03 +0200

** Changed in: autopkgtest (Ubuntu)
       Status: Fix Committed => Fix Released

-- 
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to autopkgtest in Ubuntu.
https://bugs.launchpad.net/bugs/1475679

Title:
  some tests tmpfail with: testbed auxverb failed with exit code 255

Status in autopkgtest package in Ubuntu:
  Fix Released

Bug description:
  The following tests fail with something like

  adt-run [14:16:22]: test phpunit: [-----------------------
  PHP Fatal error:  Class 'PHPUnit_Extensions_Story_TestCase' not found in /tmp/adt-run.RcIhN8/build.rYE/php-horde-kolab-server-2.0.4/Horde_Kolab_Server-2.0.4/test/Horde/Kolab/Server/Integration/Scenario.php on line 29
  Exit request sent.
  adt-run [14:16:23]: ERROR: testbed failed: testbed auxverb failed with exit code 255

  Exiting with 255 is a "magic" exit code from ssh indicating a problem
  with the ssh connection, and should not ordinarily be used by tests.

  Affected tests:

  marisa
  php-horde-kolab-server
  php-horde-sesha
  php-sabre-http
  pillow-sane
  symfony

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/autopkgtest/+bug/1475679/+subscriptions