[RFC] small updates to test running

[Aaron Bentley]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

John Arbash Meinel wrote:
> Second, I think it would be nice if the non-verbose mode would print out
> a single line for failed/error tests. It goes back to Aaron's earlier
> complaint, that now you have to run the whole test suite before it
> prints out anything about what has failed. I think doing something like:
> 
> test.foo.bar.baz: FAIL
> test.xxx.yy.zzz: ERROR

I like this, but I'm inclined to take it further: we can print out the
entire test failure when it actually fails.  I don't think there's a
real benefit in delaying that output until all the tests have been run.
 Is there?

I guess for -v, there is, but I rarely do -v.

- -            self.pb.update(self._ellipsise_unimportant_words('ERROR',
13), self.testsRun, None)
+            self.pb.note(self._ellipsise_unimportant_words(
+                            test.id() + ': ERROR',
+                            osutils.terminal_width(), keep_start=True))

I'm not sure we need to elipsise this.

In terms of dealing with slow tests, I'd love to take an approach of
minimizing the time-to-failure.  For each test, record:

1. total number of failures (f)
2. total duration (d)

Then sort the test cases by d/f.

Aaron
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.1 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org

iD8DBQFEtSyf0F+nu1YWqI0RAi23AJ9fn2G7y+yCcmZylhjOoPFMK4+agQCfSNnK
+jCdmbown4Ki+me1riQ47Og=
=wZES
-----END PGP SIGNATURE-----