[RFC] small updates to test running

[Martin Pool]

On 12 Jul 2006, John Arbash Meinel <john at arbash-meinel.com> wrote:
> Currently the selftest suite runs all of the adapted Transport tests
> before running any other tests. This takes quite a while, and Transport
> has been stable for a while. I think it would be nice if we ran them
> after the testmod_names. Just trying to move failed tests earlier.
> 
> Second, I think it would be nice if the non-verbose mode would print out
> a single line for failed/error tests. It goes back to Aaron's earlier
> complaint, that now you have to run the whole test suite before it
> prints out anything about what has failed. I think doing something like:
> 
> test.foo.bar.baz: FAIL
> test.xxx.yy.zzz: ERROR
> [========      ] 10/1000
> 
> It would add 1 line for everything that fails, but it is nicer in a few
> ways.

Both those sounds good to me.

I tend to run with --one if I expect anything will fail, just because of
the volume of (largely unhelpful) error log we get at the moment.

> 1) You know that something is failing before the test finishes
> 2) You can see what is actually failing and go work on that test while
> waiting for the rest to finish.
> 3) You can quickly spot fail/error tests, rather than grepping through
> the output of --verbose


-- 
Martin