[merge] add TestNotApplicable and test documentation

[Ian Clatworthy]

Martin Pool wrote:
> On 8/23/07, Aaron Bentley <aaron.bentley at utoronto.ca> wrote:
>>> +======================= ======= ======= ========
>>> +result                  strict  default lax
>>> +======================= ======= ======= ========
>>> +TestSkipped             pass    pass    pass
>>> +TestNotApplicable       pass    pass    pass
>>> +TestPlatformLimit       pass    pass    pass
>>> +TestDependencyMissing   fail    pass    pass
>>> +KnownFailure            fail    fail    pass
>>> +======================= ======= ======= ========
>> I don't like this.  To me, the point of KnownFailure is to enable us to
>> merge test cases for bugs that haven't been fixed yet.  My approach is
>> that it's better to have a test case for a bug we haven't fixed than to
>> have nothing.
> 
> I agree.  I wrote this part before --strict was added, and what was
> actually committed makes it consider KnownFailure an overall failure,
> and that seems better to me.  I'll change that to 'fail pass pass' if
> that's ok with you?
> 
> Or maybe it should be 'pass pass pass', if we expect some xfails to be
> around for a long time until they're fixed?

I think 'pass pass pass' makes more sense given Aaron's point.

Ian C.