[Launchpad-dev] Bzr plugin for guessing relevant test modules: Fault line

[Aaron Bentley]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 11-06-02 12:42 PM, vila wrote:
>>>>>> Aaron Bentley <aaron at aaronbentley.com> writes:
> Yup. I've been thinking about the coverage-based approach for quite some
> time: run each test in isolation, establish which lines are covered,
> then, from a diff, for each line modified, add the corresponding tests.

The issue I thought of with coverage-based testing is that you might get
spurious positives.  For example, most of our tests will cover
Branch.last_revision, so if you change that, which ones should you run?

> There is quite a high price to pay upfront but then the increments
> should reasonably fast to calculate and reasonably accurate. But I won't
> bet this could replace a full test suite run.

No, but Launchpad's test suite takes several hours to run.  Because of
this, shortcuts that help us find the likely test failures quickly are a
bigger win for Launchpad than for bzr.

Aaron
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk3nxN0ACgkQ0F+nu1YWqI3aPACghrjV/GLrFfsb6e5Dav+SRnQg
rgUAn1lvsYHANaN9qb841ZIhlGlHPK8z
=m/fU
-----END PGP SIGNATURE-----