Release testing and the relationship between 'bzr selftest' and plugins

[Vincent Ladeuil]

>>>>> Jelmer Vernooij <jelmer at samba.org> writes:

    > Am 16/03/12 10:55, schrieb Vincent Ladeuil:
    >> Still on this subject but from a slightly different pov, you maintain a
    >> set of recipes to build bzr and various plugins in the daily PPA.
    >> 
    >> Since they all run the tests can you give some feedback about:
    >> 
    >> - whether this is a good way to catch regressions,
    > I don't think it is. The plugins are only built when their tip changes,
    > so we usually don't notice breakage until somebody is also changing the
    > plugin (in which case they run the testsuite anyway).

Ok.

    > The other problem with it is that you get a single plain text file for
    > each plugin, with all build and test output. That makes it a bit awkward
    > to navigate the failures and to figure out what they are.

Ha, too bad, I thought you had a magic bullet for that...

    >> - how you proceed to filter out and extract the significant bits from
    >> the lp mails.
    > I don't :-) 

Hehe.

    > I regularly go to
    > http://people.canonical.com/~jelmer/recipe-status/bzr.html
    > <http://people.canonical.com/%7Ejelmer/recipe-status/bzr.html> and
    > fix issues that show up there.

OMG ! The magic bullet !

Thanks, that was useful feedback,

        Vincent