the need for a bench suite

[Robert Collins]

On Sun, 2006-01-15 at 19:41 -0600, John Arbash Meinel wrote:
> Denys Duchier wrote:
> > John Arbash Meinel <john at arbash-meinel.com> writes:
> > 
> > 
> >>Is there a reason we need a benchmark, rather than just doing:
> >>bzr selftest --verbose
> > 
> > 
> > yes, the existing tests are for correctness, not for performance.  They could
> > certainly provide additional data, but they would have nothing to say about
> > e.g. the speed of "bzr log", and you certainly would not want a "bzr log" test,
> > in the test suite, that ran for minutes.
> > 
> > Cheers,
> > 
> > --Denys
> 
> I agree. But should this new test be inside the main bzr branch. Because
> theoretically you would want to generate/have generated a lot of data so
> that you can test large trees.
> And I don't think we really want bzr to carry around another 50MB just
> to do benchmarking.

We can generate the data as part of the benchmark. All it needs is a
repeatable algorithm to create the sample tree.

> A benchmarking plugin would be pretty simple to write. And then it can
> have the extra data.
> 
> I think having benchmarks is a good idea, though.

Yes. I do too, and I know martin does too.

Rob

-- 
GPG key available at: <http://www.robertcollins.net/keys.txt>.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part
Url : https://lists.ubuntu.com/archives/bazaar/attachments/20060116/d93d8607/attachment.pgp