RFC: startup time - again

[Russel Winder]

On Fri, 2008-09-12 at 11:11 +0300, Alexander Belchenko wrote:

> You can think what you want but this is the best numbers for 10 runs.
> Yes, of course numbers is not stable. So what?

So why not say that you took the average over 10 runs so as to allay
fears of people who think decision making based on a single data point
is not a clever thing to do?  I assume this is the average and not just
the best, since that would be equally fallacious as testing on just one
data point. 

The so what about things not being stable is that to focus on a supposed
5% improvement when the variance is 10% is a waste of everybody's time.

> I have patched version of bzr.exe that has 70ms faster startup than
> official one. So this speedup is a real fact, not my imagination.

Fine I have no problem with that as long as the statistics show you are
right.

-- 
Russel.
====================================================
Dr Russel Winder                 Partner

Concertant LLP                   t: +44 20 7585 2200, +44 20 7193 9203
41 Buckmaster Road,              f: +44 8700 516 084
London SW11 1EN, UK.             m: +44 7770 465 077
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part
Url : https://lists.ubuntu.com/archives/bazaar/attachments/20080912/c4a5343b/attachment-0001.pgp