RFC: startup time - again

[Alexander Belchenko]

Russel Winder пишет:
> Alexander,
> On Thu, 2008-09-11 at 19:37 +0300, Alexander Belchenko wrote:
>> Here is the numbers for 1.6.1 with and without tests.
>>
>> Full bzrlib with tests:
>>
>> C:\Temp\bzr-1.6.1\win32_bzr.exe>timeit bzr.exe --no-plugins --no-aliases rocks
>> It sure does!
>>
>> time: 0.297
>>
>> Without tests and benchmarks:
>>
>> C:\Temp\bzr-1.6.1-wo-test\win32_bzr.exe>timeit bzr.exe --no-plugins --no-aliases rocks
>> It sure does!
>>
>> time: 0.281
>>
>> So I get about 16 ms win, i.e. >5% speedup. Does it big or small? For me it's enough big.
>> There is another 3-5 places where I can get additional 16ms speedup on each.
>> So in sum I could get about 80ms speedup. Does it big or small?
> 
> I would be strongly tempted to not make any deductions at all from two
> data points.  I find that I easily get ±10% variation for the same job
> on the same machine just running at different times.   Even if you run
> the same job on the same machine just one after the other, I bet the
> times are easily going to be ±5%.

You can think what you want but this is the best numbers for 10 runs.
Yes, of course numbers is not stable. So what?

I have patched version of bzr.exe that has 70ms faster startup than
official one. So this speedup is a real fact, not my imagination.