usertest notes

[Martin Pool]

On Thu, Sep 25, 2008 at 1:11 PM, Robert Collins
<robertc at robertcollins.net> wrote:
> I thought I'd put some notes up on usertest...
>
> All the logs are at
> http://benchmark.bazaar-vcs.org/usertest/log/?C=M;O=D
> This is a long list, perhaps the last 30 days only, with by-month
> subdirs after that would be useful ?

I've moved the existing logs, changed the script to put them into
subdirectories, tweaked the IndexOptions so the names are more
readable and linked them from the benchmark.bazaar-vcs.org top page.

>
> test run every 6 hours, and pull in new content in the measured
> branches.
>
> All the canonical staff that hack on bzr can trigger manual tests if
> needed, and add or remove branches to test.
>
> Anyone's branch that is performance related can be tested.
>
> Current highlights;
>
> the readdir acceleration improvements seem to have had an effect -
> status and diff are notably faster.

Yes, it looks like they're now being built properly.

> log has slowed down since 1.3
> log-one-file has got faster
>
> (grain of salt - you need to check the scenarios to know what
> circumstances they are really testing).

The scenarios are taken from the bzr-usertest plugin, which is
documented in loving detail here
<http://people.ubuntu.com/~ianc/plugins/usertest/doc/usertest-tutorial.html>
and more scenarios would be useful.

-- 
Martin <http://launchpad.net/~mbp/>