brainstorming for UDS-N - Performance

[Christopher James Halse Rogers]

On Fri, 2010-10-01 at 14:19 -0700, Kees Cook wrote:
> On Fri, Oct 01, 2010 at 10:25:07AM +0100, Matthew Paul Thomas wrote:
> > Kees Cook wrote on 30/09/10 23:10:
> > >
> > > On Wed, Sep 29, 2010 at 07:43:49PM +0100, Matthew Paul Thomas wrote:
> > >...
> > >> Measurement. Where can I go to see the equivalent of Firefox's
> > >> <http://arewefastyet.com/> for Ubuntu startup speed? Where's the
> > >> equivalent graph for Ubiquity? For Unity? For Ubuntu Software Center?
> > >> How much better or worse is yesterday's Natty nightly compared with
> > >> Ubuntu 10.10? With Ubuntu 10.04 LTS?
> > >...
> > > Changes to the compiler toolchain, the kernel, etc, all have an impact
> > > on everyone's workloads, but most teams haven't actually stepped
> > > forward and said "THIS workload is important to us, here's how to
> > > reproduce the measurement, and here's where we're tracking the daily
> > > changes to that measurement."
> > >...
> > 
> > Have you asked them why that is? Maybe they don't know how to automate
> > the measurement, where to host it, or who to tell about it.
> 
> In discussions at the last UDS, it seems that most teams could not agree
> on what would be valuable to measure. For the teams that did have things
> they wanted to measure (e.g. a specific firefox rendering speed test),
> no one stepped up to automate it.
> 

I know that for X, cairo has a fantastic set of performance tests
regularly used by (at least some) upstream driver developers to test
performance changes.

If I remember my last UDS accurately, the hardware testing team (and the
arm team) wanted to include this in their testing.  The fairly recent
Cairo update in Maverick means that this suite, at least, is now
runnable.  I'm not sure if QA runs it frequently, or where the results
would be, though.

It *would* be nice to have a location which collates performance testing
results, if only to encourage them to be published.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 490 bytes
Desc: This is a digitally signed message part
Url : https://lists.ubuntu.com/archives/ubuntu-devel/attachments/20101004/ef1a6100/attachment.pgp