[RFC] Benchmark configuration handling

[Carl Friedrich Bolz]

Hi all!

What's the preferred way to handle configuration for benchmarks? The
problem is that the number of options for a benchmark run will likely
increase: the times that the SocketDelay sleeps per roundtrip and per
transmitted character are the first things, but other options might
follow.  (The benchmark config file probably also should contain
information how to produce a web page so that people can
easily publish results from certain benchmarking settings at
some point).

So it would be nice to have a way to specify various benchmark
configurations and naming them (to be shown in the performance-history
page for example). What's a good way of doing this? We (Jan,
Holger and me) thought about adding a new configuration file somewhere
with various sections to correspond to various settings and a global
section to list the configurations.

A notes on the target group of this file: the benchmark
configuration probably does not need to be visible/advertised to
end users, i.e. should primarily be convenient to use for
developers/people caring for working with and producing benchmarks.
Probably, allowing to set (the possibly rather numerous) options from
the commandline is not important, is it?

Comments?

Cheers,

Carl Friedrich