> If you want to help with 'interactive performance', i.e., user
> experience, then *quantify what contributes to that* and write a
> micro-measurement tool that measures such things. E.g, latency of
> response to keyboard events under load. It's not rocket science, it
> just takes time and effort to set this kind of thing up so it's accurate
> and predictive.
http://people.redhat.com/bmatthews/irman/
I've already asked Randy Hwron(sp?) to include this in
his regular benchmarking.
> It's an incredible waste of developer's time to be running 'reality
> tests' all the time, and never using more precise measurement methods.
> Anyone who wants to run reality tests and post the results is more than
> welcome to, and this is valuable. It's not valuable to throw mud at a
> testing/measurement tool because you think it's not 'realistic'.
The thing is that developers need some benchmarking thing
they can script to run overnight. Watching vmstat for
hours on end is not a useful way of spending development
time.
On the other hand, if somebody could code up some scriptable
benchmarks that approximate real workloads better than the
current benchmarks do, I'd certainly appreciate it.
For web serving, for example, I wouldn't mind a benchmark that:
1) simulates a number of users, that:
1a) load a page with 10 to 20 associated images
1b) sleep for a random time between 3 and 60 seconds,
"reading the page"
1c) follow a link and grab another page with N images
2) varies the number of users from 1 to N
3) measures
3a) the server's response time until it starts
answering the request
3b) the time it takes to download each full page
Then we can plot both kinds of response time against the number
of users and we have an idea of the web serving performance of
a particular system ... without focussing on, or even measuring,
the unrealistic "servers N pages per minute" number.
Volunteers ? ;)
kind regards,
Rik
-- Bravely reimplemented by the knights who say "NIH".http://www.surriel.com/ http://distro.conectiva.com/
- To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/