[BENCHMARKS] AS vs DL vs CFQ

Nick Piggin (piggin@cyberone.com.au)
Thu, 27 Mar 2003 15:21:34 +1100


This is a MIME-formatted message. If you see this text it means that your
E-mail software does not support MIME-formatted messages.

--=_courier-18013-1048738947-0001-2
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Due to popular demand I have done a CFQ run of these benchmarks on the
same kernel+hardware. DL and AS results are the results I previously
posted.

Summary: Looks like CFQ still has some problems which need sorting out,
AFAIK no tuning has been done, and Jens is currently caught up with
other important stuff. So, don't read too much into these results. They
are most useful as a bug report. Search for '*' to for my comments where
I have seen problems.

--=_courier-18013-1048738947-0001-2
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment; filename=all_results

Cat kernel source during seq read
DL - 0.03user 0.13system 5:21.39elapsed
AS - 0.02user 0.14system 0:14.50elapsed
CF - 0.01user 0.13system 4:52.79elapsed

Cat kernel source during seq write
DL - 0.03user 0.14system 14:06.45elapsed
AS - 0.02user 0.14system 0:16.33elapsed
CF - N/A
* Test DNF after 20 minutes. "Equilibrium" state is
5s pauses between reads of ~500K and continual ~45MB/s writes

ls -lr kernel source during seq read
DL - 0.18user 0.31system 0:24.32elapsed
AS - 0.19user 0.32system 0:09.39elapsed
CF - 0.18user 0.29system 0:23.76elapsed

ls -lr kernel source during seq write
DL - 0.23user 0.34system 1:13.90elapsed
AS - 0.18user 0.32system 0:05.49elapsed
CF - 0.20user 0.33system 0:47.19elapsed

Contest
no_load:
Kernel [runs] Time CPU% Loads LCPU% Ratio
2.5.65-mm4-dl 1 69 95.7 0.0 0.0 1.00
2.5.65-mm4-as 1 69 95.7 0.0 0.0 1.00
2.5.65-mm4-cf 1 69 95.7 0.0 0.0 1.00
io_load:
Kernel [runs] Time CPU% Loads LCPU% Ratio
2.5.65-mm4-dl 1 149 46.3 121.0 22.8 2.16
2.5.65-mm4-as 1 100 70.0 81.2 22.0 1.45
2.5.65-mm4-cf 1 121 57.9 77.8 18.0 1.75
read_load:
Kernel [runs] Time CPU% Loads LCPU% Ratio
2.5.65-mm4-dl 1 91 78.0 12.8 6.6 1.32
2.5.65-mm4-as 1 100 72.0 15.6 8.0 1.45
2.5.65-mm4-cf 1 92 76.1 12.5 6.5 1.33
list_load:
Kernel [runs] Time CPU% Loads LCPU% Ratio
2.5.65-mm4-dl 1 87 78.2 5.0 18.4 1.26
2.5.65-mm4-as 1 94 72.3 6.0 19.1 1.36
2.5.65-mm4-cf 1 89 76.4 5.0 18.0 1.29

tiobench
Only did 1 and 4 threads for CFQ. It is not a scheduler for a server.

Unit information
================
File size = 1024MB
Blk Size = 4096B

Sequential Reads
Num Avg Maximum Lat% Lat% CPU
Identifier Thr Rate (CPU%) Latency Latency >2s >10s Eff
--------------- --- ------ ------ --------- ----------- ----- ------ -----
2.5.65-mm4-dl 1 48.21 11.09% 0.080 36.49 0.00 0.00 435
2.5.65-mm4-dl 4 11.47 2.500% 1.358 86.84 0.00 0.00 459
2.5.65-mm4-dl 16 13.18 3.049% 4.704 311.43 0.00 0.00 432
2.5.65-mm4-dl 256 10.32 2.489% 58.877 69755.23 0.09 0.07 414
2.5.65-mm4-as 1 49.23 11.52% 0.078 28.10 0.00 0.00 427
2.5.65-mm4-as 4 39.56 9.461% 0.387 217.46 0.00 0.00 418
2.5.65-mm4-as 16 37.81 8.902% 1.571 929.76 0.00 0.00 425
2.5.65-mm4-as 256 33.10 7.822% 17.405 26072.15 0.25 0.05 423
2.5.65-mm4-cf 1 48.80 12.66% 0.079 28.16 0.00 0.00 385
2.5.65-mm4-cf 4 12.38 2.607% 1.184 276.88 0.00 0.00 475

Random Reads
2.5.65-mm4-dl 1 0.59 0.488% 6.647 23.35 0.00 0.00 120
2.5.65-mm4-dl 4 0.59 0.178% 26.003 96.85 0.00 0.00 332
2.5.65-mm4-dl 16 0.67 0.327% 88.082 403.66 0.00 0.00 206
2.5.65-mm4-dl 256 0.61 0.480% 1064.411 16058.51 3.02 2.68 127
2.5.65-mm4-as 1 0.57 0.504% 6.829 28.33 0.00 0.00 113
2.5.65-mm4-as 4 0.63 0.584% 23.283 220.36 0.00 0.00 108
2.5.65-mm4-as 16 0.63 0.624% 87.513 596.26 0.00 0.00 101
2.5.65-mm4-as 256 0.85 0.852% 659.708 14613.03 13.15 1.04 99
2.5.65-mm4-cf 1 0.59 0.554% 6.581 22.38 0.00 0.00 107
2.5.65-mm4-cf 4 0.59 0.203% 25.473 105.73 0.00 0.00 289

Sequential Writes
2.5.65-mm4-dl 1 42.85 20.66% 0.082 992.45 0.00 0.00 207
2.5.65-mm4-dl 4 43.04 20.94% 0.291 1104.10 0.00 0.00 205
2.5.65-mm4-dl 16 37.10 17.68% 1.188 6594.20 0.02 0.00 210
2.5.65-mm4-dl 256 29.38 14.76% 15.689 30675.42 0.17 0.06 199
2.5.65-mm4-as 1 44.15 21.43% 0.080 1025.37 0.00 0.00 206
2.5.65-mm4-as 4 40.94 19.79% 0.299 1087.51 0.00 0.00 207
2.5.65-mm4-as 16 35.62 16.89% 1.220 5965.63 0.02 0.00 211
2.5.65-mm4-as 256 28.20 14.15% 16.388 33732.92 0.17 0.06 199
2.5.65-mm4-cf 1 45.22 21.20% 0.078 1222.02 0.00 0.00 213
2.5.65-mm4-cf 4 33.45 15.87% 0.367 1602.89 0.00 0.00 211

Random Writes
2.5.65-mm4-dl 1 0.81 0.467% 0.033 32.69 0.00 0.00 174
2.5.65-mm4-dl 4 0.79 0.509% 0.934 75.36 0.00 0.00 155
2.5.65-mm4-dl 16 0.81 0.484% 3.573 518.44 0.00 0.00 166
2.5.65-mm4-dl 256 0.99 0.561% 48.837 7073.10 0.60 0.00 176
2.5.65-mm4-as 1 0.82 0.472% 0.034 32.15 0.00 0.00 174
2.5.65-mm4-as 4 0.81 0.518% 0.818 137.50 0.00 0.00 156
2.5.65-mm4-as 16 0.79 0.516% 4.735 476.85 0.00 0.00 153
2.5.65-mm4-as 256 0.94 0.524% 79.319 7416.65 0.96 0.00 179
2.5.65-mm4-cf 1 0.78 0.433% 0.334 25.19 0.00 0.00 180
2.5.65-mm4-cf 4 0.89 0.515% 4.068 12795.50 0.03 0.03 172
* CFQ has latency problems here for some reason.

OraSim (bigger is better)
DL - 132, 144
AS - 129, 140
CF - 97, 121

nickbench (IO rate is total combined throughput)
Bench 2 - 2 threads, streaming reader and streaming writer
DL - IO Rate: 33.36 MB/s, Reads per write: 0.08
AS - IO Rate: 42.19 MB/s, Reads per write: 2.08
CF - IO Rate: 32.00 MB/s, Reads per write: 0.12

Bench 3 - 2 threads, streaming readers
DL - IO Rate: 12.64 MB/s, Reads per read: 0.95
AS - IO Rate: 45.56 MB/s, Reads per read: 1.00
CF - IO Rate: 11.93 MB/s, Reads per read: 0.99

Bench 4 - 2 threads, streaming writers
DL - IO Rate: 38.59 MB/s, Writes per write: 1.45
AS - IO Rate: 40.64 MB/s, Writes per write: 1.68
CF - IO Rate: 37.88 MB/s, Writes per write: 1.66

Bench 5 - 1 thread, read then write each block of 1 file
DL - IO Rate: 40.24 MB/s, CPU time per byte: 4732.421875 us/B
AS - IO Rate: 45.30 MB/s, CPU time per byte: 5238.281250 us/B
CF - IO Rate: 38.80 MB/s, CPU time per byte: 4718.750000 us/B

Bench 6 - 4 threads, streaming readers
DL - IO Rate: 11.87 MB/s, Greatest unfairness between 4 readers: 0.95
AS - IO Rate: 44.89 MB/s, Greatest unfairness between 4 readers: 0.95
CF - IO Rate: 11.27 MB/s, Greatest unfairness between 4 readers: 0.5
* in this CFQ result, 2 threads read 256MB, 2 read 128MB

--=_courier-18013-1048738947-0001-2--