Kernel 2.4.16 & Heavy I/O

war war (war@starband.net)
Thu, 29 Nov 2001 10:46:40 -0500


Issue:

Is it possible to set the disk cache size to a higher value to avoid
temporary freezing while untarring large files? Memory is not an
issue, I have plenty of it. The disk drive is a good drive, does
29.2MB/s sustained in single user mode, 25MB/s when I have a lot of
processes open. Here is what I think is going on. Sometimes, when I
untar things, or do things that consume a lot of disk space rapidly,
they do it VERY quickly, and then the disk rumbles on for 5-20
seconds after it is done. What accounts for this?

Example:

[20:10]% tar -xf 2GB-FILE.tar
[20:30]% # Hard disk is still grinding.
[20:60]% # Hard disk stops grinding.

In essence, the 'tar' command is finished, however, 30-60 seconds
after it has finished, it is actually still decompressing the data to
the file on the disk.

I have not tested ALL kernels for when or where this has started, but
could someone provide a further explanation as to why the disk
scheduluer works like this?

On Solaris, when I untar a file, the disk stops grinding when the tar
process is finished, and the system is totally usuable.

With Linux, when I untar the file, the system may completely lock up
for 3-5 seconds during the duration after the initial untar (which is
30-60 seconds) after the untar processes has ended.

System Setup: P3/866
1GB RAM
2GB SWAP
Kernel 2.4.16

Result:

Just read this [bottom] after trying to burn 2 CD's (luckily on
CDRW's) at the same time on two different IDE bus controllers while
untarring a 1.6GB file. With earlier kernels, this is usually not a
problem.

CDRW1 = Plextor v1.09
CDRW2 = HP 7510i

Burnproof kicked in for the Plextor, I love Plextor drives.
With the HP, it didn't have enough data to fill the buffer, and
therefore caused a buffer underrun, easy to blank=toc and re-write
however.

http://lwn.net/2001/1129/kernel.php3

The current stable kernel release is 2.4.16. This release, the first
by Marcelo Tosatti, contains little beyond the filesystem fix. This
release does seem to deserve the name "stable," though there are
still some persistent complaints about interactive response in the
presence of heavy I/O. The culprit appears to be the disk I/O
scheduler; a real fix for that problem could be long in coming. The
2.4.17-pre1 prepatch contains a number of items including a new USB
maintainer and a devfs update.
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/