Re: Ext2 directory index: ALS paper and benchmarks

Cameron Simpson (cs@zip.com.au)
Fri, 7 Dec 2001 14:19:13 +1100


On Thu, Dec 06, 2001 at 06:41:17AM +0300, Hans Reiser <reiser@namesys.com> wrote:
| Have you ever seen an application that creates millions of files create
| them in random order?

I can readily imagine one. An app which stashes things sent by random
other things (usenet/email attachment trollers? security cameras taking
thouands of still photos a day?). Mail services like hotmail. with a
zillion mail spools, being made and deleted and accessed at random...

| Applications that create millions of files are usually willing to play
| nice for an order of magnitude performance gain also.....

But they shouldn't have to! Specificly, to "play nice" you need to know
about the filesystem attributes. You can obviously do simple things like
a directory hierachy as for squid proxy caches etc, but it's an ad hoc
thing. Tuning it does require specific knowledge, and the act itself
presumes exactly the sort of inefficiency in the fs implementation that
this htree stuff is aimed at rooting out.

A filesystem _should_ be just a namespace from the app's point of view.
Needing to play silly subdir games is, well, ugly.

-- 
Cameron Simpson, DoD#743        cs@zip.com.au    http://www.zip.com.au/~cs/

Were I subject to execution, I would choose to be fired at tremendous speed from a cannon into the brick wall of an elemetary school building, and insist on full media coverage, however, as I said the choices are sadly limited. - Jim Del Vecchio - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/