[ic] howto do if file exists
John Young
interchange-users@icdevgroup.org
Fri Apr 18 16:35:55 2003
Mike replied:
> Quoting Stefan Hornburg (Racke) (racke@linuxia.de):
>
>> On Thu, 17 Apr 2003 12:20:38 -0400
>> Mike Heins <mike@perusion.com> wrote:
>>
>> > Quoting Nicholas Cook (ncook@gryphon.net):
>>
>> > > I hadn't thought about using apache. I'll try that approach because
>> > > I am talking about 20,000+ images.
>
>> > Warning -- Apache can't repeal the laws of physics either. It still
>> > has to do directory lookups just like IC does.
>> >
>> > You will be much happier if you hash your directories (like IC does
>> > with the session directory) and keep maximum entries down to a
>> > thousand or less.
>>
>> Using a filesystem suited for this should be an option as well, right ?
>
>
> Which one would you suggest? I am not aware of any mainstream Linux
> B-tree (or such) filesystems....
I'm assuming Racke was speaking of ReiserFS. From their website:
http://www.reiserfs.org/
ReiserFS is based on fast balanced trees. Balanced trees are more
robust in their performance, and are a more sophisticated algorithmic
foundation for a filesystem. When we started our project, there was a
consensus in the industry that balanced trees were too slow for
filesystem usage patterns. We proved that if you just do them right
they are better. We have fewer worst case performance scenarios than
other filesystems and generally better overall performance. If you
put 100,000 files in one directory, we think its fine; many other
filesystems try to tell you that you are wrong to want to do it.
Hans Reiser and others have quite a bit of techinical information available
at that site.
Of course, benchmarking would be required to *really* know how it compares
(if anyone wants to build the same system twice, just with different
filesystems).
John Young