[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]

Re: htree stabilitity and performance issues



Thanks, I'll give the below code a go and post to the list on how it
goes.

What's your take on the nfs client load issues? It does run for 4-5
hours albeit at higher load (how explained by your post) however it does
eventually die with the load going stupid (180 odd). It seems that the
patch still has some nfs interoperability problems.

With the e2fsck issue I was using e2fsckprogs v1.34.

On Thu, 2003-12-18 at 10:35, Theodore Ts'o wrote:
> On Thu, Dec 18, 2003 at 10:17:06AM +1100, Adam Cassar wrote:
> > > This has to be done in userspace because a directory can be
> > > arbitrarily big, so we can't do it in the kernel.  However, for people
> > > who don't want to modify their application, I do have an LD_PRELOAD
> > > module which you can try using that should also do the trick (see
> > > attached).
> > 
> > Could you resend please - it didn't come through.
> 
> Oops, sorry about that.  I forgot to attach it before I hit "send".
> 
> > So htree workloads are best suited for applications that know the name
> > of the file in advance? From your comments above I would assume that
> > even 'ls' would perform worse?
> 
> Well, "ls" is fine.  "ls -sF", which requires that you stat every
> single file that is returned by readdir, will perform much, much worse
> unless you sort the returned files by inode number.  The same is true
> with find as well.  
> 
> If you compile the attached C source file as a shared library, and
> then point the LD_PRELOAD environment variable (or place the pathame
> in /etc/ld.so.preload --- which is preferred), it will intercept all
> opendir/readdir system calls, and sort the results first before
> returning them to the user progam.  It will require a little bit more
> memory (enough to hold the entire contents of the directory at once),
> but while this might be a problem in the kernel, for a userspace
> program, this is generally not a problem.
> 
> 					 - Ted
-- 
Adam Cassar
IT Manager
NetRegistry Pty Ltd
______________________________________________
http://www.netregistry.com.au
Tel:  02 9699 6099          Fax:  02 9699 6088
PO Box 270    Broadway      NSW   2007

Domains |Business Email|Web Hosting|E-Commerce
Trusted  by  10,000s of  businesses since 1997
______________________________________________




[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]