Disk-Performace issue?
Michael Schuh
michael.schuh at gmail.com
Tue May 10 05:37:36 PDT 2005
Hallo Charles,
thank you for this hint, but this is not the source....
i have this option as default in my kernels.
Iknow that putting tons of files in one directory is not really good for the
performance. I think also that the way get better by using subdirs.
But my problem ist that the performance fall from one moment to
another from 100% to ~10%........ this was not linear, ist was not a
ramp, it was the grand canion.... or the "Eiger Nordwand". :-))
not that the performance at all is bad.
Thank you for your Hint
Michael
2005/5/10, Charles Swiger <cswiger at mac.com>:
> On May 10, 2005, at 6:46 AM, Michael Schuh wrote:
> > Now i have 2 Directories with ~500.000-600.000 files with an size of
> > ~5kByte.
> > by copying the files from one disk to another or an direktory on the
> > same disk
> > (equal behavior), i can see this behavior:
> > [ ... ]
> > Can anyone explain me from where this behavior can come?
> > Come thie eventually from the filesytem, or from my disks, so that
> > these are to hot? (I think not)
>
> Directories are kept as lists. Adding files to the end of a list takes
> a longer time, as the list gets bigger. There is a kernel option
> called DIRHASH (UFS_DIRHASH?) which can be enabled which will help this
> kind of situation out significantly, but even with it, you aren't going
> to get great performance when you put a half-million files into a
> single directory.
>
> Try breaking this content up into one or two levels of subdirectories.
> See the way the Squid cache works...
>
> --
> -Chuck
>
>
More information about the freebsd-stable
mailing list