Bad performance when accessing a lot of small files

Alfred Perlstein alfred at
Fri Dec 21 16:27:05 PST 2007

* Alexandre Biancalana <biancalana at> [071221 15:53] wrote:
> On 12/21/07, Alfred Perlstein <alfred at> wrote:
> >
> > What application are you scanning these files with?  I know I had
> > issues with rsync in particular where I had to have it rsync
> > smaller pieces of a collection for it to work nicely instead of
> > going for the whole heirarchy.
> tar
> I run tar in the /backup/<hostname>/YYYYMMDD writing to LTO3 tape
> drive, the problem is that when origin directory contains a lot of
> small files the process is *much* more slow.... this is my question
> since the thread start.

Have you tried the 'noatime' mount option?  That should help.

Can you provide a histogram of the count of files per directory?

- Alfred Perlstein

More information about the freebsd-performance mailing list