Bad performance when accessing a lot of small files
Alexandre Biancalana
biancalana at gmail.com
Sat Dec 29 07:50:30 PST 2007
On Dec 28, 2007 7:38 PM, Alfred Perlstein <alfred at freebsd.org> wrote:
>
> * Alexandre Biancalana <biancalana at gmail.com> [071225 16:45] wrote:
> > On 12/21/07, Alfred Perlstein <alfred at freebsd.org> wrote:
> >
> > > Have you tried the 'noatime' mount option? That should help.
> >
> > Yeah, the zfs set atime=off was already done....
> >
> > >
> > > Can you provide a histogram of the count of files per directory?
> >
> > Excuse-me, but I don't understand....
>
> Distribution of files per directory, example:
>
> 1000 files in 9 dirs
> 1001 files in 12 dirs
>
> find /path_to_root/ -type f | sed 's/\/[^/]*$//' | uniq -c | \
> awk '{print $1}' | sort -n | uniq -c
>
> That will print out the number of files per dir.
>
> 2 98
> 3 102
> 1 103
> 2 105
Ohh yes !! Now I understand....
The problem is that last night the server stop responding and now is
panicing with the message:
ZFS(panic): zfs: allocating allocated segment(offset=2781261201408 size=131072)
More information about the freebsd-performance
mailing list