Terrible NFS4 performance: FreeBSD 9.1 + ZFS + AWS EC2

[Berend de Boer]

Hi All,

I've just completed a round of NFS testing on FreeBSD 9.1 on AWS. The
underlying file system is ZFS.  I have a real nfs killer test: doing
an "svn update" of a directory of 3541 files.

Performance on the NFS server itself is good: checking this out takes
11 seconds (doing the same on a not really comparable Linux NFS server
is 43 seconds).

Doing this on a client writing to an NFS mounted home directory is
however terrible. Really terrible. This takes 25 minutes! With
"sync=disable" it's 16 minutes.

(doing this against the underpowered Linux NFS server is about 4.5 minutes).

The problem might be that the NFS server (nfsd) runs at 70-80% CPU. So
my writing speed is cpu bound (go figure).

Repeating this with nfs4 + udp: doesn't work at all, get input/output
error after a few files.

nfs3: 1m55s (nfsd cpu is in the 6%-8% range)

Varying tcp/udp, lock/nolock, sync/async, or enabling zfs
sync=standard doesn't make any particular difference. All timing were
within the 1m49s - 2m3s range.

So what's up with NFS4 on FreeBSD?

--
All the best,

Berend de Boer


          ------------------------------------------------------
          Awesome Drupal hosting: https://www.xplainhosting.com/
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 836 bytes
Desc: OpenPGP Digital Signature
URL: <http://lists.freebsd.org/pipermail/freebsd-fs/attachments/20130708/3c5a8725/attachment.sig>