Terrible NFS4 performance: FreeBSD 9.1 + UFS/ZFS + AWS EC2

[Joshua Boyd]

Are you using EBS or ephemeral storage?

If you are using EBS, how many provisioned IOPS and how many volumes are
you using? In what configuration?

What ec2 instance size are you using?

Are you running your tests against the NFS server from within EC2, or from
a host outside of EC2?

On Tue, Jul 30, 2013 at 9:08 PM, Berend de Boer <berend at pobox.com> wrote:

> >>>>> "Rick" == Rick Macklem <rmacklem at uoguelph.ca> writes:
>
>     Rick> I think you mentioned that you were using a Linux client,
>     Rick> but not what version. I'd suggest a recent kernel from
>     Rick> kernel.org. (Fedora tracks updates/fixes for NFSv4 pretty
>     Rick> closely, so the newest Fedora release should be pretty
>     Rick> current.)
>
> This was Ubuntu 10.04 LTS.
>
> Have just tried a FreeBSD 9.1 client. Similar numbers. NFSv3 is about
> 30% slower on FreeBSD than Linux: 3m30s versus 2m10s. NFSv4 has the
> same terribly slow performance, i.e. 21m56s for the same test.
>
> Interestingly, the nfsd cpu usage doesn't rise as high as with
> Linux. But goes up to 20% (instead of over 50%).
>
> I had a look at collectd measurements as well, one cpu on the FreeBSD
> server is spending a lot of time in IRQ (whatever that means).
>
> BTS, this was a FreeBSD NFS4 out-of-the-box server, not with the patch
> (as the patch didn't do that much for me, it did some, but performance
> was still 8 times slower than nfs3).
>
>
>     Rick> All I can suggest is capturing packets and then emailing be
>     Rick> the captured packet trace. You can use tcpdump to do the
>     Rick> capture, since wireshark will understand it: # tcpdump -s 0
>     Rick> -w <file>.pcap host <client-host> and then emailing me
>     Rick> <file>.pcap.
>
>     Rick> I can take a look at the packet capture and maybe see what
>     Rick> is going on.
>
> Will email them shortly.
>
> --
> All the best,
>
> Berend de Boer
>
>
>           ------------------------------------------------------
>           Awesome Drupal hosting: https://www.xplainhosting.com/
>



-- 
Joshua Boyd

E-mail: boydjd at jbip.net
http://www.jbip.net