NFS Performance issue against NetApp

[Marc G. Fournier]

On 2013-04-24, at 14:18 , Rainer Duffner <rainer at ultra-secure.de> wrote:

> 
> Am 24.04.2013 um 23:02 schrieb "Marc G. Fournier" <scrappy at hub.org>:
> 
>> 
>> On 2013-04-24, at 12:48 , Rainer Duffner <rainer at ultra-secure.de> wrote:
>> 
>>> 
>>> In the NFS mount options.
>>> I've re-done my tests and it still seems to be a problem. 
>> 
>> 'k, just to clarify … your tests are with the Broadcom chipset(s)?   I have an Intel card on order, so will run tests against that as soon as it gets here to see  how it changes …
>> 
> 
> 
> No, with the intel card then.
> Even then it was slow.
> 
> 
> 
>> Just curious, but what are you running for tests?   I noticed it visually, but other then  using something like iozone21, not sure what is useful for coming up with a benchmark …
> 
> 
> I've just ran something like
> dd if=/dev/zero of=bla bs=1000000 count=1000
> 
> on the nfsmount on the client.
> 

Here is what I'm seeing with the Broadcom card:

IOZONE performance measurements:
        108561574 bytes/second for writing the file
        95311340 bytes/second for reading the file


That is using 'ozone 1024' for a 1G file … and no mount / kernel settings …

The problem isn't with the single file read / write though … the problem is when starting up an app server like jboss … my "reference server" is an old 32bit, 2 CPU + HT server with local drives … start up takes, from jboss start to deploy: 

				JBoss AS 7.1.1.Final "Brontes" started in 87916ms

now, I do acknowledge that this is with local drives, so will always be faster the NFS drives … but … 

HP Proliant Gen8, 64bit, 16G of RAM, Oodles of CPU:
	FreeBSD/SMP: Multiprocessor System Detected: 24 CPUs
	FreeBSD/SMP: 2 package(s) x 6 core(s) x 2 SMT threads
Brand new HP Procurve 2910al-24G … brand new 3xxx series NetApp running 8.1.2 … and everything pretty much idle (non production yet), and:

				JBoss AS 7.1.1.Final "Brontes" started in 310249ms


So, over 4x slower?

Can you send me what your mount options are in /etc/fstab?  I'd like to try that out and compare against the two above … and I do have the Intel card on the way, so see if that makes a difference …