NFS over LAGG / lacp poor performance

[Steven Hartland]

----- Original Message ----- 
From: "Marek Salwerowicz" <marek_sal at wp.pl>
To: "Steven Hartland" <killing at multiplay.co.uk>; "Gerrit Kühn" <gerrit.kuehn at aei.mpg.de>
Cc: <freebsd-net at freebsd.org>
Sent: Friday, April 25, 2014 2:57 PM
Subject: Re: NFS over LAGG / lacp poor performance


>W dniu 2014-04-25 15:27, Steven Hartland pisze:
>> In that case I believe you've hard coded the number of queues, check
>> /boot/loader.conf
>> for references to this.
>
> Yes, that's true:
>
> % cat /boot/loader.conf
> debug.acpi.max_tasks="128"
> if_lagg_load="YES"
> kern.ipc.nmbclusters="131072"
> hw.igb.num_queues="1"
>
>
> I am wondering  why I have turned this on..
> My box has raidz2 ZFS box with SSD mirrored log..

We find that large numbers of queues causes high interrupt issues
however at a guess you did this to enable the machine to boot with
all nics due to lack of auto mbuf tuning in 9.x.

I'd go with ~2 queues per nic.

    Regards
    Steve