ix(intel) vs mlxen(mellanox) 10Gb performance

[Slawa Olhovchenkov]

On Sun, Aug 23, 2015 at 02:08:56PM +0300, Daniel Braniss wrote:

> >> send me the patch and I'll test it ASAP.
> >> 	danny
> >> 
> > Patch is attached. The one for head will also include an update to the comment
> > in sys/net/if_var.h, but that isn't needed for testing.
> 
> 
> well, the plot thickens.
> 
> Yesterday, before running the new kernel, I decided to re run my test, and to my surprise
> i was getting good numbers, about 300MGB/s with and without TSO.
> 
> this morning, the numbers were again bad, around 70MGB/s,what the ^%$#@!
> 
> so, after some coffee, I run some more tests, and some conclusions:
> using a netapp(*) as the nfs client:
>   - doing 
> 	ifconfig ix0 tso or -tso
>     does some magic and numbers are back to normal - for a while
> 
> using another Fbsd/zfs as client all is nifty, actually a bit faster than the netapp (not a fair
> comparison, since the zfs client is not heavily used) and I can't see any degradation.
>  
> btw, this is with the patch applied, but was seeing similar numbers before the patch.
> 
> running with tso, initially I get around 300MGB/s, but after a while(sorry can't be more scientific)
> it drops down to about half,  and finally to a pathetic 70MGB/s
> 
> *: while running the tests I monitored the Netapp, and nothing out of the ordinary there.

Can you do this
https://lists.freebsd.org/pipermail/freebsd-stable/2015-August/083138.html ?