ixgbe/ix sysctl missing in FreeBSD 9.2

[Rumen Telbizov]

Jack,

Thanks for the hints.

I checked that the card is inserted into PCIe v3.0 x16 + I get no
complaints from the driver.
I checked for interrupt throttling messages in the logs - found nothing. I
also set hw.intr_storm_threshold: 10000
then I saw hw.igb.max_interrupt_rate: 8000 and figured that I should have
hw.ix or hw.ixgbe which seems
to have existed in the past but I don't have it.Also tried this
dev.ix.0.enable_aim: 0 + dev.ix.1.enable_aim: 0

I think I have enough mbufs:
kern.ipc.nmbclusters=262144
kern.ipc.nmbjumbop=262144

I also tried doubling those.

So after trying all those it still seems like I can't get past the
4-5Gbit/s barrier so I decided to ask.
Now I start wondering if it has anything to do with the lacp/switch or even
with that patch from Oleg which helped me overcome the problem with the
flapping interface.

If anything else comes to mind and there should be another knob to turn -
feel free to suggest it.

Thanks,
Rumen Telbizov


On Thu, Oct 3, 2013 at 3:15 PM, Jack Vogel <jfvogel at gmail.com> wrote:

> Make sure you are in slots with enough lanes/bandwidth, the driver should
> complain when loaded
> if you aren't though. Make sure you aren't getting interrupts throttled,
> and that you have sufficient
> mbuf resources so you aren't waiting on those, that can make a BIG
> difference.
>
> Jack
>
>
>
> On Thu, Oct 3, 2013 at 2:37 PM, Rumen Telbizov <telbizov at gmail.com> wrote:
>
>> Thanks Jack,
>>
>> So I am running a couple of FreeBSD machines with those and they are in
>> LACP pair plus vlans on top of them.
>> When I run iperf between the two I get about about 1.7Gbit/s with 1
>> thread and I max out around 4.5-5Gbp/s with 6-8 multiple parallel threads
>> (tried both UDP and TCP).
>>
>> What kind of tuning would you recommend that I try?
>>
>> Thanks,
>> Rumen Telbizov
>>
>>
>> On Thu, Oct 3, 2013 at 1:35 PM, Jack Vogel <jfvogel at gmail.com> wrote:
>>
>>> sysctl dev.ix.0 etc...
>>>
>>> Jack
>>>
>>>
>>>
>>> On Thu, Oct 3, 2013 at 12:35 PM, Rumen Telbizov <telbizov at gmail.com>wrote:
>>>
>>>> Hello everyone,
>>>>
>>>> I am trying to tweak some of the sysctl tunables for the ix (ixgbe)
>>>> driver
>>>> in FreeBSD 9.2 since I am experiencing less than ideal performance and
>>>> it
>>>> seems like I can't find any:
>>>>
>>>> # sysctl -a | grep -i ixgbe
>>>> device    ixgbe
>>>>
>>>> I am running 9.2-RC4.
>>>>
>>>> Any input appreciated.
>>>>
>>>> Thanks,
>>>> --
>>>> Rumen Telbizov
>>>> Unix Systems Administrator <http://telbizov.com>
>>>> _______________________________________________
>>>> freebsd-stable at freebsd.org mailing list
>>>> http://lists.freebsd.org/mailman/listinfo/freebsd-stable
>>>> To unsubscribe, send any mail to "
>>>> freebsd-stable-unsubscribe at freebsd.org"
>>>>
>>>
>>>
>>
>>
>> --
>> Rumen Telbizov
>> Unix Systems Administrator <http://telbizov.com>
>>
>
>


-- 
Rumen Telbizov
Unix Systems Administrator <http://telbizov.com>