ixgbe/ix sysctl missing in FreeBSD 9.2

[Jack Vogel]

Set the storm threshold to 0, that way you disable the check and don't have
to wonder
if its a problem :)

Given everything you've told me I'd suspect the switch... easy enough to
test, remove it
from the equation, run two systems back-to-back and see how that effects
the numbers.

Jack



On Thu, Oct 3, 2013 at 3:24 PM, Rumen Telbizov <telbizov at gmail.com> wrote:

> Jack,
>
> Thanks for the hints.
>
> I checked that the card is inserted into PCIe v3.0 x16 + I get no
> complaints from the driver.
> I checked for interrupt throttling messages in the logs - found nothing. I
> also set hw.intr_storm_threshold: 10000
> then I saw hw.igb.max_interrupt_rate: 8000 and figured that I should have
> hw.ix or hw.ixgbe which seems
> to have existed in the past but I don't have it.Also tried this
> dev.ix.0.enable_aim: 0 + dev.ix.1.enable_aim: 0
>
> I think I have enough mbufs:
> kern.ipc.nmbclusters=262144
> kern.ipc.nmbjumbop=262144
>
> I also tried doubling those.
>
> So after trying all those it still seems like I can't get past the
> 4-5Gbit/s barrier so I decided to ask.
> Now I start wondering if it has anything to do with the lacp/switch or even
> with that patch from Oleg which helped me overcome the problem with the
> flapping interface.
>
> If anything else comes to mind and there should be another knob to turn -
> feel free to suggest it.
>
> Thanks,
> Rumen Telbizov
>
>
> On Thu, Oct 3, 2013 at 3:15 PM, Jack Vogel <jfvogel at gmail.com> wrote:
>
> > Make sure you are in slots with enough lanes/bandwidth, the driver should
> > complain when loaded
> > if you aren't though. Make sure you aren't getting interrupts throttled,
> > and that you have sufficient
> > mbuf resources so you aren't waiting on those, that can make a BIG
> > difference.
> >
> > Jack
> >
> >
> >
> > On Thu, Oct 3, 2013 at 2:37 PM, Rumen Telbizov <telbizov at gmail.com>
> wrote:
> >
> >> Thanks Jack,
> >>
> >> So I am running a couple of FreeBSD machines with those and they are in
> >> LACP pair plus vlans on top of them.
> >> When I run iperf between the two I get about about 1.7Gbit/s with 1
> >> thread and I max out around 4.5-5Gbp/s with 6-8 multiple parallel
> threads
> >> (tried both UDP and TCP).
> >>
> >> What kind of tuning would you recommend that I try?
> >>
> >> Thanks,
> >> Rumen Telbizov
> >>
> >>
> >> On Thu, Oct 3, 2013 at 1:35 PM, Jack Vogel <jfvogel at gmail.com> wrote:
> >>
> >>> sysctl dev.ix.0 etc...
> >>>
> >>> Jack
> >>>
> >>>
> >>>
> >>> On Thu, Oct 3, 2013 at 12:35 PM, Rumen Telbizov <telbizov at gmail.com
> >wrote:
> >>>
> >>>> Hello everyone,
> >>>>
> >>>> I am trying to tweak some of the sysctl tunables for the ix (ixgbe)
> >>>> driver
> >>>> in FreeBSD 9.2 since I am experiencing less than ideal performance and
> >>>> it
> >>>> seems like I can't find any:
> >>>>
> >>>> # sysctl -a | grep -i ixgbe
> >>>> device    ixgbe
> >>>>
> >>>> I am running 9.2-RC4.
> >>>>
> >>>> Any input appreciated.
> >>>>
> >>>> Thanks,
> >>>> --
> >>>> Rumen Telbizov
> >>>> Unix Systems Administrator <http://telbizov.com>
> >>>> _______________________________________________
> >>>> freebsd-stable at freebsd.org mailing list
> >>>> http://lists.freebsd.org/mailman/listinfo/freebsd-stable
> >>>> To unsubscribe, send any mail to "
> >>>> freebsd-stable-unsubscribe at freebsd.org"
> >>>>
> >>>
> >>>
> >>
> >>
> >> --
> >> Rumen Telbizov
> >> Unix Systems Administrator <http://telbizov.com>
> >>
> >
> >
>
>
> --
> Rumen Telbizov
> Unix Systems Administrator <http://telbizov.com>
> _______________________________________________
> freebsd-stable at freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-stable
> To unsubscribe, send any mail to "freebsd-stable-unsubscribe at freebsd.org"
>