FreeBSD 8.0 ixgbe Poor Performance

[Stephen Sanders]

According to pciconf, the card is a "82598EB 10 Gigabit AF Dual Port
Network Connection". 

It looks to me like the card is plugged into a 4xPCIe slot.  I'm sure
this means we're not going to make the 10Gbps but I would imagine that
we should get north of 5 Gbps.

Is there a URL to pick the latest code up from or is the code the latest
STABLE check in for ixgbe?

Thanks.

On 4/21/2010 4:53 PM, Jack Vogel wrote:
> Use my new driver and it will tell you when it comes up with the slot
> speed is,
> and if its substandard it will SQUAWK loudly at you :)
>
> I think the S5000PAL only has Gen1 PCIE slots which is going to limit you
> somewhat. Would recommend a current generation (x58 or 5520 chipset)
> system if you want the full benefit of 10G.
>
> BTW, you dont way what adapter, 82598 or 82599, you are using?
>
> Jack
>
>
> On Wed, Apr 21, 2010 at 12:52 PM, Stephen Sanders
> <ssanders at softhammer.net <mailto:ssanders at softhammer.net>> wrote:
>
>     I'd be most pleased to get near 9k.
>
>     I'm running FreeBSD 8.0 amd64 on both of the the test hosts.  I've
>     reset
>     the configurations to system default as I was getting no where with
>     sysctl and loader.conf settings.
>
>     The motherboards have been configured to do MSI interrupts.  The
>     S5000PAL has a MSI to old style interrupt BIOS setting that
>     confuses the
>     driver interrupt setup.
>
>     The 10Gbps cards should be plugged into the 8x PCI-E slots on both
>     hosts.  I'm double checking that claim right now and will get back
>     later.
>
>     Thanks
>
>
>     On 4/21/2010 2:13 PM, Jack Vogel wrote:
>     > When you get into the 10G world  your performance will only be
>     as good
>     > as your weakest link, what I mean is if you connect to something
>     that has
>     > less than stellar bus and/or memory performance it is going to
>     throttle
>     > everything.
>     >
>     > Running back to back with two good systems you should be able to get
>     > near line rate (9K range).  Things that can effect that:  64 bit
>     kernel,
>     > TSO, LRO, how many queues come to mind.  The default driver config
>     > should get you there, so tell me more about your hardware/os
>     config??
>     >
>     > Jack
>     >
>     >
>     >
>     > On Wed, Apr 21, 2010 at 8:04 AM, Brandon Gooch
>     > <jamesbrandongooch at gmail.com
>     <mailto:jamesbrandongooch at gmail.com>>wrote:
>     >
>     >
>     >> On Wed, Apr 21, 2010 at 9:32 AM, Stephen Sanders
>     >> <ssanders at softhammer.net <mailto:ssanders at softhammer.net>> wrote:
>     >>
>     >>> I am running speed tests on a pair of systems equipped with
>     Intel 10Gbps
>     >>> cards and am getting poor performance.
>     >>>
>     >>> iperf and tcpdump testing indicates that the card is running
>     at roughly
>     >>> 2.5Gbps max transmit/receive.
>     >>>
>     >>> My attempts at turning fiddling with netisr, polling, and
>     varying the
>     >>> buffer sizes has been fruitless.  I'm sure there is something
>     that I'm
>     >>> missing so I'm hoping for suggestions.
>     >>>
>     >>> There are two systems that are connected head to head via
>      cross over
>     >>> cable.  The two systems have the same hardware configuration.  The
>     >>> hardware is as follows:
>     >>>
>     >>> 2 Intel E5430 (Quad core) @ 2.66 Ghz
>     >>> Intel S5000PAL Motherboard
>     >>> 16GB Memory
>     >>>
>     >>> My iperf command line for the client is:
>     >>>
>     >>> iperf -t 10 -c 169.0.0.1 -w 2.5M -l 2.5M
>     >>>
>     >>> My TCP dump test command lines are:
>     >>>
>     >>> tcpdump -i ix0 -w/dev/null
>     >>> tcpreplay -i ix0 -t -l 0 -K ./test.pcap
>     >>>
>     >> If you're running 8.0-RELEASE, you might try updating to 8-STABLE.
>     >> Jack Vogel recently committed updated Intel NIC driver code:
>     >>
>     >> http://svn.freebsd.org/viewvc/base/stable/8/sys/dev/ixgbe/
>     >>
>     >> -Brandon
>     >> _______________________________________________
>     >> freebsd-performance at freebsd.org
>     <mailto:freebsd-performance at freebsd.org> mailing list
>     >> http://lists.freebsd.org/mailman/listinfo/freebsd-performance
>     >> To unsubscribe, send any mail to "
>     >> freebsd-performance-unsubscribe at freebsd.org
>     <mailto:freebsd-performance-unsubscribe at freebsd.org>"
>     >>
>     >>
>     > _______________________________________________
>     > freebsd-performance at freebsd.org
>     <mailto:freebsd-performance at freebsd.org> mailing list
>     > http://lists.freebsd.org/mailman/listinfo/freebsd-performance
>     > To unsubscribe, send any mail to
>     "freebsd-performance-unsubscribe at freebsd.org
>     <mailto:freebsd-performance-unsubscribe at freebsd.org>"
>     >
>     >
>
>