NFS on 10G interface terribly slow

[Rick Macklem]

Scott Larson wrote:
> 82599 in our case. One problem I do have is the stack likes to blow up
> on occasion with the right combo of high load and high throughput while TSO
> is enabled, possibly relating to the 10.x driver issue you've pointed out.
> But when it comes to the throughput they'll blast 10G with no problem.
> 
Thanks for the info. So long as your mbuf cluster pool is large enough, I
think the m_defrag() calls will just result in increased CPU overheads and
probably don't introduce much delay.

I have no idea why the stack would blow up sometimes.
If you can catch the backtrace for one of these and post it, it might become
obvious. (Or you could just try increasing KSTACK_PAGES in sys/amd64/include/param.h
and see if the stack still blows up. Alternately, I think you can set KSTACK_PAGES in
your kernel config file.)

rick

> 
> *[image: userimage]Scott Larson[image: los angeles]
> <https://www.google.com/maps/place/4216+Glencoe+Ave,+Marina+Del+Rey,+CA+90292/@33.9892151,-118.4421334,17z/data=!3m1!4b1!4m2!3m1!1s0x80c2ba88ffae914d:0x14e1d00084d4d09c>Lead
> Systems Administrator[image: wdlogo] <https://www.wiredrive.com/> [image:
> linkedin] <https://www.linkedin.com/company/wiredrive> [image: facebook]
> <https://www.twitter.com/wiredrive> [image: twitter]
> <https://www.facebook.com/wiredrive> [image: instagram]
> <https://www.instagram.com/wiredrive>T 310 823 8238 x1106
> <310%20823%208238%20x1106>  |  M 310 904 8818 <310%20904%208818>*
> 
> On Mon, Jun 29, 2015 at 5:22 AM, Rick Macklem <rmacklem at uoguelph.ca> wrote:
> 
> > Gerrit Kuhn wrote:
> > > On Fri, 26 Jun 2015 20:42:08 -0400 (EDT) Rick Macklem
> > > <rmacklem at uoguelph.ca> wrote about Re: NFS on 10G interface terribly
> > slow:
> > >
> > > RM> Btw, can you tell us what Intel chip(s) you're using?
> > >
> > > I have
> > >
> > > ix0 at pci0:5:0:0: class=0x020000 card=0x00028086 chip=0x15288086 rev=0x01
> > > hdr=0x00 vendor     = 'Intel Corporation'
> > >     device     = 'Ethernet Controller 10-Gigabit X540-AT2'
> > >     class      = network
> > >     subclass   = ethernet
> > >
> > Yea, I don't know how to decode this either. I was actually interested in
> > what chip Scott was using and getting wire speed.
> > As noted in the other reply, since disabling TSO didn't help, you probably
> > aren't affected by this issue.
> >
> > rick
> >
> > > RM> For example, from the "ix" driver:
> > > RM> #define IXGBE_82598_SCATTER               100
> > > RM> #define IXGBE_82599_SCATTER               32
> > >
> > > Hm, I cannot find out into which chipset number this translates for my
> > > device...
> > >
> > > RM> Btw, it appears that the driver in head/current now sets
> > > RM> if_hw_tsomaxsegcount, but the driver in stable/10 does not. This
> > means
> > > RM> that the 82599 chip will end up doing the m_defrag() calls for 10.x.
> > >
> > > So the next step could even be updating to -current...
> > > OTOH, I get the same (bad) resulsts, no matter if TSO is enabled or
> > > disabled on the interface.
> > >
> > >
> > > cu
> > >   Gerrit
> > > _______________________________________________
> > > freebsd-net at freebsd.org mailing list
> > > http://lists.freebsd.org/mailman/listinfo/freebsd-net
> > > To unsubscribe, send any mail to "freebsd-net-unsubscribe at freebsd.org"
> > >
> >
> _______________________________________________
> freebsd-net at freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net-unsubscribe at freebsd.org"
>