igb Could not setup receive structures (again)

[David DeSimone]

Would it be possible for the driver to report how many clusters it calculated that it needs, whenever it runs into this memory shortage during attach?  That way an administrator might have some idea how much to increase their tunables in order to meet the driver's requirements.

As it is, it's merely a guessing game or requires digging into driver source to come up with the right numbers.


-----Original Message-----
From: owner-freebsd-net at freebsd.org [mailto:owner-freebsd-net at freebsd.org] On Behalf Of Jack Vogel
Sent: Friday, November 21, 2014 10:23 AM
To: Gerrit Kühn
Cc: FreeBSD Net
Subject: Re: igb Could not setup receive structures (again)

The message is pretty straightforward, its only cause is the inability
of the driver to get the necessary clusters to populate the RX rings.

After you get the error do a `netstat -m` and see what the state of the
9K jumbo pool is, for that is the size you would be using.

Depending on the specific device type you may have up to 8 rings
per interface, and with a ring size of 1K...

It does seem like you should have enough, but maybe something else
in your system is using the pool? As I said, look at netstat, it should give
you the truth, and then adjust the allocated size to fit your needs.

Jack


On Fri, Nov 21, 2014 at 2:48 AM, Gerrit Kühn <gerrit.kuehn at aei.mpg.de>
wrote:

> Hi all,
>
> I get the error message above when trying to go for jumbo frames (mtu
> 9000) on a system here. I found a lot of comments on this, but they all
> state that this is due to a too low setting for mbufs in FreeBSD8/9
> settings.
> However, I have 10-stable here, and the settings look rather high to me:
>
> kern.ipc.nmbclusters: 1014856
> kern.ipc.maxmbufmem: 8313700352
> kern.ipc.nmbufs: 6495090
> kern.ipc.nmbjumbop: 507428
> kern.ipc.nmbjumbo9: 451047
> kern.ipc.nmbjumbo16: 338284
>
> FreeBSD mclane 10.0-STABLE FreeBSD 10.0-STABLE #5 r261710: Mon Feb 10
> 16:55:29 CET 2014 root at mclane.rt.aei.uni-hannover.de:/usr/obj/usr/src/sys/GENERIC
> amd64
>
>
> Is this still too low? I have a 6core machine with 6 igb interfaces, and I
> cannot even get one of these set to mtu 9000 without getting "Could not
> setup receive structures".
>
>
> cu
>   Gerrit
> _______________________________________________
> freebsd-net at freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net-unsubscribe at freebsd.org"
>
_______________________________________________
freebsd-net at freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscribe at freebsd.org"
This email message is intended for the use of the person to whom it has been sent, and may contain information that is confidential or legally protected. If you are not the intended recipient or have received this message in error, you are not authorized to copy, distribute, or otherwise use this message or its attachments. Please notify the sender immediately by return e-mail and permanently delete this message and any attachments. Verio Inc. makes no warranty that this email is error or virus free. Thank you.