InfiniBand supported hw

Chris Reeves chrisr at spectralogic.com
Thu May 26 19:00:59 UTC 2016


I've tried to LAGG two IPOIB ports in the past on FreeBSD, but was not successful.
I'm not certain, but I believe the following from sys/net/if_lagg.c is the issue:

        /* XXX Disallow non-ethernet interfaces (this should be any of 802) */
        if (ifp->if_type != IFT_ETHER) {
                LAGG_WUNLOCK(sc);
                return (EPROTONOSUPPORT);
        }

I think IPOIB is not considered an Ethernet port.
________________________________________
From: owner-freebsd-infiniband at freebsd.org <owner-freebsd-infiniband at freebsd.org> on behalf of Grzegorz Junka <list1 at gjunka.com>
Sent: Thursday, May 26, 2016 12:33 PM
To: freebsd-infiniband at freebsd.org
Subject: Re: InfiniBand supported hw

On 26/05/2016 17:44, John Nielsen wrote:
> On May 26, 2016, at 11:07 AM, Justin Clift <justin at postgresql.org> wrote:
>
>> On 26 May 2016, at 14:00, Grzegorz Junka <list1 at gjunka.com> wrote:
>>> Is 500EX-D supported on FreeBSD? I read that it's a Voltaire version and it is the same as Mellanox ConnectX, which supposed to be supported.
>> Yep, they should work.  You may need to flash them with their Mellanox equivalent
>> firmware, but I'm not sure.  (doing that flash isn't very hard btw)
>>
>>> Also, most InfiniBand cards provide two ports. When connecting two computers together (IPoIB) is it possible to use both ports to double the speed?
>> Not sure, as I've not needed to personally.  None of my storage (or other uses)
>> even fills one DDR port.  Yet. :)
>>
>> I *think* the answer to that is yes,
> It depends on what you mean by "use both ports." You can of course use both ports at the same time, but if you're envisioning something like an IPoIB version of an Ethernet LAGG I don't think that is supported.
>
> If you are using the IB for storage protocols, then active/active multipathing is one way to utilize the full bandwidth of multiple ports.
>
>>> Lastly, is NFS RDMA properly supported on FreeBSD?
>> Again not sure.  Other people here would likely know. :)
>

Yes, that's exactly what I was hoping for, a sort of LAGG to double the
speed of the link between computer by utilizing both ports together.
LAGG is independent from the network interface, if I could set up an
IPoIB NIC for each port separately what could prevent me from creating a
LAGG interface on top of them? And if that's not supported, what do
people usually do with the other interface? Just leave it unconnected?

Grzegorz
_______________________________________________
freebsd-infiniband at freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-infiniband
To unsubscribe, send any mail to "freebsd-infiniband-unsubscribe at freebsd.org"


More information about the freebsd-infiniband mailing list