IBSRP and switches
ronc at lanl.gov
Tue Feb 10 18:01:09 UTC 2015
On 02/10/2015 10:39 AM, John Nielsen wrote:
> On Feb 10, 2015, at 9:19 AM, Ron Croonenberg <ronc at lanl.gov> wrote:
>> From what I understand IBSRP is a point to point protocol and cannot be switched over an IB switch, correct? (and the presented devices cannot be see by initiators 'through' a switch.
> At $work we use SRP over InfiniBand with lots of switches in the mix. Never had an issue.
Ok, I'll try some of that. I assume you were able to see all drives on
all ports. What I am trying to do is see all drives on all hosts
(connected to a switch). IBSRP seems to be 'point to point' So I wonder
if it (ibsrp) will let me mount a drive multiple times. (I am doing this
in a 'not so posix' kind of way)
>> Is there a 'scsi protocol' that I can run over IB that can be switched?
> Unfortunately, there isn't currently SRP support on FreeBSD. There is RDMA support, so it might be feasible to port the SRP code from Linux, but I haven't really looked in to it.
That is why I am looking into it this way, because of RDMA.
There is also something called ISER (iSCSI extensions over RDMA)
> There's always iSCSI. FreeBSD 10.0 saw the addition of the kernel-based target and initiator (with some improvements since), but I don't think it takes advantage of RDMA or other acceleration techniques when used with InfiniBand. I'd love to be wrong. :)
right, but I am trying to go for the highest performance that is reliable.
More information about the freebsd-infiniband