IBSRP and switches

[Ron Croonenberg]

On 02/10/2015 10:39 AM, John Nielsen wrote:
> On Feb 10, 2015, at 9:19 AM, Ron Croonenberg <ronc at lanl.gov> wrote:
>
>>  From what I understand IBSRP is a point to point protocol and cannot be switched over an IB switch, correct? (and the presented devices cannot be see by initiators 'through' a switch.
>
> At $work we use SRP over InfiniBand with lots of switches in the mix. Never had an issue.
>

Ok, I'll try some of that.  I assume you were able to see all drives on 
all ports. What I am trying to do is see all drives on all hosts 
(connected to a switch). IBSRP seems to be 'point to point' So I wonder 
if it (ibsrp) will let me mount a drive multiple times. (I am doing this 
in a 'not so posix' kind of way)

>> Is there a 'scsi protocol' that I can run over IB that can be switched?
>
> Unfortunately, there isn't currently SRP support on FreeBSD. There is RDMA support, so it might be feasible to port the SRP code from Linux, but I haven't really looked in to it.

That is why I am looking into it this way, because of RDMA.

There is also something called ISER (iSCSI extensions over RDMA)

> There's always iSCSI. FreeBSD 10.0 saw the addition of the kernel-based target and initiator (with some improvements since), but I don't think it takes advantage of RDMA or other acceleration techniques when used with InfiniBand. I'd love to be wrong. :)

right, but I am trying to go for the highest performance that is reliable.

> JN
>


Ron