Infiniband under FreeBSD 11.0-CURRENT...

[Hans Petter Selasky]

On 01/06/15 07:48, Hans Petter Selasky wrote:
> On 01/06/15 00:12, Karl Pielorz wrote:
>>
>> Hi,
>>
>> I just built a couple of 11.0-CURRENT r275655M amd64 boxes up, both with:
>>
>> "
>> MT25418 [ConnectX VPI PCIe 2.0 2.5GT/s - IB DDR / 10GigE]
>> "
>>
>> Cards in that appear after boot as 'mlxen0' and 'mlxen1' (they're dual
>> port cards).
>>
>> I'd previously run these cards with FreeBSD 10.0. I noticed the
>> Infiniband options seem to be in GENERIC now, and opensm/ibstat appears
>> to be in base.
>>
>> But neither work, i.e.
>>
>> "
>> #ibstat
>> ibpanic: [1343] main: stat of IB device 'mthca0' failed: (m)
>> "
>>
>> And,
>>
>> "
>> #opensm
>> ...
>> No local ports detected!
>>
>> Error from osm_opensm_bind (0x2A)
>> Perhaps another instance of OpenSM is already running
>> Exiting SM
>> "
>>
>>
>> Things have obviously changed since 10.0 (and I realise this is work in
>> progress) - is there a setup guide or anywhere I can lookup how to get
>> this working? [presuming it does work :)]
>>
>
> Hi,
>
> Did you set the following sysctl(s) to specify the port mode:
>
> sysctl -a | grep eth
>
> sys.device.mlx4_core0.mlx4_port1: eth
> sys.device.mlx4_core0.mlx4_port2: eth
> sys.device.mlx4_core1.mlx4_port1: eth
> sys.device.mlx4_core1.mlx4_port2: eth
>
> --HPS

Valid options are: eth and ib

--HPS