Ib0 not working unless i unload ipoib and load it again.

Mihai Vintila unixro at gmail.com
Sun Jun 14 19:12:14 UTC 2015

Same behavior:
  sysctl -w sys.device.mlx4_core0.mlx4_port1=ib
sys.device.mlx4_core0.mlx4_port1: eth -> ib
  ifconfig ib0
ib0: flags=8043<UP,BROADCAST,RUNNING,MULTICAST> metric 0 mtu 2044
         inet netmask 0xffffff00 broadcast

PING ( 56 data bytes
ping: sendto: No route to host
ping: sendto: No route to host

Might worth to mention that this host also holds opensm, and i actually 
need to run opensm first next unload/load the module.
But i rather expect that the ib0 state changes along mlx4_core0 state.

Best regards,
Vintila Mihai Alexandru

On 6/14/2015 9:57 PM, Hans Petter Selasky wrote:
> Hi,
> On 06/14/15 20:40, Mihai Vintila wrote:
>> Another strange issue. Is that i have:
>> /boot/loader.conf
>> mlx4_core="YES"
>> ibcore_load="YES"
>> mlxen_load="YES"
>> mlx4ib_load="YES"
>> ipoib_load="YES"
> If you remove this line from sysctl.conf and run it from the command 
> line instead, does it work then?
>> and in sysctl.conf
>> sys.device.mlx4_core0.mlx4_port1=ib
>> Only when it boots ib0 is not functional. From what i've noticed if
>> after mlx4_core0 is up i remove ipoib module and add it again it's 
>> working.
>> Bellow is a small output from dmesg in which i unload/load ipoib at boot
>> in rc.local and interface still doesn't work and after port is up i do
>> it manually and it starts working:
>> ib0: Attached to mlx4_0 port 1
>> ums0: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 2>
>> on usbus0
>> ums0: 3 buttons and [Z] coordinates ID=0
>> ib0: link state changed to DOWN
>> ib0: Attached to mlx4_0 port 1
>> mlx4_core0: mlx4_ib: Port 1 logical link is up
>> ib0: link state changed to DOWN
>> ib0: Attached to mlx4_0 port 1
>> ib0: link state changed to UP
>> in ifconfig only difference is a new lladdr for ib0.
> --HPS

More information about the freebsd-infiniband mailing list