How to force IB cards to come up in IB mode?

[Justin Clift]

On 16 Apr 2016, at 15:55, Meny Yossefi <menyy at mellanox.com> wrote:
> Hi Justin,
> 
> 
> It seems as the pre-boot configuration didn't work.
> 
> loader.conf doesn't work on all sysctl params AFAIK.
> 
> 
> Is it a pre-boot only issue?
> 
> What is the current sysctl output for those ports?
> 
> Have you tried switching to IB after system was loaded?
> 
> 
> If I remember correctly, the driver was set for Eth configuration by default.
> 
> Of course, this is reversible..

Looking at the 10.3 code, this seems to be the port selection clause:

  https://github.com/freebsd/freebsd/blob/master/sys/ofed/drivers/net/mlx4/main.c#L706-L736

In the comments inside that clause, it says:

  "If IB and ETH are supported, we set the port type according to user
   selection of port type; if there is no user selection, take the FW hint"

  https://github.com/freebsd/freebsd/blob/master/sys/ofed/drivers/net/mlx4/main.c#L716-L718

There is no man page for mlx4, so I'm a bit stumped for how to select
the port type for "user selection" as mentioned there.

Any hints? :)

(And sure, things could be forced in the code with something like:

  dev->caps.port_type[i] = MLX4_PORT_TYPE_IB;

... for each of the ports.  But that's a temporary only solution and we
probably find the proper one instead. ;D

Regards and best wishes,

Justin Clift

--
"My grandfather once told me that there are two kinds of people: those
who work and those who take the credit. He told me to try to be in the
first group; there was less competition there."
- Indira Gandhi