How to chnge Datagram/Connected modes at FreeBSD?

Alex Liptsin alexl at
Tue May 28 12:09:00 UTC 2013


I work with FreeBSD 9.1 and Mellanox devices.

How can I configure MTU in connected mode on FreeBSD 9.1?
In Linux to enable connected mode for interface ib0, I enter:

   echo connected > /sys/class/net/ib0/mode

Switching between CM and UD mode can be done in run time:

   echo datagram > /sys/class/net/ib0/mode sets the mode of ib0 to UD

   echo connected > /sys/class/net/ib0/mode sets the mode ib0 to CM

There is no such directories at FreeBSD. Wat shall I do?

Datagram vs Connected modes

  The IPoIB driver supports two modes of operation: datagram and
  connected.  The mode is set and read through an interface's
  /sys/class/net/<intf name>/mode file.

  In datagram mode, the IB UD (Unreliable Datagram) transport is used
  and so the interface MTU has is equal to the IB L2 MTU minus the
  IPoIB encapsulation header (4 bytes).  For example, in a typical IB
  fabric with a 2K MTU, the IPoIB MTU will be 2048 - 4 = 2044 bytes.

  In connected mode, the IB RC (Reliable Connected) transport is used.
  Connected mode takes advantage of the connected nature of the IB
  transport and allows an MTU up to the maximal IP packet size of 64K,
  which reduces the number of IP packets needed for handling large UDP
  datagrams, TCP segments, etc and increases the performance for large

  In connected mode, the interface's UD QP is still used for multicast
  and communication with peers that don't support connected mode. In
  this case, RX emulation of ICMP PMTU packets is used to cause the
  networking stack to use the smaller UD MTU for these neighbours.

Thanks a lot

Alex Liptsin
Software Quality Assurance Engineer | Mellanox Technologies Ltd.
Office: +972 (74) 7236141
Mobile: +972(54) 7833986
Fax: +972(74) 7236161
Email: alexl at<mailto:alexl at>
Mellanox, Tel-Hai Industrial Park. Building 7, M.P. Upper Galilee 12100 Israel

More information about the freebsd-infiniband mailing list