[Bug 231192] cxl: nic does not work after reboot

[bugzilla-noreply at freebsd.org]

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=231192

            Bug ID: 231192
           Summary: cxl: nic does not work after reboot
           Product: Base System
           Version: 11.2-RELEASE
          Hardware: Any
                OS: Any
            Status: New
          Severity: Affects Only Me
          Priority: ---
         Component: kern
          Assignee: bugs at FreeBSD.org
          Reporter: marius.halden at modirum.com

Hi,

We use some Chelsio T540-CR NICs and after upgrading to 11.2 from 11.1 we have
run into an issue where the NICs don't forward any traffic after rebooting
them. If we unplug the SFPs and then reinsert them everything will start
working. Looking at ifconfig everything looks normal and ifconfig down/up does
not help. The SFPs we are experiencing the issue with are 1Gbit CWDM optics,
our 10Gbit DAC cables are working correctly. I'm unable to find anything
specific in the log about what is happening, but interface frame counters say
we are sending packets, but nothing is received at the other end and we are not
receiving any thing at all according to the same counters.

Looking at the hw.t5nex.0.misc.devlog I noticed a line containing
"hw_mac_init_port[0], …" is always logged when it works, but never when it
doesn't work. Otherwise the there is not anything obvious to me in that log.
(Full log can be found in the original email thread[1].)

After downgrading the firmware from 1.19.1.0 to 1.16.45.0 and disabling
automatic upgrade in loader.conf everything works as expected, even on 11.2.

[1]: https://lists.freebsd.org/pipermail/freebsd-net/2018-August/051420.html

-- 
You are receiving this mail because:
You are the assignee for the bug.