[Bug 273263] isp(4): 32Gbit Qlogic cards do not work

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=273263

            Bug ID: 273263
           Summary: isp(4): 32Gbit Qlogic cards do not work
           Product: Base System
           Version: CURRENT
          Hardware: amd64
                OS: Any
            Status: New
          Severity: Affects Some People
          Priority: ---
         Component: kern
          Assignee: bugs@FreeBSD.org
          Reporter: vermaden@interia.pl

Created attachment 244253
  --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=244253&action=edit
DEBUG_WITH_ISPFW.tar.gz

TL;DR
This will be quite long bug report so to summarize it:

32 Gbit/s Qlogic cards does not work with isp(4) driver on Lenovo ThinkSystem
SR665 system.

We have tried everything and still are not able to make them work:
- we tried internal card firmware
- we tried FreeBSD firmware with ISPFW="YES"
- we tried CUSTOM kernel with ISP_TARGET_MODE
- we tried 13.2-RELEASE and 13.2-STABLE and 14.1-ALPHA1 (and earlier 14.x
series) and TrueNAS
- UEFI boot
- legacy CSM/BIOS boot

Automatic switching the Qlogic card to initiator mode during kernel boot leads
to a detachment of the card (can be prevented with ISP_TARGET_MODE kernel
option).

Switching the card with sysctl dev.isp.X.role=2 shows:
- Mailbox Command 'INIT FIRMWARE' failed (HOST INTERFACE ERROR)
... and does not bring the card online.

Now ...

According to isp(4) following cards are supported:

- Qlogic 2740/2742/2764 (aka 2722/2714)
    Optical 32Gb Fibre Channel PCIe cards.

The cards we have itself identify in BIOS as QLE2742 model.

FreeBSD sees them as 2722 model: (maybe that is the root cause but we do nt
know)

  isp0: <Qlogic ISP 2722 PCI FC Adapter> mem
0x60170105000-0x60170105fff,0x60170102000-0x60170103fff,0x60170000000-0x601700fffff
irq 248 at device 0.0 numa-domain 1 on pci29

  isp0@pci0:129:0:0:      class=0x0c0400 rev=0x01 hdr=0x00 vendor=0x1077
device=0x2261 subvendor=0x1077 subdevice=0x02b3
      vendor     = 'QLogic Corp.'
      device     = 'ISP2722-based 16/32Gb Fibre Channel to PCIe Adapter'
      class      = serial bus
      subclass   = Fibre Channel

The Qlogic cards have firmware version 8.07.00 (2017).

The firmware which is installed on the card is:
  isp0: Board Type 2700, Chip Revision 0x1, resident F/W Revision 8.8.231

One of errors:
  isp0: Internal Firmware Error @ RISC Address 0xf9c2 !!!

I will attach each group of logs as separate attachment to make it more
readable:

- WITHOUT_ISPFW.tar.gz
- WITH_ISPFW.tar.gz
- DEBUG_WITHOUT_ISPFW.tar.gz
- DEBUG_WITH_ISPFW.tar.gz

We're not sure whether the firmware upload to the card works and do not
understand the kernel message in verbose mode as we have two 2742 cards built
into the system.

I hope that would organize the bug report more.

Thanks in advance for any help.

Regards,
vermaden

-- 
You are receiving this mail because:
You are the assignee for the bug.