kern/187312: LSI Logic Invader card fails at boot

Borja Marcos borjam at sarenet.es
Thu Mar 6 11:20:02 UTC 2014 

>Number:         187312
>Category:       kern
>Synopsis:       LSI Logic Invader card fails at boot
>Confidential:   no
>Severity:       non-critical
>Priority:       low
>Responsible:    freebsd-bugs
>State:          open
>Quarter:        
>Keywords:       
>Date-Required:
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Thu Mar 06 11:20:01 UTC 2014
>Closed-Date:
>Last-Modified:
>Originator:     Borja Marcos
>Release:        FreeBSD 10-STABLE
>Organization:
>Environment:
FreeBSD elibm 10.0-STABLE FreeBSD 10.0-STABLE #1: Tue Mar  4 09:36:48 UTC 2014     root@:/usr/obj/usr/src/sys/GENERIC  amd64

>Description:
There is some trouble with this LSI Logic RAID card:

mfi0 Adapter:
    Product Name: ServeRAID M5210e
   Serial Number: 3CJ0SG          
        Firmware: 24.0.2-0013
     RAID Levels: JBOD, RAID0, RAID1, RAID10
  Battery Backup: not present
           NVRAM: 32K
  Onboard Memory: 0M
  Minimum Stripe: 64K
  Maximum Stripe: 64K


It's an Invader series card. When booting from install media (for example, a memstick) FreeBSD detects the RAID volume (/dev/mfid0) without issues and the installation completes. There's just a warning message:

However, once the system is installed, FreeBSD is unable to boot. The loader works, the kernel starts, but it fails when trying to mount the root file system from /dev/mfid0p2.

It fails with 10-RELEASE and 10-STABLE.


The errors are:

mfi0: Adapter RESET condition is detected
mfi0: First step of FW reset initialized…
mfi0: ADP_RESET_TBOLT: Hostdiag=0xa0
mfi0: First stage of reset complete, second stage initialized…
mfi0: APJ ****requeue command 0xfffffe000104dfc0 index=120
mfi0: second stage of reset complete, FW is ready now.
mfi0: 11032 (boot + 3s/0x0020/info) - Firmware initialization started (PCI ID 005d/1000/045b/1014)
mfi0: 11033 (boot + 3s/0x0020/info) - Firmware version 4.200.21-2840
…

I haven't copied all the errors, last time I tried it finished entering an endless loop.

Interestingly, IT WORKS With 11-CURRENT. I can successfully install 11-CURRENT and boot normally.

>How-To-Repeat:
Create a RAID 1 volume (it's the only option I have tried) and install 10-RELEASE or 10-STABLE on /dev/mfid0, standard installation, no frills.

>Fix:
It works with 11-CURRENT.

Comparing the mfi driver betwen CURRENT and STABLE I noticed that there are three files with changes,

sys/dev/mfi/mfi_pci.c
sys/dev/mfi/mfi_tbolt.c
sys/dev/mvi/mfivar.h

http://svnweb.freebsd.org/base/head/sys/dev/mfi/mfi_pci.c?revision=261535&view=markup
http://svnweb.freebsd.org/base/head/sys/dev/mfi/mfi_tbolt.c?revision=261535&view=markup
http://svnweb.freebsd.org/base/head/sys/dev/mfi/mfivar.h?revision=261535&view=markup

I copied the three files on a -STABLE source tree checked out yesterday, built a kernel and tried. The -STABLE kernel with mfi compiled with these new files works. It can boot from /dev/mfid0 and mount /dev/mfid0p2 as the root file system.

mfi0: <Invader> port 0x4f00-0x4fff mem 0x913f0000-0x913fffff,0x91400000-0x914fffff irq 34 at device 0.0 on pci22
mfi0: Using MSI
mfi0: Megaraid SAS driver Ver 4.23 
mfi0: FW MaxCmds = 240, limiting to 128
mfi0: MaxCmd = 240, Drv MaxCmd = 128, MaxSgl = 70, state = 0xb73c00f0
mfi0: 11019 (447416787s/0x0020/info) - Shutdown command received from host
mfi0: 11020 (boot + 10s/0x0020/info) - Firmware initialization started (PCI ID 005d/1000/045b/1014)
mfi0: 11021 (boot + 10s/0x0020/info) - Firmware version 4.200.21-2840
mfi0: 11022 (boot + 12s/0x0020/info) - Package version 24.0.2-0013
mfi0: 11023 (boot + 12s/0x0020/info) - Board Revision  00AL055
mfi0: 11024 (boot + 33s/0x0002/info) - Inserted: PD 02(e0x3e/s25)
mfi0: 11025 (boot + 33s/0x0002/info) - Inserted: PD 02(e0x3e/s25) Info: enclPd=3e, scsiType=0, portMap=00, sasAddr=4433221102000000,0000000000000000
mfi0: 11026 (boot + 33s/0x0002/info) - PD 02(e0x3e/s25) FRU is 90Y8649
mfi0: 11027 (boot + 33s/0x0002/info) - Inserted: PD 03(e0x3e/s24)
mfi0: 11028 (boot + 33s/0x0002/info) - Inserted: PD 03(e0x3e/s24) Info: enclPd=3e, scsiType=0, portMap=01, sasAddr=4433221103000000,0000000000000000
mfi0: 11029 (boot + 33s/0x0002/info) - PD 03(e0x3e/s24) FRU is 90Y8649
mfi0: 11030 (447416847s/0x0020/info) - Time established as 03/06/14 10:27:27; (33 seconds since power on)

mfi0: 11031 (447416924s/0x0020/info) - Time established as 03/06/14 10:28:44; (111 seconds since power on)
mfi0: 11032 (boot + 3s/0x0020/info) - Firmware initialization started (PCI ID 005d/1000/045b/1014)
mfi0: 11033 (boot + 3s/0x0020/info) - Firmware version 4.200.21-2840
mfi0: 11034 (447417030s/0x0020/CRIT) - Controller encountered a fatal error and was reset
mfi0: 11035 (447417032s/0x0020/info) - Package version 24.0.2-0013
mfi0: 11036 (447417032s/0x0020/info) - Board Revision  00AL055
mfi0: 11037 (447417052s/0x0002/info) - Inserted: PD 02(e0x3e/s25)
mfi0: 11038 (447417052s/0x0002/info) - Inserted: PD 02(e0x3e/s25) Info: enclPd=3e, scsiType=0, portMap=00, sasAddr=4433221102000000,0000000000000000
mfi0: 11039 (447417052s/0x0002/info) - PD 02(e0x3e/s25) FRU is 90Y8649
mfi0: 11040 (447417052s/0x0002/info) - Inserted: PD 03(e0x3e/s24)
mfi0: 11041 (447417052s/0x0002/info) - Inserted: PD 03(e0x3e/s24) Info: enclPd=3e, scsiType=0, portMap=01, sasAddr=4433221103000000,0000000000000000
mfi0: 11042 (447417052s/0x0002/info) - PD 03(e0x3e/s24) FRU is 90Y8649
mfi0: 11043 (447417052s/0x0020/info) - Controller Hot Plug detected
mfi0: 11044 (boot + 10s/0x0020/info) - Firmware initialization started (PCI ID 005d/1000/045b/1014)

mfi0: 11045 (boot + 10s/0x0020/info) - Firmware version 4.200.21-2840
mfi0: 11046 (boot + 12s/0x0020/info) - Package version 24.0.2-0013
mfi0: 11047 (boot + 12s/0x0020/info) - Board Revision  00AL055
mfi0: 11048 (boot + 32s/0x0002/info) - Inserted: PD 02(e0x3e/s25)
mfi0: 11049 (boot + 32s/0x0002/info) - Inserted: PD 02(e0x3e/s25) Info: enclPd=3e, scsiType=0, portMap=00, sasAddr=4433221102000000,0000000000000000
mfi0: 11050 (boot + 32s/0x0002/info) - PD 02(e0x3e/s25) FRU is 90Y8649
mfi0: 11051 (boot + 32s/0x0002/info) - Inserted: PD 03(e0x3e/s24)
mfi0: 11052 (boot + 32s/0x0002/info) - Inserted: PD 03(e0x3e/s24) Info: enclPd=3e, scsiType=0, portMap=01, sasAddr=4433221103000000,0000000000000000
mfi0: 11053 (boot + 32s/0x0002/info) - PD 03(e0x3e/s24) FRU is 90Y8649
mfi0: 11054 (447417194s/0x0020/info) - Time established as 03/06/14 10:33:14; (32 seconds since power on)
mfi0: 11055 (447417277s/0x0020/info) - Time established as 03/06/14 10:34:37; (115 seconds since power on)

mfid0 on mfi0
mfid0: 121116MB (248045568 sectors) RAID volume (no label) is optimal
mfi0: Failed to get command
mfi0: <Invader> port 0x4f00-0x4fff mem 0x913f0000-0x913fffff,0x91400000-0x914fffff irq 34 at device 0.0 on pci22
mfi0: Using MSI
mfi0: Megaraid SAS driver Ver 4.23 
mfi0: FW MaxCmds = 240, limiting to 128
mfi0: MaxCmd = 240, Drv MaxCmd = 128, MaxSgl = 70, state = 0xb73c00f0
mfi0: 11056 (447417497s/0x0020/info) - Shutdown command received from host
mfi0: 11057 (boot + 10s/0x0020/info) - Firmware initialization started (PCI ID 005d/1000/045b/1014)
mfi0: 11058 (boot + 10s/0x0020/info) - Firmware version 4.200.21-2840
mfi0: 11059 (boot + 12s/0x0020/info) - Package version 24.0.2-0013
mfi0: 11060 (boot + 12s/0x0020/info) - Board Revision  00AL055
mfi0: 11061 (boot + 33s/0x0002/info) - Inserted: PD 02(e0x3e/s25)



mfi0: 11062 (boot + 33s/0x0002/info) - Inserted: PD 02(e0x3e/s25) Info: enclPd=3e, scsiType=0, portMap=00, sasAddr=4433221102000000,0000000000000000
mfi0: 11063 (boot + 33s/0x0002/info) - PD 02(e0x3e/s25) FRU is 90Y8649
mfi0: 11064 (boot + 33s/0x0002/info) - Inserted: PD 03(e0x3e/s24)
mfi0: 11065 (boot + 33s/0x0002/info) - Inserted: PD 03(e0x3e/s24) Info: enclPd=3e, scsiType=0, portMap=01, sasAddr=4433221103000000,0000000000000000
mfi0: 11066 (boot + 33s/0x0002/info) - PD 03(e0x3e/s24) FRU is 90Y8649
mfi0: 11067 (447417556s/0x0020/info) - Time established as 03/06/14 10:39:16; (33 seconds since power on)
mfi0: 11068 (447417632s/0x0020/info) - Time established as 03/06/14 10:40:32; (110 seconds since power on)
mfid0 on mfi0
mfid0: 121116MB (248045568 sectors) RAID volume (no label) is optimal
Trying to mount root from ufs:/dev/mfid0p2 [rw]...




There's still some problem with the driver (see  the "fatal error" message) but at least it works. I'm going to do some checks, run some heavy I/O activity to see if it can be reliable.

In case this solves the issue, could the above mentioned changes be backported to 10-STABLE?



>Release-Note:
>Audit-Trail:
>Unformatted:

More information about the freebsd-bugs mailing list