mpt0 timeouts with an intel SASUC8I controller

[Thomas Vogt]

Hello

I've stability issue with my new intel SASUC8I [1] PCIe controller. It's a LSI 1068e based controller. After a few minutes with disk io (csup or scrub by example) my FreeBSD 8-stable (64bit) is "freezing" for a couple of minutes and I see a lot of error messages like:

Sep 17 03:10:03 gw kernel: mpt0: request 0xffffff80002bc3b0:48367 timed out for ccb 0xffffff00050a8000 (req->ccb 0xffffff00050a8000)
Sep 17 03:10:03 gw kernel: mpt0: request 0xffffff80002bbb40:48368 timed out for ccb 0xffffff0004f81800 (req->ccb 0xffffff0004f81800)
Sep 17 03:10:03 gw kernel: mpt0: completing timedout/aborted req 0xffffff80002bc3b0:48367
Sep 17 03:10:03 gw kernel: mpt0: completing timedout/aborted req 0xffffff80002bbb40:48368
Sep 17 03:10:03 gw kernel: mpt0: Timedout requests already complete. Interrupts may not be functioning

It takes minutes to execute commands after the first timeout message. The whole OS is running on single raidz ZFS pool. I use 4x 2TB SpinPoint F4 EcoGreen HD204UI disks with fixed firmware [2]. The disks are connected with brand new adaptec cables. I already replaced a cable to disqualify a cable issue. smartctl looks ok. The system is working fine if I connect all 4 disk to the the onboard controller. 

Is this an known issue with this controller and the mpt driver? Is there an workaround? I hope someone can help me.

Regards,
Thomas


FreeBSD Information:
8.2-STABLE FreeBSD 8.2-STABLE #3: Sun Jul  3 19:39:11 UTC 2011  root at gw.lan:/usr/obj/usr/src/sys/GENERIC  amd64

Motherboard:
smbios.planar.maker="ASUSTeK Computer INC."
smbios.planar.product="P5N73-AM"

Controller:
mptutil show adapter
mpt0 Adapter:
       Board Name: SASUC8I
   Board Assembly: L3-25071-00C
        Chip Name: C1068E
    Chip Revision: UNUSED
      RAID Levels: RAID0, RAID1, RAID1E
    RAID0 Stripes: 64k
   RAID1E Stripes: 64k
 RAID0 Drives/Vol: 2-10
 RAID1 Drives/Vol: 2

dmesg about the controller:
mpt0: <LSILogic SAS/SATA Adapter> port 0xee00-0xeeff mem 0xef7fc000-0xef7fffff,0xef7e0000-0xef7effff irq 16 at device 0.0 on pci2
mpt0: [ITHREAD]
mpt0: MPI Version=1.5.20.0
mpt0: Capabilities: ( RAID-0 RAID-1E RAID-1 )
mpt0: 0 Active Volumes (2 Max)
mpt0: 0 Hidden Drive Members (14 Max)

zpool status:
  pool: tank
 state: ONLINE
 scan: scrub canceled on Sun Sep 18 10:44:46 2011
config:

	NAME                                            STATE     READ WRITE CKSUM
	tank                                            ONLINE       0     0     0
	  raidz1-0                                      ONLINE       0     0     0
	    gptid/7cd20811-2af6-11e0-9271-e5dbd4b6b481  ONLINE       0     0     0
	    gptid/7d7af0fc-2af6-11e0-b0b1-85b4c14d926b  ONLINE       0     0     0
	    gptid/7e24b41a-2af6-11e0-944f-fb3dae8bad6a  ONLINE       0     0     0
	    gptid/dac06b61-972b-11e0-affc-1c6f65565b30  ONLINE       0     0     0

/boot/loader.conf:
zfs_load="YES"
vfs.root.mountfrom="zfs:tank/root"
aio_load="yes"
ahci_load="YES"
ataahci_load="YES"
ipfw_load="YES"
vm.kmem_size="6G"
vfs.zfs.arc_max="4G"
vfs.zfs.prefetch_disable="1"
vfs.zfs.txg.timeout="5"

rc.conf:
ipv6_firewall_enable="YES"
ipv6_firewall_type="OPEN"
sendmail_enable="NO"
sshd_enable="YES"
zfs_enable="YES"
firewall_enable="YES"
firewall_type="OPEN"

dmesg:
http://pastebin.com/sL15g1vt

smartctl:
http://pastebin.com/wYU2DXJ4

[1] http://www.intel.com/content/www/us/en/servers/raid/raid-controller-sasuc8i.html
[2] http://www.samsung.com/global/business/hdd/faqView.do?b2b_bbs_msg_id=386