5.3-RELEASE-p5 reboots, ahd(4) debug messages on reboot

Leroy van Logchem leroy.vanlogchem at wldelft.nl
Wed Mar 16 02:35:58 PST 2005


Hello,

Our fileserver with a raid cabinet attached reboots about every two
weeks. What could be causing this?

OS Version: FreeBSD 5.3-RELEASE-p5
Server brand: Supermicro 6018-P8
Server purpose: Hosting files using Samba 3 and NFS with 400 clients.
SCSI cabinet: 2U EonStore A08-G1410. A RAID5+1 being exported as single
U160 device to the HBA.

Boot messages after crash:

Mar 10 10:09:21 <kern.crit> filer kernel: Waiting 15 seconds for SCSI 
devices to settle
Mar 10 10:09:21 <kern.crit> filer kernel: ahd0: Invalid Sequencer 
interrupt occurred.
Mar 10 10:09:21 <kern.crit> filer kernel: >>>>>>>>>>>>>>>>>> Dump Card 
State Begins <<<<<<<<<<<<<<<<<
Mar 10 10:09:21 <kern.crit> filer kernel: ahd0: Dumping Card State at 
program address 0x23b Mode 0x0
Mar 10 10:09:21 <kern.crit> filer kernel: Card was paused
Mar 10 10:09:21 <kern.crit> filer kernel: INTSTAT[0x0] SELOID[0x0] 
SELID[0x10] HS_MAILBOX[0x0]
Mar 10 10:09:21 <kern.crit> filer kernel: INTCTL[0x80]:(SWTMINTMASK) 
SEQINTSTAT[0x0] SAVED_MODE[0x11]
Mar 10 10:09:21 <kern.crit> filer kernel: 
DFFSTAT[0x33]:(CURRFIFO_NONE|FIFO0FREE|FIFO1FREE)
Mar 10 10:09:21 <kern.crit> filer kernel: SCSISIGI[0x0]:(P_DATAOUT) 
SCSIPHASE[0x0] SCSIBUS[0x0]
Mar 10 10:09:21 <kern.crit> filer kernel: 
LASTPHASE[0x1]:(P_DATAOUT|P_BUSFREE) SCSISEQ0[0x0]
Mar 10 10:09:21 <kern.crit> filer kernel: 
SCSISEQ1[0x12]:(ENAUTOATNP|ENRSELI) SEQCTL0[0x0] 
SEQINTCTL[0x6]:(INTMASK1|INTMASK2)
Mar 10 10:09:21 <kern.crit> filer kernel: SEQ_FLAGS[0x0] SEQ_FLAGS2[0x0] 
QFREEZE_COUNT[0x3]
Mar 10 10:09:21 <kern.crit> filer kernel: KERNEL_QFREEZE_COUNT[0x3] 
MK_MESSAGE_SCB[0xff00] MK_MESSAGE_SCSIID[0xff]
Mar 10 10:09:21 <kern.crit> filer kernel: SSTAT0[0x0] SSTAT1[0x0] 
SSTAT2[0x0] SSTAT3[0x0] PERRDIAG[0x0]
Mar 10 10:09:21 <kern.crit> filer kernel: 
SIMODE1[0xa4]:(ENSCSIPERR|ENSCSIRST|ENSELTIMO) LQISTAT0[0x0]
Mar 10 10:09:21 <kern.crit> filer kernel: LQISTAT1[0x0] LQISTAT2[0x0] 
LQOSTAT0[0x0] LQOSTAT1[0x0]
Mar 10 10:09:21 <kern.crit> filer kernel: LQOSTAT2[0x0]
Mar 10 10:09:21 <kern.crit> filer kernel:
Mar 10 10:09:21 <kern.crit> filer kernel: SCB Count = 16 CMDS_PENDING = 
0 LASTSCB 0xffff CURRSCB 0xf NEXTSCB 0xff00
Mar 10 10:09:21 <kern.crit> filer kernel: qinstart = 39 qinfifonext = 39
Mar 10 10:09:21 <kern.crit> filer kernel: QINFIFO:
Mar 10 10:09:21 <kern.crit> filer kernel: WAITING_TID_QUEUES:
Mar 10 10:09:21 <kern.crit> filer kernel: Pending list:
Mar 10 10:09:21 <kern.crit> filer kernel: Total 0
Mar 10 10:09:21 <kern.crit> filer kernel: Kernel Free SCB list: 15 14 9 
1 2 3 4 5 6 7 8 10 11 12 13 0
Mar 10 10:09:21 <kern.crit> filer kernel: Sequencer Complete DMA-inprog 
list:
Mar 10 10:09:21 <kern.crit> filer kernel: Sequencer Complete list:
Mar 10 10:09:21 <kern.crit> filer kernel: Sequencer DMA-Up and Complete 
list:
Mar 10 10:09:21 <kern.crit> filer kernel: Sequencer On QFreeze and 
Complete list:
Mar 10 10:09:21 <kern.crit> filer kernel:
Mar 10 10:09:21 <kern.crit> filer kernel:
Mar 10 10:09:21 <kern.crit> filer kernel: ahd0: FIFO0 Free, LONGJMP == 
0x8000, SCB 0xe
Mar 10 10:09:21 <kern.crit> filer kernel: 
SEQIMODE[0x3f]:(ENCFG4TCMD|ENCFG4ICMD|ENCFG4TSTAT|ENCFG4ISTAT|ENCFG4DATA|ENSAVEPTRS)
Mar 10 10:09:21 <kern.crit> filer kernel: SEQINTSRC[0x0] DFCNTRL[0x0] 
DFSTATUS[0x89]:(FIFOEMP|HDONE|PRELOAD_AVAIL)
Mar 10 10:09:21 <kern.crit> filer kernel: 
SG_CACHE_SHADOW[0x2]:(LAST_SEG) SG_STATE[0x0] DFFSXFRCTL[0x0]
Mar 10 10:09:21 <kern.crit> filer kernel: SOFFCNT[0x0] 
MDFFSTAT[0x5]:(FIFOFREE|DLZERO) SHADDR = 0x00, SHCNT = 0x0
Mar 10 10:09:21 <kern.crit> filer kernel: HADDR = 0x00, HCNT = 0x0 
CCSGCTL[0x10]:(SG_CACHE_AVAIL)
Mar 10 10:09:21 <kern.crit> filer kernel:
Mar 10 10:09:21 <kern.crit> filer kernel: ahd0: FIFO1 Free, LONGJMP == 
0x8063, SCB 0xf
Mar 10 10:09:21 <kern.crit> filer kernel: 
SEQIMODE[0x3f]:(ENCFG4TCMD|ENCFG4ICMD|ENCFG4TSTAT|ENCFG4ISTAT|ENCFG4DATA|ENSAVEPTRS)
Mar 10 10:09:21 <kern.crit> filer kernel: SEQINTSRC[0x0] DFCNTRL[0x0] 
DFSTATUS[0x89]:(FIFOEMP|HDONE|PRELOAD_AVAIL)
Mar 10 10:09:21 <kern.crit> filer kernel: 
SG_CACHE_SHADOW[0x2]:(LAST_SEG) SG_STATE[0x0] DFFSXFRCTL[0x0]
Mar 10 10:09:21 <kern.crit> filer kernel: SOFFCNT[0x0] 
MDFFSTAT[0x5]:(FIFOFREE|DLZERO) SHADDR = 0x00, SHCNT = 0x0
Mar 10 10:09:21 <kern.crit> filer kernel: HADDR = 0x00, HCNT = 0x0 
CCSGCTL[0x10]:(SG_CACHE_AVAIL)
Mar 10 10:09:21 <kern.crit> filer kernel: LQIN: 0x8 0x0 0x0 0xe 0x0 0x1 
0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0
Mar 10 10:09:21 <kern.crit> filer kernel: ahd0: LQISTATE = 0x0, LQOSTATE 
= 0x0, OPTIONMODE = 0x42
Mar 10 10:09:21 <kern.crit> filer kernel: ahd0: OS_SPACE_CNT = 0x20 
MAXCMDCNT = 0x1
Mar 10 10:09:21 <kern.crit> filer kernel: ahd0: SAVED_SCSIID = 0x0 
SAVED_LUN = 0x0
Mar 10 10:09:21 <kern.crit> filer kernel:
Mar 10 10:09:21 <kern.crit> filer kernel: SIMODE0[0xc]:(ENOVERRUN|ENIOERR)
Mar 10 10:09:21 <kern.crit> filer kernel: CCSCBCTL[0x4]:(CCSCBDIR)
Mar 10 10:09:21 <kern.crit> filer kernel: ahd0: REG0 == 0xd501, SINDEX = 
0x10e, DINDEX = 0x102
Mar 10 10:09:21 <kern.crit> filer kernel: ahd0: SCBPTR == 0xe, SCB_NEXT 
== 0xff00, SCB_NEXT2 == 0xff36
Mar 10 10:09:21 <kern.crit> filer kernel: CDB 12 20 0 80 8 55
Mar 10 10:09:21 <kern.crit> filer kernel: STACK: 0x236 0x2 0x0 0x0 0x0 
0x0 0x0 0x0
Mar 10 10:09:21 <kern.crit> filer kernel: <<<<<<<<<<<<<<<<< Dump Card 
State Ends >>>>>>>>>>>>>>>>>>
Mar 10 10:09:21 <kern.crit> filer kernel: ses0 at ahd0 bus 0 target 6 lun 0
Mar 10 10:09:21 <kern.crit> filer kernel: ses0: <SUPER GEM318 0> Fixed 
Processor SCSI-2 device
Mar 10 10:09:21 <kern.crit> filer kernel: ses0: 3.300MB/s transfers
Mar 10 10:09:21 <kern.crit> filer kernel: ses0: SAF-TE Compliant Device
Mar 10 10:09:21 <kern.crit> filer kernel: Copied 18 bytes of sense data 
offset 12: 0x70 0x0 0x6 0x0 0x0 0x0 0x0 0xa 0x0 0x0 0x0 0x0 0x29 0x2 0x2 
0x0 0x0 0x0
Mar 10 10:09:21 <kern.crit> filer kernel: Copied 18 bytes of sense data 
offset 12: 0x70 0x0 0x6 0x0 0x0 0x0 0x0 0xa 0x0 0x0 0x0 0x0 0x29 0x2 0x2 
0x0 0x0 0x0
Mar 10 10:09:21 <kern.crit> filer kernel: da2 at ahd1 bus 0 target 2 lun 0
Mar 10 10:09:21 <kern.crit> filer kernel: da2: <IFT A08U-G1A3 341B> 
Fixed Direct Access SCSI-3 device
Mar 10 10:09:21 <kern.crit> filer kernel: da2: 160.000MB/s transfers 
(80.000MHz, offset 62, 16bit), Tagged Queueing Enabled
Mar 10 10:09:21 <kern.crit> filer kernel: da2: 1429284MB (2927173632 512 
byte sectors: 255H 63S/T 182208C)
Mar 10 10:09:21 <kern.crit> filer kernel: da0 at ahd0 bus 0 target 0 lun 0
Mar 10 10:09:21 <kern.crit> filer kernel: da0: <SEAGATE ST336607LC 0007> 
Fixed Direct Access SCSI-3 device
Mar 10 10:09:21 <kern.crit> filer kernel: da0: 320.000MB/s transfers 
(160.000MHz, offset 63, 16bit), Tagged Queueing Enabled

Pciconf -l:
-----------
hostb0 at pci0:0:0:        class=0x060000 card=0x358015d9 chip=0x254c8086 
rev=0x01 hdr=0x00
none0 at pci0:0:1:         class=0xff0000 card=0x358015d9 chip=0x25418086 
rev=0x01 hdr=0x00
pcib1 at pci0:2:0:         class=0x060400 card=0x00000000 chip=0x25438086 
rev=0x01 hdr=0x01
uhci0 at pci0:29:0:        class=0x0c0300 card=0x358015d9 chip=0x24828086 
rev=0x02 hdr=0x00
uhci1 at pci0:29:1:        class=0x0c0300 card=0x358015d9 chip=0x24848086 
rev=0x02 hdr=0x00
uhci2 at pci0:29:2:        class=0x0c0300 card=0x358015d9 chip=0x24878086 
rev=0x02 hdr=0x00
pcib4 at pci0:30:0:        class=0x060400 card=0x00000000 chip=0x244e8086 
rev=0x42 hdr=0x01
isab0 at pci0:31:0:        class=0x060100 card=0x00000000 chip=0x24808086 
rev=0x02 hdr=0x00
atapci0 at pci0:31:1:      class=0x01018a card=0x358015d9 chip=0x248b8086 
rev=0x02 hdr=0x00
none1 at pci0:31:3:        class=0x0c0500 card=0x358015d9 chip=0x24838086 
rev=0x02 hdr=0x00
none2 at pci1:28:0:        class=0x080020 card=0x358015d9 chip=0x14618086 
rev=0x04 hdr=0x00
pcib2 at pci1:29:0:        class=0x060400 card=0x00000050 chip=0x14608086 
rev=0x04 hdr=0x01
none3 at pci1:30:0:        class=0x080020 card=0x358015d9 chip=0x14618086 
rev=0x04 hdr=0x00
pcib3 at pci1:31:0:        class=0x060400 card=0x00000050 chip=0x14608086 
rev=0x04 hdr=0x01
em0 at pci2:3:0:           class=0x020000 card=0x10118086 chip=0x10108086 
rev=0x01 hdr=0x00
em1 at pci2:3:1:           class=0x020000 card=0x10118086 chip=0x10108086 
rev=0x01 hdr=0x00
ahd0 at pci3:2:0:          class=0x010000 card=0x005e9005 chip=0x801d9005 
rev=0x10 hdr=0x00
ahd1 at pci3:2:1:          class=0x010000 card=0x005e9005 chip=0x801d9005 
rev=0x10 hdr=0x00
none4 at pci4:1:0:         class=0x030000 card=0x00081002 chip=0x47521002 
rev=0x27 hdr=0x00

Camcontrol:
-----------
# camcontrol devlist -v

scbus0 on ahd0 bus 0:

<SEAGATE ST336607LC 0007>          at scbus0 target 0 lun 0 (pass0,da0)
<SEAGATE ST336607LC 0007>          at scbus0 target 1 lun 0 (pass1,da1)
<SUPER GEM318 0>                   at scbus0 target 6 lun 0 (ses0,pass2)
<  >                               at scbus0 target -1 lun -1 ()
scbus1 on ahd1 bus 0:
<IFT A08U-G1A3 341B>               at scbus1 target 2 lun 0 (pass3,da2)
<  >                               at scbus1 target -1 lun -1 ()
scbus-1 on xpt0 bus 0:
<  >                               at scbus-1 target -1 lun -1 (xpt0)

# camcontrol inquiry da0
pass0: <SEAGATE ST336607LC 0007> Fixed Direct Access SCSI-3 device
pass0: Serial Number 3JA7JCF100007440AJ5K
pass0: 320.000MB/s transfers (160.000MHz, offset 63, 16bit), Tagged
Queueing Enabled
# camcontrol inquiry da1
pass1: <SEAGATE ST336607LC 0007> Fixed Direct Access SCSI-3 device
pass1: Serial Number 3JA7JARS00007439A214
pass1: 320.000MB/s transfers (160.000MHz, offset 63, 16bit), Tagged
Queueing Enabled
# camcontrol inquiry da2
pass3: <IFT A08U-G1A3 341B> Fixed Direct Access SCSI-3 device
pass3: Serial Number 00000028E4A83F00
pass3: 160.000MB/s transfers (80.000MHz, offset 62, 16bit), Tagged
Queueing Enabled

Relevant df(1) output:
----------------------------
# df -hi
Filesystem           Size    Used   Avail Capacity iused    ifree
%iused  Mounted on
/dev/da2s1d          1.4T    1.2T     61G    95% 1956140 12969170
13%   /part1

Kernel configuation:
-------------------------
It's running GENERIC with these extras:
options         KDB
options         KDB_UNATTENDED
options         CAMDEBUG

Thanks,
Leroy



More information about the freebsd-questions mailing list