mps driver instability under stable/8

Dmitry Morozovsky marck at rinet.ru
Sun May 1 10:42:24 UTC 2011


On Sat, 30 Apr 2011, Kenneth D. Merry wrote:

KDM> On Fri, Apr 29, 2011 at 11:51:21 +0400, Dmitry Morozovsky wrote:
KDM> > Dear Ken,
KDM> > 
KDM> > I have SuperMicro Server with mps driver you managed, with 24 SATA disks under 
KDM> > SAS x36 expander with large ZFS
KDM> > 
KDM> > Sometimes, under random disk load such as daily find, it lost all its devices:
KDM> > 
KDM> > [-- MARK -- Fri Apr 29 03:00:00 2011]
KDM> > mps0: IOC Fault 0x40005900, Resetting^M
KDM> > (pass20:mps0:0:22:0): SCSI command timeout on device handle 0x0020 SMID 442^M
KDM> > mps0: IOC Fault 0x40001500, Resetting^M
KDM> > (da19:mps0:0:21:0): SCSI command timeout on device handle 0x001f SMID 172^M
KDM> > (da19:mps0:0:21:0): SCSI command timeout on device handle 0x001f SMID 511^M
KDM> > (da20:mps0:0:20:0): SCSI command timeout on device handle 0x001e SMID 240^M
KDM> > 
KDM> > ..
KDM> > 
KDM> > (da4:mps0:0:0:0): SCSI command timeout on device handle 0x000a SMID 844^M
KDM> > (da22:mps0:0:23:0): SCSI command timeout on device handle 0x0021 SMID 713^M
KDM> > (da18:mps0:0:22:0): SCSI command timeout on device handle 0x0020 SMID 603^M
KDM> > 
KDM> > and hangs there forever (in zio state).
KDM> > 
KDM> > I've prepared debugging kernel with DDB and would be glad to help catch the 
KDM> > situation.
KDM> 
KDM> Hmm...
KDM> 
KDM> Can you send full dmesg output?

Attached

KDM>  What I'm most interested in is whether
KDM> there is more kernel output before the IOC Fault that might shed some light
KDM> on what is going on.

Nope. I use boot_verbose, but none of mps-related debug options yet


KDM> 
KDM> Also, what brand (LSI, Maxim, etc.) and speed (3Gb, 6Gb) is the expander on
KDM> the backplane?

LSI 6G:

KDM> What model LSI controller do you have?  How many lanes are connected
KDM> between the controller and the backplane?

2x4 IIR. BTW, how can investigate real SASA topology?


KDM> What model disks do you have in the system?  (dmesg will show that
KDM> obviously.)

24 x WD RE4 2T

KDM> Hopefully we can find some clues to point to the problem.

/me too ;)

Thank you very much!

 BTW, I have serial console, DDB kernel, so while this machine is in 
production, but not too heavy, and I can spend some time in kernel debugger if 
needed.

-- 
Sincerely,
D.Marck                                     [DM5020, MCK-RIPE, DM3-RIPN]
[ FreeBSD committer:                                 marck at FreeBSD.org ]
------------------------------------------------------------------------
*** Dmitry Morozovsky --- D.Marck --- Wild Woozle --- marck at rinet.ru ***
------------------------------------------------------------------------
-------------- next part --------------
Table 'FACP' at 0xbf7a0290
Table 'APIC' at 0xbf7a0390
APIC: Found table at 0xbf7a0390
APIC: Using the MADT enumerator.
MADT: Found CPU APIC ID 0 ACPI ID 1: enabled
SMP: Added CPU 0 (AP)
MADT: Found CPU APIC ID 2 ACPI ID 2: enabled
SMP: Added CPU 2 (AP)
MADT: Found CPU APIC ID 4 ACPI ID 3: enabled
SMP: Added CPU 4 (AP)
MADT: Found CPU APIC ID 6 ACPI ID 4: enabled
SMP: Added CPU 6 (AP)
MADT: Found CPU APIC ID 132 ACPI ID 5: disabled
MADT: Found CPU APIC ID 133 ACPI ID 6: disabled
MADT: Found CPU APIC ID 134 ACPI ID 7: disabled
MADT: Found CPU APIC ID 135 ACPI ID 8: disabled
Copyright (c) 1992-2011 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.2-STABLE #4: Wed Apr 20 19:27:07 MSD 2011
    marck at moose.rinet.ru:/usr/obj/usr/src/sys/MOOSE amd64
Preloaded elf kernel "/boot/kernel/kernel" at 0xffffffff80a0a000.
Preloaded elf obj module "/boot/kernel/zfs.ko" at 0xffffffff80a0a280.
Preloaded elf obj module "/boot/kernel/opensolaris.ko" at 0xffffffff80a0a8e8.
Preloaded elf obj module "/boot/kernel/geom_mirror.ko" at 0xffffffff80a0aed8.
Preloaded /boot/zfs/zpool.cache "/boot/zfs/zpool.cache" at 0xffffffff80a0b548.
Timecounter "i8254" frequency 1193182 Hz quality 0
Calibrating TSC clock ... TSC clock: 2400017156 Hz
CPU: Intel(R) Xeon(R) CPU           X3430  @ 2.40GHz (2400.02-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x106e5  Family = 6  Model = 1e  Stepping = 5
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x98e3fd<SSE3,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,POPCNT>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x1<LAHF>
  TSC: P-state invariant
real memory  = 17179869184 (16384 MB)
Physical memory chunk(s):
0x0000000000001000 - 0x0000000000097fff, 618496 bytes (151 pages)
0x0000000000a46000 - 0x00000000bf78ffff, 3201605632 bytes (781642 pages)
0x00000000bf79e000 - 0x00000000bf79ffff, 8192 bytes (2 pages)
0x0000000100000000 - 0x00000004200affff, 13422493696 bytes (3276976 pages)
avail memory = 16520749056 (15755 MB)
ACPI APIC Table: <022510 APIC1919>
INTR: Adding local APIC 2 as a target
INTR: Adding local APIC 4 as a target
INTR: Adding local APIC 6 as a target
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s)
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  2
 cpu2 (AP): APIC ID:  4
 cpu3 (AP): APIC ID:  6
x86bios:   IVT 0x000000-0x0004ff at 0xffffff0000000000
x86bios:  SSEG 0x010000-0x01ffff at 0xffffff8000047000
x86bios:  EBDA 0x09c000-0x09ffff at 0xffffff000009c000
x86bios:   ROM 0x0a0000-0x0effff at 0xffffff00000a0000
lapic0: CMCI unmasked
APIC: CPU 0 has ACPI ID 1
APIC: CPU 1 has ACPI ID 2
APIC: CPU 2 has ACPI ID 3
APIC: CPU 3 has ACPI ID 4
ULE: setup cpu 0
ULE: setup cpu 1
ULE: setup cpu 2
ULE: setup cpu 3
ACPI: RSDP 0xfa120 00024 (v02 ACPIAM)
ACPI: XSDT 0xbf7a0100 00084 (v01 SMCI            20100225 MSFT 00000097)
ACPI: FACP 0xbf7a0290 000F4 (v03 022510 FACP1919 20100225 MSFT 00000097)
ACPI: DSDT 0xbf7a05f0 06CD8 (v01  1040D 1040D000 00000000 INTL 20051117)
ACPI: FACS 0xbf7ae000 00040
ACPI: APIC 0xbf7a0390 00092 (v01 022510 APIC1919 20100225 MSFT 00000097)
ACPI: MCFG 0xbf7a0430 0003C (v01 022510 OEMMCFG  20100225 MSFT 00000097)
ACPI: OEMB 0xbf7ae040 00073 (v01 022510 OEMB1919 20100225 MSFT 00000097)
ACPI: HPET 0xbf7aa5f0 00038 (v01 022510 OEMHPET  20100225 MSFT 00000097)
ACPI: GSCI 0xbf7ae0c0 02024 (v01 022510 GMCHSCI  20100225 MSFT 00000097)
ACPI: DMAR 0xbf7b00f0 00090 (v01    AMI  OEMDMAR 00000001 MSFT 00000097)
ACPI: SSDT 0xbf7b1580 00363 (v01 DpgPmm    CpuPm 00000012 INTL 20051117)
ACPI: EINJ 0xbf7aa630 00130 (v01  AMIER AMI_EINJ 20100225 MSFT 00000097)
ACPI: BERT 0xbf7aa7c0 00030 (v01  AMIER AMI_BERT 20100225 MSFT 00000097)
ACPI: ERST 0xbf7aa7f0 001B0 (v01  AMIER AMI_ERST 20100225 MSFT 00000097)
ACPI: HEST 0xbf7aa9a0 000A8 (v01  AMIER ABC_HEST 20100225 MSFT 00000097)
MADT: Found IO APIC ID 7, Interrupt 0 at 0xfec00000
ioapic0: Changing APIC ID to 7
ioapic0: Routing external 8259A's -> intpin 0
MADT: Interrupt override: source 0, irq 2
ioapic0: Routing IRQ 0 -> intpin 2
MADT: Interrupt override: source 9, irq 9
ioapic0: intpin 9 trigger: level
lapic: Routing NMI -> LINT1
lapic: LINT1 trigger: edge
lapic: LINT1 polarity: high
ioapic0 <Version 2.0> irqs 0-23 on motherboard
cpu0 BSP:
     ID: 0x00000000   VER: 0x00060015 LDR: 0x00000000 DFR: 0xffffffff
  lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff
  timer: 0x000100ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400
   cmci: 0x000000f2
io: <I/O>
random: <entropy source, Software, Yarrow>
nfslock: pseudo-device
kbd: new array size 4
kbd1 at kbdmux0
mem: <memory>
null: <null device, zero device>
acpi0: <SMCI > on motherboard
PCIe: Memory Mapped configuration base @ 0xe0000000
ioapic0: routing intpin 9 (ISA IRQ 9) to lapic 0 vector 48
acpi0: [MPSAFE]
acpi0: [ITHREAD]
ACPI: Executed 1 blocks of module-level executable AML code
acpi0: Power Button (fixed)
ACPI timer: 1/1 1/1 1/1 1/1 1/1 1/1 1/1 1/1 1/1 1/1 -> 10
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
cpu0: <ACPI CPU> on acpi0
ACPI Warning: Incorrect checksum in table [OEMB] - 0x90, should be 0x8F (20101013/tbutils-354)
ACPI: SSDT 0xbf7b0180 00F20 (v01 DpgPmm  P001Ist 00000011 INTL 20051117)
ACPI: Dynamic OEM Table Load:
ACPI: SSDT 0 00F20 (v01 DpgPmm  P001Ist 00000011 INTL 20051117)
ACPI: SSDT 0xbf7b10a0 004D5 (v01  PmRef  P001Cst 00003001 INTL 20051117)
ACPI: Dynamic OEM Table Load:
ACPI: SSDT 0 004D5 (v01  PmRef  P001Cst 00003001 INTL 20051117)
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
pci_link0:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0   10   N     0  3 4 6 7 10 11 12 14 15
  Validation          0   10   N     0  3 4 6 7 10 11 12 14 15
  After Disable       0  255   N     0  3 4 6 7 10 11 12 14 15
pci_link1:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0   11   N     0  3 4 6 7 10 11 12 14 15
  Validation          0   11   N     0  3 4 6 7 10 11 12 14 15
  After Disable       0  255   N     0  3 4 6 7 10 11 12 14 15
pci_link2:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0    7   N     0  3 4 6 7 10 11 12 14 15
  Validation          0    7   N     0  3 4 6 7 10 11 12 14 15
  After Disable       0  255   N     0  3 4 6 7 10 11 12 14 15
pci_link3:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0   14   N     0  3 4 6 7 10 11 12 14 15
  Validation          0   14   N     0  3 4 6 7 10 11 12 14 15
  After Disable       0  255   N     0  3 4 6 7 10 11 12 14 15
pci_link4:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0  255   N     0  3 4 6 7 10 11 12 14 15
  Validation          0  255   N     0  3 4 6 7 10 11 12 14 15
  After Disable       0  255   N     0  3 4 6 7 10 11 12 14 15
pci_link5:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0    3   N     0  3 4 6 7 10 11 12 14 15
  Validation          0    3   N     0  3 4 6 7 10 11 12 14 15
  After Disable       0  255   N     0  3 4 6 7 10 11 12 14 15
pci_link6:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0  255   N     0  3 4 6 7 10 11 12 14 15
  Validation          0  255   N     0  3 4 6 7 10 11 12 14 15
  After Disable       0  255   N     0  3 4 6 7 10 11 12 14 15
pci_link7:        Index  IRQ  Rtd  Ref  IRQs
  Initial Probe       0   15   N     0  3 4 6 7 10 11 12 14 15
  Validation          0   15   N     0  3 4 6 7 10 11 12 14 15
  After Disable       0  255   N     0  3 4 6 7 10 11 12 14 15
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pci0: domain=0, physical bus=0
found->	vendor=0x8086, dev=0xd130, revid=0x11
	domain=0, bus=0, slot=0, func=0
	class=06-00-00, hdrtype=0x00, mfdev=0
	cmdreg=0x0000, statreg=0x0010, cachelnsz=0 (dwords)
	lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
found->	vendor=0x8086, dev=0xd138, revid=0x11
	domain=0, bus=0, slot=3, func=0
	class=06-04-00, hdrtype=0x01, mfdev=0
	cmdreg=0x0104, statreg=0x0010, cachelnsz=8 (dwords)
	lattimer=0x00 (0 ns), mingnt=0x02 (500 ns), maxlat=0x00 (0 ns)
	intpin=a, irq=10
	powerspec 3  supports D0 D3  current D0
	MSI supports 2 messages, vector masks
pcib0: matched entry for 0.3.INTA
pcib0: slot 3 INTA hardwired to IRQ 16
found->	vendor=0x8086, dev=0xd13a, revid=0x11
	domain=0, bus=0, slot=5, func=0
	class=06-04-00, hdrtype=0x01, mfdev=0
	cmdreg=0x0107, statreg=0x0010, cachelnsz=8 (dwords)
	lattimer=0x00 (0 ns), mingnt=0x02 (500 ns), maxlat=0x00 (0 ns)
	intpin=a, irq=10
	powerspec 3  supports D0 D3  current D0
	MSI supports 2 messages, vector masks
pcib0: matched entry for 0.5.INTA
pcib0: slot 5 INTA hardwired to IRQ 16
found->	vendor=0x8086, dev=0xd155, revid=0x11
	domain=0, bus=0, slot=8, func=0
	class=08-80-00, hdrtype=0x00, mfdev=1
	cmdreg=0x0000, statreg=0x0010, cachelnsz=8 (dwords)
	lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
found->	vendor=0x8086, dev=0xd156, revid=0x11
	domain=0, bus=0, slot=8, func=1
	class=08-80-00, hdrtype=0x00, mfdev=1
	cmdreg=0x0000, statreg=0x0010, cachelnsz=8 (dwords)
	lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
found->	vendor=0x8086, dev=0xd157, revid=0x11
	domain=0, bus=0, slot=8, func=2
	class=08-80-00, hdrtype=0x00, mfdev=1
	cmdreg=0x0000, statreg=0x0010, cachelnsz=8 (dwords)
	lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
found->	vendor=0x8086, dev=0xd158, revid=0x11
	domain=0, bus=0, slot=8, func=3
	class=08-80-00, hdrtype=0x00, mfdev=1
	cmdreg=0x0000, statreg=0x0000, cachelnsz=8 (dwords)
	lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
found->	vendor=0x8086, dev=0xd150, revid=0x11
	domain=0, bus=0, slot=16, func=0
	class=08-80-00, hdrtype=0x00, mfdev=1
	cmdreg=0x0000, statreg=0x0000, cachelnsz=8 (dwords)
	lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
found->	vendor=0x8086, dev=0xd151, revid=0x11
	domain=0, bus=0, slot=16, func=1
	class=08-80-00, hdrtype=0x00, mfdev=1
	cmdreg=0x0000, statreg=0x0000, cachelnsz=8 (dwords)
	lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
found->	vendor=0x8086, dev=0x3b3c, revid=0x05
	domain=0, bus=0, slot=26, func=0
	class=0c-03-20, hdrtype=0x00, mfdev=0
	cmdreg=0x0006, statreg=0x0290, cachelnsz=0 (dwords)
	lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
	intpin=a, irq=3
	powerspec 2  supports D0 D3  current D0
	map[10]: type Memory, range 32, base 0xfb3fc000, size 10, enabled
pcib0: matched entry for 0.26.INTA
pcib0: slot 26 INTA hardwired to IRQ 21
unknown: Reserved 0x400 bytes for rid 0x10 type 3 at 0xfb3fc000
found->	vendor=0x8086, dev=0x3b42, revid=0x05
	domain=0, bus=0, slot=28, func=0
	class=06-04-00, hdrtype=0x01, mfdev=1
	cmdreg=0x0104, statreg=0x0010, cachelnsz=8 (dwords)
	lattimer=0x00 (0 ns), mingnt=0x02 (500 ns), maxlat=0x00 (0 ns)
	intpin=a, irq=11
	powerspec 2  supports D0 D3  current D0
	MSI supports 1 message
pcib0: matched entry for 0.28.INTA
pcib0: slot 28 INTA hardwired to IRQ 17
found->	vendor=0x8086, dev=0x3b4a, revid=0x05
	domain=0, bus=0, slot=28, func=4
	class=06-04-00, hdrtype=0x01, mfdev=1
	cmdreg=0x0107, statreg=0x0010, cachelnsz=8 (dwords)
	lattimer=0x00 (0 ns), mingnt=0x02 (500 ns), maxlat=0x00 (0 ns)
	intpin=a, irq=11
	powerspec 2  supports D0 D3  current D0
	MSI supports 1 message
pcib0: matched entry for 0.28.INTA
pcib0: slot 28 INTA hardwired to IRQ 17
found->	vendor=0x8086, dev=0x3b4c, revid=0x05
	domain=0, bus=0, slot=28, func=5
	class=06-04-00, hdrtype=0x01, mfdev=1
	cmdreg=0x0107, statreg=0x0010, cachelnsz=8 (dwords)
	lattimer=0x00 (0 ns), mingnt=0x02 (500 ns), maxlat=0x00 (0 ns)
	intpin=b, irq=10
	powerspec 2  supports D0 D3  current D0
	MSI supports 1 message
pcib0: matched entry for 0.28.INTB
pcib0: slot 28 INTB hardwired to IRQ 16
found->	vendor=0x8086, dev=0x3b34, revid=0x05
	domain=0, bus=0, slot=29, func=0
	class=0c-03-20, hdrtype=0x00, mfdev=0
	cmdreg=0x0006, statreg=0x0290, cachelnsz=0 (dwords)
	lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
	intpin=a, irq=15
	powerspec 2  supports D0 D3  current D0
	map[10]: type Memory, range 32, base 0xfb3fa000, size 10, enabled
pcib0: matched entry for 0.29.INTA
pcib0: slot 29 INTA hardwired to IRQ 23
unknown: Reserved 0x400 bytes for rid 0x10 type 3 at 0xfb3fa000
found->	vendor=0x8086, dev=0x244e, revid=0xa5
	domain=0, bus=0, slot=30, func=0
	class=06-04-01, hdrtype=0x01, mfdev=0
	cmdreg=0x0107, statreg=0x0010, cachelnsz=0 (dwords)
	lattimer=0x00 (0 ns), mingnt=0x1a (6500 ns), maxlat=0x00 (0 ns)
found->	vendor=0x8086, dev=0x3b14, revid=0x05
	domain=0, bus=0, slot=31, func=0
	class=06-01-00, hdrtype=0x00, mfdev=1
	cmdreg=0x0007, statreg=0x0210, cachelnsz=0 (dwords)
	lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
found->	vendor=0x8086, dev=0x3b22, revid=0x05
	domain=0, bus=0, slot=31, func=2
	class=01-06-01, hdrtype=0x00, mfdev=0
	cmdreg=0x0007, statreg=0x02b0, cachelnsz=0 (dwords)
	lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
	intpin=b, irq=14
	powerspec 3  supports D0 D3  current D0
	MSI supports 1 message
	map[10]: type I/O Port, range 32, base 0xb400, size  3, enabled
	map[14]: type I/O Port, range 32, base 0xbc00, size  2, enabled
	map[18]: type I/O Port, range 32, base 0xb880, size  3, enabled
	map[1c]: type I/O Port, range 32, base 0xb800, size  2, enabled
	map[20]: type I/O Port, range 32, base 0xb480, size  5, enabled
	map[24]: type Memory, range 32, base 0xfb3f8000, size 11, enabled
pcib0: matched entry for 0.31.INTB
pcib0: slot 31 INTB hardwired to IRQ 19
found->	vendor=0x8086, dev=0x3b30, revid=0x05
	domain=0, bus=0, slot=31, func=3
	class=0c-05-00, hdrtype=0x00, mfdev=0
	cmdreg=0x0003, statreg=0x0280, cachelnsz=0 (dwords)
	lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
	intpin=c, irq=7
	map[10]: type Memory, range 64, base 0xfb3f6000, size  8, enabled
	map[20]: type I/O Port, range 32, base 0x400, size  5, enabled
pcib0: matched entry for 0.31.INTC
pcib0: slot 31 INTC hardwired to IRQ 18
pcib1: <ACPI PCI-PCI bridge> irq 16 at device 3.0 on pci0
pcib1:   domain            0
pcib1:   secondary bus     1
pcib1:   subordinate bus   1
pcib1:   I/O decode        0x0-0x0
pcib1:   no prefetched decode
pci1: <ACPI PCI bus> on pcib1
pci1: domain=0, physical bus=1
pcib2: <ACPI PCI-PCI bridge> irq 16 at device 5.0 on pci0
pcib2:   domain            0
pcib2:   secondary bus     2
pcib2:   subordinate bus   2
pcib2:   I/O decode        0xc000-0xcfff
pcib2:   memory decode     0xfb400000-0xfb4fffff
pcib2:   no prefetched decode
pcib2: could not get PCI interrupt routing table for \\_SB_.PCI0.P0P5 - AE_NOT_FOUND
pci2: <ACPI PCI bus> on pcib2
pci2: domain=0, physical bus=2
found->	vendor=0x1000, dev=0x0072, revid=0x02
	domain=0, bus=2, slot=0, func=0
	class=01-07-00, hdrtype=0x00, mfdev=0
	cmdreg=0x0147, statreg=0x0010, cachelnsz=8 (dwords)
	lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
	intpin=a, irq=10
	powerspec 3  supports D0 D1 D2 D3  current D0
	MSI supports 1 message, 64 bit
	MSI-X supports 15 messages in map 0x14
	map[10]: type I/O Port, range 32, base 0xc000, size  8, enabled
pcib2: requested I/O range 0xc000-0xc0ff: in range
	map[14]: type Memory, range 64, base 0xfb43c000, size 14, enabled
pcib2: requested memory range 0xfb43c000-0xfb43ffff: good
	map[1c]: type Memory, range 64, base 0xfb440000, size 18, enabled
pcib2: requested memory range 0xfb440000-0xfb47ffff: good
pcib0: matched entry for 0.5.INTA
pcib0: slot 5 INTA hardwired to IRQ 16
pcib2: slot 0 INTA is routed to irq 16
mps0: <LSI SAS2008> port 0xc000-0xc0ff mem 0xfb43c000-0xfb43ffff,0xfb440000-0xfb47ffff irq 16 at device 0.0 on pci2
mps0: Reserved 0x4000 bytes for rid 0x14 type 3 at 0xfb43c000
mps0: Firmware: 04.00.00.00
mps0: IOCCapabilities: 185c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,IR>
mps0: attempting to allocate 1 MSI-X vectors (15 supported)
msi: routing MSI-X IRQ 256 to local APIC 0 vector 49
mps0: using IRQ 256 for MSI-X
mps0: [MPSAFE]
mps0: [ITHREAD]
pci0: <base peripheral> at device 8.0 (no driver attached)
pci0: <base peripheral> at device 8.1 (no driver attached)
pci0: <base peripheral> at device 8.2 (no driver attached)
pci0: <base peripheral> at device 8.3 (no driver attached)
pci0: <base peripheral> at device 16.0 (no driver attached)
pci0: <base peripheral> at device 16.1 (no driver attached)
ehci0: <Intel PCH USB 2.0 controller USB-B> mem 0xfb3fc000-0xfb3fc3ff irq 21 at device 26.0 on pci0
ioapic0: routing intpin 21 (PCI IRQ 21) to lapic 0 vector 50
ehci0: [MPSAFE]
ehci0: [ITHREAD]
usbus0: EHCI version 1.0
usbus0: <Intel PCH USB 2.0 controller USB-B> on ehci0
pcib3: <ACPI PCI-PCI bridge> irq 17 at device 28.0 on pci0
pcib3:   domain            0
pcib3:   secondary bus     3
pcib3:   subordinate bus   3
pcib3:   I/O decode        0x0-0x0
pcib3:   no prefetched decode
pci3: <ACPI PCI bus> on pcib3
pci3: domain=0, physical bus=3
pcib4: <ACPI PCI-PCI bridge> irq 17 at device 28.4 on pci0
pcib4:   domain            0
pcib4:   secondary bus     4
pcib4:   subordinate bus   4
pcib4:   I/O decode        0xd000-0xdfff
pcib4:   memory decode     0xfb500000-0xfb5fffff
pcib4:   no prefetched decode
pci4: <ACPI PCI bus> on pcib4
pci4: domain=0, physical bus=4
found->	vendor=0x8086, dev=0x10d3, revid=0x00
	domain=0, bus=4, slot=0, func=0
	class=02-00-00, hdrtype=0x00, mfdev=0
	cmdreg=0x0007, statreg=0x0010, cachelnsz=8 (dwords)
	lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
	intpin=a, irq=10
	powerspec 2  supports D0 D3  current D0
	MSI supports 1 message, 64 bit
	MSI-X supports 5 messages in map 0x1c
	map[10]: type Memory, range 32, base 0xfb5e0000, size 17, enabled
pcib4: requested memory range 0xfb5e0000-0xfb5fffff: good
	map[18]: type I/O Port, range 32, base 0xdc00, size  5, enabled
pcib4: requested I/O range 0xdc00-0xdc1f: in range
	map[1c]: type Memory, range 32, base 0xfb5dc000, size 14, enabled
pcib4: requested memory range 0xfb5dc000-0xfb5dffff: good
pcib4: matched entry for 4.0.INTA
pcib4: slot 0 INTA hardwired to IRQ 16
em0: <Intel(R) PRO/1000 Network Connection 7.1.9> port 0xdc00-0xdc1f mem 0xfb5e0000-0xfb5fffff,0xfb5dc000-0xfb5dffff irq 16 at device 0.0 on pci4
em0: Reserved 0x20000 bytes for rid 0x10 type 3 at 0xfb5e0000
em0: Reserved 0x4000 bytes for rid 0x1c type 3 at 0xfb5dc000
em0: attempting to allocate 3 MSI-X vectors (5 supported)
msi: routing MSI-X IRQ 257 to local APIC 0 vector 51
msi: routing MSI-X IRQ 258 to local APIC 0 vector 52
msi: routing MSI-X IRQ 259 to local APIC 0 vector 53
em0: using IRQs 257-259 for MSI-X
em0: Using MSIX interrupts with 3 vectors
em0: [MPSAFE]
em0: [ITHREAD]
em0: [MPSAFE]
em0: [ITHREAD]
em0: [MPSAFE]
em0: [ITHREAD]
em0: bpf attached
em0: Ethernet address: 00:25:90:00:64:68
pcib5: <ACPI PCI-PCI bridge> irq 16 at device 28.5 on pci0
pcib5:   domain            0
pcib5:   secondary bus     5
pcib5:   subordinate bus   5
pcib5:   I/O decode        0xe000-0xefff
pcib5:   memory decode     0xfb600000-0xfb6fffff
pcib5:   no prefetched decode
pci5: <ACPI PCI bus> on pcib5
pci5: domain=0, physical bus=5
found->	vendor=0x8086, dev=0x10d3, revid=0x00
	domain=0, bus=5, slot=0, func=0
	class=02-00-00, hdrtype=0x00, mfdev=0
	cmdreg=0x0007, statreg=0x0010, cachelnsz=8 (dwords)
	lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns)
	intpin=a, irq=11
	powerspec 2  supports D0 D3  current D0
	MSI supports 1 message, 64 bit
	MSI-X supports 5 messages in map 0x1c
	map[10]: type Memory, range 32, base 0xfb6e0000, size 17, enabled
pcib5: requested memory range 0xfb6e0000-0xfb6fffff: good
	map[18]: type I/O Port, range 32, base 0xec00, size  5, enabled
pcib5: requested I/O range 0xec00-0xec1f: in range
	map[1c]: type Memory, range 32, base 0xfb6dc000, size 14, enabled
pcib5: requested memory range 0xfb6dc000-0xfb6dffff: good
pcib5: matched entry for 5.0.INTA
pcib5: slot 0 INTA hardwired to IRQ 17
em1: <Intel(R) PRO/1000 Network Connection 7.1.9> port 0xec00-0xec1f mem 0xfb6e0000-0xfb6fffff,0xfb6dc000-0xfb6dffff irq 17 at device 0.0 on pci5
em1: Reserved 0x20000 bytes for rid 0x10 type 3 at 0xfb6e0000
em1: Reserved 0x4000 bytes for rid 0x1c type 3 at 0xfb6dc000
em1: attempting to allocate 3 MSI-X vectors (5 supported)
msi: routing MSI-X IRQ 260 to local APIC 0 vector 54
msi: routing MSI-X IRQ 261 to local APIC 0 vector 55
msi: routing MSI-X IRQ 262 to local APIC 0 vector 56
em1: using IRQs 260-262 for MSI-X
em1: Using MSIX interrupts with 3 vectors
em1: [MPSAFE]
em1: [ITHREAD]
em1: [MPSAFE]
em1: [ITHREAD]
em1: [MPSAFE]
em1: [ITHREAD]
em1: bpf attached
em1: Ethernet address: 00:25:90:00:64:69
ehci1: <Intel PCH USB 2.0 controller USB-A> mem 0xfb3fa000-0xfb3fa3ff irq 23 at device 29.0 on pci0
ioapic0: routing intpin 23 (PCI IRQ 23) to lapic 0 vector 57
ehci1: [MPSAFE]
ehci1: [ITHREAD]
usbus1: EHCI version 1.0
usbus1: <Intel PCH USB 2.0 controller USB-A> on ehci1
pcib6: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pcib6:   domain            0
pcib6:   secondary bus     6
pcib6:   subordinate bus   6
pcib6:   I/O decode        0xf000-0xfff
pcib6:   memory decode     0xfb700000-0xfbffffff
pcib6:   prefetched decode 0xfa000000-0xfaffffff
pcib6:   Subtractively decoded bridge.
pci6: <ACPI PCI bus> on pcib6
pci6: domain=0, physical bus=6
found->	vendor=0x102b, dev=0x0532, revid=0x0a
	domain=0, bus=6, slot=3, func=0
	class=03-00-00, hdrtype=0x00, mfdev=0
	cmdreg=0x0007, statreg=0x0290, cachelnsz=8 (dwords)
	lattimer=0x40 (1920 ns), mingnt=0x10 (4000 ns), maxlat=0x20 (8000 ns)
	intpin=a, irq=15
	powerspec 1  supports D0 D3  current D0
	map[10]: type Prefetchable Memory, range 32, base 0xfa000000, size 24, enabled
pcib6: requested memory range 0xfa000000-0xfaffffff: good
	map[14]: type Memory, range 32, base 0xfb7fc000, size 14, enabled
pcib6: requested memory range 0xfb7fc000-0xfb7fffff: good
	map[18]: type Memory, range 32, base 0xfb800000, size 23, enabled
pcib6: requested memory range 0xfb800000-0xfbffffff: good
pcib6: matched entry for 6.3.INTA
pcib6: slot 3 INTA hardwired to IRQ 23
vgapci0: <VGA-compatible display> mem 0xfa000000-0xfaffffff,0xfb7fc000-0xfb7fffff,0xfb800000-0xfbffffff irq 23 at device 3.0 on pci6
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
ahci0: <Intel 5 Series/3400 Series AHCI SATA controller> port 0xb400-0xb407,0xbc00-0xbc03,0xb880-0xb887,0xb800-0xb803,0xb480-0xb49f mem 0xfb3f8000-0xfb3f87ff irq 19 at device 31.2 on pci0
ahci0: Reserved 0x800 bytes for rid 0x24 type 3 at 0xfb3f8000
ahci0: attempting to allocate 1 MSI vectors (1 supported)
msi: routing MSI IRQ 263 to local APIC 0 vector 58
ahci0: using IRQ 263 for MSI
ahci0: [MPSAFE]
ahci0: [ITHREAD]
ahci0: AHCI v1.30 with 6 3Gbps ports, Port Multiplier not supported
ahci0: Caps: 64bit NCQ SNTF SS ALP AL CLO 3Gbps PMD SSC PSC 32cmd EM eSATA 6ports
ahci0: Caps2: APST
ahci0: EM Caps: ALHD XMT SMB LED
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich0: [MPSAFE]
ahcich0: [ITHREAD]
ahcich0: Caps: HPCP
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich1: [MPSAFE]
ahcich1: [ITHREAD]
ahcich1: Caps: HPCP
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich2: [MPSAFE]
ahcich2: [ITHREAD]
ahcich2: Caps: HPCP
ahcich3: <AHCI channel> at channel 3 on ahci0
ahcich3: [MPSAFE]
ahcich3: [ITHREAD]
ahcich3: Caps: HPCP
ahcich4: <AHCI channel> at channel 4 on ahci0
ahcich4: [MPSAFE]
ahcich4: [ITHREAD]
ahcich4: Caps: HPCP
ahcich5: <AHCI channel> at channel 5 on ahci0
ahcich5: [MPSAFE]
ahcich5: [ITHREAD]
ahcich5: Caps: HPCP
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
acpi_button0: <Power Button> on acpi0
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
atrtc0: registered as a time-of-day clock (resolution 1000000us)
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
ioapic0: routing intpin 4 (ISA IRQ 4) to lapic 0 vector 59
uart0: [FILTER]
uart0: fast interrupt
uart0: console (115200,n,8,1)
uart2: <16550 or compatible> port 0x3e8-0x3ef irq 5 on acpi0
ioapic0: routing intpin 5 (ISA IRQ 5) to lapic 0 vector 60
uart2: [FILTER]
uart2: fast interrupt
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
atkbd: the current kbd controller command byte 0065
atkbd: keyboard ID 0x41ab (2)
kbd0 at atkbd0
kbd0: atkbd0, AT 101/102 (2), config:0x0, flags:0x3d0000
ioapic0: routing intpin 1 (ISA IRQ 1) to lapic 0 vector 61
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
acpi_hpet0: vend: 0x8086 rev: 0x1 num: 8 hz: 14318180 opts: legacy_route 64-bit
Timecounter "HPET" frequency 14318180 Hz quality 900
acpi0: wakeup code va 0xffffff84840e8000 pa 0x4000
isa_probe_children: disabling PnP devices
atkbdc: atkbdc0 already exists; skipping it
atrtc: atrtc0 already exists; skipping it
sc: sc0 already exists; skipping it
uart: uart0 already exists; skipping it
isa_probe_children: probing non-PnP devices
orm0: <ISA Option ROM> at iomem 0xc0000-0xc7fff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sc0: fb0, kbd1, terminal emulator: scteken (teken terminal)
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
fdc0 failed to probe at port 0x3f0 irq 6 drq 2 on isa0
ppc0 failed to probe at irq 7 on isa0
uart1: <ns8250> failed to probe at port 0x2f8-0x2ff irq 3 on isa0
isa_probe_children: probing PnP devices
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
coretemp0: Setting TjMax=99
est0: <Enhanced SpeedStep Frequency Control> on cpu0
est0: Invalid id16 (set, cur) = (17, 18)
est0: Can't check freq 2267, it may be invalid
est0: Invalid id16 (set, cur) = (16, 18)
est0: Can't check freq 2133, it may be invalid
est0: Invalid id16 (set, cur) = (15, 18)
est0: Can't check freq 2000, it may be invalid
est0: Invalid id16 (set, cur) = (14, 18)
est0: Can't check freq 1867, it may be invalid
est0: Invalid id16 (set, cur) = (13, 18)
est0: Can't check freq 1733, it may be invalid
est0: Invalid id16 (set, cur) = (12, 18)
est0: Can't check freq 1600, it may be invalid
est0: Invalid id16 (set, cur) = (11, 18)
est0: Can't check freq 1467, it may be invalid
est0: Invalid id16 (set, cur) = (10, 18)
est0: Can't check freq 1333, it may be invalid
est0: Invalid id16 (set, cur) = (9, 18)
est0: Can't check freq 1200, it may be invalid
p4tcc0: <CPU Frequency Thermal Control> on cpu0
coretemp1: <CPU On-Die Thermal Sensors> on cpu1
coretemp1: Setting TjMax=99
est1: <Enhanced SpeedStep Frequency Control> on cpu1
est1: Invalid id16 (set, cur) = (17, 18)
est1: Can't check freq 2267, it may be invalid
est1: Invalid id16 (set, cur) = (16, 18)
est1: Can't check freq 2133, it may be invalid
est1: Invalid id16 (set, cur) = (15, 18)
est1: Can't check freq 2000, it may be invalid
est1: Invalid id16 (set, cur) = (14, 18)
est1: Can't check freq 1867, it may be invalid
est1: Invalid id16 (set, cur) = (13, 18)
est1: Can't check freq 1733, it may be invalid
est1: Invalid id16 (set, cur) = (12, 18)
est1: Can't check freq 1600, it may be invalid
est1: Invalid id16 (set, cur) = (11, 18)
est1: Can't check freq 1467, it may be invalid
est1: Invalid id16 (set, cur) = (10, 18)
est1: Can't check freq 1333, it may be invalid
est1: Invalid id16 (set, cur) = (9, 18)
est1: Can't check freq 1200, it may be invalid
p4tcc1: <CPU Frequency Thermal Control> on cpu1
coretemp2: <CPU On-Die Thermal Sensors> on cpu2
coretemp2: Setting TjMax=99
est2: <Enhanced SpeedStep Frequency Control> on cpu2
est2: Invalid id16 (set, cur) = (17, 18)
est2: Can't check freq 2267, it may be invalid
est2: Invalid id16 (set, cur) = (16, 18)
est2: Can't check freq 2133, it may be invalid
est2: Invalid id16 (set, cur) = (15, 18)
est2: Can't check freq 2000, it may be invalid
est2: Invalid id16 (set, cur) = (14, 18)
est2: Can't check freq 1867, it may be invalid
est2: Invalid id16 (set, cur) = (13, 18)
est2: Can't check freq 1733, it may be invalid
est2: Invalid id16 (set, cur) = (12, 18)
est2: Can't check freq 1600, it may be invalid
est2: Invalid id16 (set, cur) = (11, 18)
est2: Can't check freq 1467, it may be invalid
est2: Invalid id16 (set, cur) = (10, 18)
est2: Can't check freq 1333, it may be invalid
est2: Invalid id16 (set, cur) = (9, 18)
est2: Can't check freq 1200, it may be invalid
p4tcc2: <CPU Frequency Thermal Control> on cpu2
coretemp3: <CPU On-Die Thermal Sensors> on cpu3
coretemp3: Setting TjMax=99
est3: <Enhanced SpeedStep Frequency Control> on cpu3
est3: Invalid id16 (set, cur) = (17, 18)
est3: Can't check freq 2267, it may be invalid
est3: Invalid id16 (set, cur) = (16, 18)
est3: Can't check freq 2133, it may be invalid
est3: Invalid id16 (set, cur) = (15, 18)
est3: Can't check freq 2000, it may be invalid
est3: Invalid id16 (set, cur) = (14, 18)
est3: Can't check freq 1867, it may be invalid
est3: Invalid id16 (set, cur) = (13, 18)
est3: Can't check freq 1733, it may be invalid
est3: Invalid id16 (set, cur) = (12, 18)
est3: Can't check freq 1600, it may be invalid
est3: Invalid id16 (set, cur) = (11, 18)
est3: Can't check freq 1467, it may be invalid
est3: Invalid id16 (set, cur) = (10, 18)
est3: Can't check freq 1333, it may be invalid
est3: Invalid id16 (set, cur) = (9, 18)
est3: Can't check freq 1200, it may be invalid
p4tcc3: <CPU Frequency Thermal Control> on cpu3
Device configuration finished.
ZFS filesystem version 5
ZFS storage pool version 28
lapic: Divisor 2, Frequency 66667135 Hz
Timecounter "TSC" frequency 2400017156 Hz quality -100
Timecounters tick every 1.000 msec
vlan: initialized, using hash tables with chaining
lo0: bpf attached
usbus0: 480Mbps High Speed USB v2.0
usbus1: 480Mbps High Speed USB v2.0
ugen0.1: <Intel> at usbus0
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0
ugen1.1: <Intel> at usbus1
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
ahcich0: AHCI reset...
ahcich0: SATA connect timeout status=00000000
ahcich0: AHCI reset: device not found
ahcich1: AHCI reset...
ahcich1: SATA connect timeout status=00000000
ahcich1: AHCI reset: device not found
ahcich2: AHCI reset...
ahcich2: SATA connect time=100us status=00000123
ahcich2: AHCI reset: device found
ahcich3: AHCI reset...
ahcich2: AHCI reset: device ready after 100ms
(aprobe0:ahcich2:0:0:0): SIGNATURE: 0000
ahcich3: SATA connect timeout status=00000000
ahcich3: AHCI reset: device not found
ahcich4: AHCI reset...
ahcich4: SATA connect timeout status=00000000
ahcich4: AHCI reset: device not found
ahcich5: AHCI reset...
ahcich5: SATA connect timeout status=00000000
ahcich5: AHCI reset: device not found
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
ugen0.2: <vendor 0x8087> at usbus0
uhub2: <vendor 0x8087 product 0x0020, class 9/0, rev 2.00/0.00, addr 2> on usbus0
ugen1.2: <vendor 0x8087> at usbus1
uhub3: <vendor 0x8087 product 0x0020, class 9/0, rev 2.00/0.00, addr 2> on usbus1
uhub2: 6 ports with 6 removable, self powered
uhub3: 6 ports with 6 removable, self powered
ugen0.3: <Winbond Electronics Corp> at usbus0
ukbd0: <Winbond Electronics Corp Hermon USB hidmouse Device, class 0/0, rev 1.10/0.01, addr 3> on usbus0
kbd2 at ukbd0
kbd2: ukbd0, generic (0), config:0x0, flags:0x3d0000
pass0 at ahcich2 bus 0 scbus3 target 0 lun 0
pass0: <SAMSUNG HD204UI 1AQ10001> ATA-8 SATA 2.x device
pass0: Serial Number S2H7J1CB220301
pass0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada0 at ahcich2 bus 0 scbus3 target 0 lun 0
ada0: <SAMSUNG HD204UI 1AQ10001> ATA-8 SATA 2.x device
ada0: Serial Number S2H7J1CB220301
ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, GEOM: new disk ada0
PIO 8192bytes)
ada0: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
Expander found at enclosure 2
mps0: Found device <1902<SmpTarg,Direct,LsiDev>,Edge Expander> <6.0Gbps> <0x0009> <2/0>
mps0: Found device <81<SataDev>,End Device> <3.0Gbps> <0x000a> <2/0>
mps0: Found device <81<SataDev>,End Device> <3.0Gbps> <0x000b> <2/1>
mps0: Found device <81<SataDev>,End Device> <3.0Gbps> <0x000c> <2/2>
mps0: Found device <81<SataDev>,End Device> <3.0Gbps> <0x000d> <2/3>
mps0: Found device <81<SataDev>,End Device> <3.0Gbps> <0x000e> <2/4>
mps0: Found device <81<SataDev>,End Device> <3.0Gbps> <0x000f> <2/5>
mps0: Found device <81<SataDev>,End Device> <3.0Gbps> <0x0010> <2/6>
mps0: Found device <81<SataDev>,End Device> <3.0Gbps> <0x0011> <2/7>
mps0: Found device <81<SataDev>,End Device> <3.0Gbps> <0x0012> <2/8>
mps0: Found device <81<SataDev>,End Device> <3.0Gbps> <0x0013> <2/9>
(probe0:mps0:0:0:0): Down reving Protocol Version from 4 to 0?
(probe1:mps0:0:1:0): Down reving Protocol Version from 4 to 0?
(probe2:mps0:0:2:0): Down reving Protocol Version from 4 to 0?
(probe3:mps0:0:3:0): Down reving Protocol Version from 4 to 0?
(probe4:mps0:0:4:0): Down reving Protocol Version from 4 to 0?
(probe5:mps0:0:5:0): Down reving Protocol Version from 4 to 0?
(probe6:mps0:0:6:0): Down reving Protocol Version from 4 to 0?
(probe7:mps0:0:7:0): Down reving Protocol Version from 4 to 0?
(probe8:mps0:0:8:0): Down reving Protocol Version from 4 to 0?
(probe9:mps0:0:9:0): Down reving Protocol Version from 4 to 0?
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Error 22, Unretryable error
pass1 at mps0 bus 0 scbus0 target 5 lun 0
pass1: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass1: Serial Number      WD-WMAY00063033
pass1: 300.000MB/s transfers
pass1: Command Queueing enabled
pass2 at mps0 bus 0 scbus0 target 7 lun 0
pass2: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass2: Serial Number      WD-WMAY00611415
pass2: 300.000MB/s transfers
pass2: Command Queueing enabled
pass3 at mps0 bus 0 scbus0 target 1 lun 0
pass3: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass3: Serial Number      WD-WMAY00577665
pass3: 300.000MB/s transfers
pass3: Command Queueing enabled
pass4 at mps0 bus 0 scbus0 target 3 lun 0
pass4: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass4: Serial Number      WD-WMAY00548478
pass4: 300.000MB/s transfers
pass4: Command Queueing enabled
pass5 at mps0 bus 0 scbus0 target 0 lun 0
pass5: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass5: Serial Number      WD-WMAY00563590
pass5: 300.000MB/s transfers
pass5: Command Queueing enabled
pass6 at mps0 bus 0 scbus0 target 9 lun 0
pass6: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass6: Serial Number      WD-WMAY00525739
pass6: 300.000MB/s transfers
pass6: Command Queueing enabled
pass7 at mps0 bus 0 scbus0 target 6 lun 0
pass7: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass7: Serial Number      WD-WMAY00602317
pass7: 300.000MB/s transfers
pass7: Command Queueing enabled
pass8 at mps0 bus 0 scbus0 target 4 lun 0
pass8: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass8: Serial Number      WD-WMAY00644401
pass8: 300.000MB/s transfers
pass8: Command Queueing enabled
pass9 at mps0 bus 0 scbus0 target 8 lun 0
pass9: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass9: Serial Number      WD-WMAY00437978
pass9: 300.000MB/s transfers
pass9: Command Queueing enabled
pass10 at mps0 bus 0 scbus0 target 2 lun 0
pass10: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass10: Serial Number      WD-WMAY00653631
pass10: 300.000MB/s transfers
pass10: Command Queueing enabled
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Error 22, Unretryable error
GEOM: new disk da0
GEOM: new disk da1
GEOM: new disk da2
GEOM: new disk da3
GEOM: new disk da4
GEOM: new disk da5
GEOM: new disk da6
GEOM: new disk da7
GEOM: new disk da8
GEOM: new disk da9
da0 at mps0 bus 0 scbus0 target 5 lun 0
da0: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da0: Serial Number      WD-WMAY00063033
da0: 300.000MB/s transfers
da0: Command Queueing enabled
da0: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da1 at mps0 bus 0 scbus0 target 7 lun 0
da1: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da1: Serial Number      WD-WMAY00611415
da1: 300.000MB/s transfers
da1: Command Queueing enabled
da1: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da2 at mps0 bus 0 scbus0 target 1 lun 0
da2: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da2: Serial Number      WD-WMAY00577665
da2: 300.000MB/s transfers
da2: Command Queueing enabled
da2: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da4 at mps0 bus 0 scbus0 target 0 lun 0
da4: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da4: Serial Number      WD-WMAY00563590
da4: 300.000MB/s transfers
da4: Command Queueing enabled
da4: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da3 at mps0 bus 0 scbus0 target 3 lun 0
da3: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da3: Serial Number      WD-WMAY00548478
da3: 300.000MB/s transfers
da3: Command Queueing enabled
da3: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da5 at mps0 bus 0 scbus0 target 9 lun 0
da5: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da5: Serial Number      WD-WMAY00525739
da5: 300.000MB/s transfers
da5: Command Queueing enabled
da5: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da8 at mps0 bus 0 scbus0 target 8 lun 0
da8: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da8: Serial Number      WD-WMAY00437978
da8: 300.000MB/s transfers
da8: Command Queueing enabled
da8: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da6 at mps0 bus 0 scbus0 target 6 lun 0
da6: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da6: Serial Number      WD-WMAY00602317
da6: 300.000MB/s transfers
da6: Command Queueing enabled
da6: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da7 at mps0 bus 0 scbus0 target 4 lun 0
da7: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da7: Serial Number      WD-WMAY00644401
da7: 300.000MB/s transfers
da7: Command Queueing enabled
da7: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da9 at mps0 bus 0 scbus0 target 2 lun 0
da9: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da9: Serial Number      WD-WMAY00653631
da9: 300.000MB/s transfers
da9: Command Queueing enabled
da9: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
GEOM_MIRROR: Device mirror/m0a launched (6/6).
mps0: Found device <81<SataDev>,End Device> <3.0Gbps> <0x0014> <2/10>lllaappaipiccic642:::  CCMCM ICCI M uCunnmmaasskkeeddI unmasked
mps0: 
SMP: AP CPU #1 Launched!
Found device <81<SataDev>,End Device> <3.0Gbps> <0x0015> <2/11>
cpu1 AP:
mps0: 
     ID: 0x02000000   VER: 0x00060015 LDR: 0x00000000 DFR: 0xffffffffFound device <81<SataDev>,End Device> <3.0Gbps> <0x0016> <2/12>

mps0: 
  lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ffFound device <81<SataDev>,End Device> <3.0Gbps> <0x0017> <2/13>
  timer: 0x000200ef therm: 0x00010000 err: 0x000000f0
mps0:  pmc: 0x00010400Found device <81<SataDev>,End Device> <3.0Gbps> <0x0018> <2/14>
mps0: 
   cmci: 0x000000f2Found device <81<SataDev>,End Device> <3.0Gbps> <0x0019> <2/15>
SMP: AP CPU #3 Launched!
mps0: 
cpu3 AP:Found device <81<SataDev>,End Device> <3.0Gbps> <0x001a> <2/16>
     ID: 0x06000000   VER: 0x00060015 LDR: 0x00000000 DFR: 0xffffffff
mps0: 
  lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ffFound device <81<SataDev>,End Device> <3.0Gbps> <0x001b> <2/17>
  timer: 0x000200ef therm: 0x00010000 err: 0x000000f0
mps0:  pmc: 0x00010400Found device <81<SataDev>,End Device> <3.0Gbps> <0x001c> <2/18>
mps0: 
   cmci: 0x000000f2Found device <81<SataDev>,End Device> <3.0Gbps> <0x001d> <2/19>
SMP: AP CPU #2 Launched!
mps0: 
cpu2 AP:Found device <81<SataDev>,End Device> <3.0Gbps> <0x001e> <2/20>
     ID: 0x04000000   VER: 0x00060015 LDR: 0x00000000 DFR: 0xffffffff
mps0: 
  lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ffFound device <81<SataDev>,End Device> <3.0Gbps> <0x001f> <2/21>
  timer: 0x000200ef therm: 0x00010000 err: 0x000000f0
mps0:  pmc: 0x00010400Found device <81<SataDev>,End Device> <3.0Gbps> <0x0020> <2/22>
mps0: 
   cmci: 0x000000f2Found device <81<SataDev>,End Device> <3.0Gbps> <0x0021> <2/23>
ioapic0: routing intpin 4 (
mps0: ISA IRQ 4Found device <4451<SmpInit,SspInit,SspTarg,SepDev>,End Device> <6.0Gbps> <0x0022> <2/24>) to lapic 2 vector 48
(probe10:
mps0:0:10:0): Down reving Protocol Version from 4 to 2?
(probe11:mps0:0:11:0): Down reving Protocol Version from 4 to 2?
(probe12:mps0:0:12:0): Down reving Protocol Version from 4 to 2?
(probe13:mps0:0:13:0): Down reving Protocol Version from 4 to 2?
(probe14:mps0:0:14:0): Down reving Protocol Version from 4 to 2?
(probe15:mps0:0:15:0): Down reving Protocol Version from 4 to 2?
(probe16:mps0:0:16:0): Down reving Protocol Version from 4 to 2?
(probe17:mps0:0:17:0): Down reving Protocol Version from 4 to 2?
(probe18:mps0:0:18:0): Down reving Protocol Version from 4 to 2?
(probe19:mps0:0:19:0): Down reving Protocol Version from 4 to 2?
(probe20:mps0:0:20:0): Down reving Protocol Version from 4 to 2?
(probe21:mps0:0:21:0): Down reving Protocol Version from 4 to 2?
(probe22:mps0:0:22:0): Down reving Protocol Version from 4 to 2?
(probe23:mps0:0:23:0): Down reving Protocol Version from 4 to 2?
(probe24:mps0:0:24:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe24:mps0:0:24:0): SCSI status error
(probe24:mps0:0:24:0): MODE SENSE(6). CDB: 1a 0 a 0 14 0 
(probe24:mps0:0:24:0): CAM status: SCSI Status Error
(probe24:mps0:0:24:0): SCSI status: Check Condition
(probe24:mps0:0:24:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
(probe24:mps0:0:24:0): Retrying command (per sense data)
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe24:mps0:0:24:0): SCSI status error
(probe24:mps0:0:24:0): MODE SENSE(6). CDB: 1a 0 a 0 14 0 
(probe24:mps0:0:24:0): CAM status: SCSI Status Error
(probe24:mps0:0:24:0): SCSI status: Check Condition
(probe24:mps0:0:24:0): SCSI sense: ILLEGAL REQUEST asc:24,0 (Invalid field in CDB)
(probe24:mps0:0:24:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
ioapic0: routing intpin 5 (GEOM: new disk da10pass11 at mps0 bus 0 scbus0 target 15 lun 0ISA IRQ 5
pass11: ) to lapic 4 vector 48<ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
ioapic0: routing intpin 9 (

pass11: Serial Number      WD-WMAY00063009ISA IRQ 9
pass11: 300.000MB/s transfers) to lapic 6 vector 48
ioapic0: routing intpin 23 (
pass11: Command Queueing enabledPCI IRQ 23
) to lapic 2 vector 49pass12 at mps0 bus 0 scbus0 target 14 lun 0

pass12: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass12: Serial Number      WD-WMAY00060983
pass12: 300.000MB/s transfers
pass12: Command Queueing enabled
msi: Assigning MSI-X IRQ 256 to local APIC 4 vector 49pass13 at mps0 bus 0 scbus0 target 13 lun 0
msi: Assigning MSI-X IRQ 257 to local APIC 6 vector 49
pass13: 
msi: Assigning MSI-X IRQ 259 to local APIC 2 vector 50<ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
msi: Assigning MSI-X IRQ 260 to local APIC 4 vector 50
pass13: Serial Number      WD-WMAY00060293
msi: Assigning MSI-X IRQ 261 to local APIC 6 vector 50
pass13: 300.000MB/s transfers
msi: Assigning MSI IRQ 263 to local APIC 2 vector 51

pass13: Command Queueing enabled
pass14 at mps0 bus 0 scbus0 target 17 lun 0
pass14: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass14: Serial Number      WD-WMAY01113837
pass14: 300.000MB/s transfers
pass14: Command Queueing enabled
pass15 at mps0 bus 0 scbus0 target 11 lun 0
pass15: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass15: Serial Number      WD-WMAY00562999
pass15: 300.000MB/s transfers
pass15: Command Queueing enabled
pass16 at mps0 bus 0 scbus0 target 16 lun 0
pass16: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass16: Serial Number      WD-WMAY00058336
pass16: 300.000MB/s transfers
pass16: Command Queueing enabled
pass17 at mps0 bus 0 scbus0 target 12 lun 0
pass17: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass17: Serial Number      WD-WMAY00058751
pass17: 300.000MB/s transfers
pass17: Command Queueing enabled
pass18 at mps0 bus 0 scbus0 target 20 lun 0
pass18: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass18: Serial Number      WD-WMAY01141093
pass18: 300.000MB/s transfers
pass18: Command Queueing enabled
pass19 at mps0 bus 0 scbus0 target 10 lun 0
pass19: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass19: Serial Number      WD-WMAY00551108
pass19: 300.000MB/s transfers
pass19: Command Queueing enabled
pass20 at mps0 bus 0 scbus0 target 22 lun 0
pass20: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass20: Serial Number      WD-WMAY00760780
pass20: 300.000MB/s transfers
pass20: Command Queueing enabled
pass21 at mps0 bus 0 scbus0 target 18 lun 0
pass21: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass21: Serial Number      WD-WMAY00608732
pass21: 300.000MB/s transfers
pass21: Command Queueing enabled
pass22 at mps0 bus 0 scbus0 target 19 lun 0
pass22: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass22: Serial Number      WD-WMAY01112173
pass22: 300.000MB/s transfers
pass22: Command Queueing enabled
pass23 at mps0 bus 0 scbus0 target 21 lun 0
pass23: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass23: Serial Number      WD-WMAY01220605
pass23: 300.000MB/s transfers
pass23: Command Queueing enabled
pass24 at mps0 bus 0 scbus0 target 23 lun 0
pass24: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
pass24: Serial Number      WD-WMAY00644752
pass24: 300.000MB/s transfers
pass24: Command Queueing enabled
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
pass25 at mps0 bus 0 scbus0 target 24 lun 0
pass25: <LSI CORP SAS2X36 0417> Fixed Enclosure Services SCSI-5 device 
pass25: Serial Number 
pass25: 600.000MB/s transfers
pass25: Command Queueing enabled
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe24:mps0:0:24:0): SCSI status error
(probe24:mps0:0:24:0): MODE SENSE(6). CDB: 1a 0 a 0 14 0 
(probe24:mps0:0:24:0): CAM status: SCSI Status Error
(probe24:mps0:0:24:0): SCSI status: Check Condition
(probe24:mps0:0:24:0): SCSI sense: ILLEGAL REQUEST asc:24,0 (Invalid field in CDB)
(probe24:mps0:0:24:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe200:mps0:0:200:0): Down reving Protocol Version from 4 to 2?
(probe200:mps0:0:200:0): Error 22, Unretryable error
(probe24:mps0:0:24:0): SCSI status error
(probe24:mps0:0:24:0): MODE SENSE(6). CDB: 1a 0 a 0 14 0 
(probe24:mps0:0:24:0): CAM status: SCSI Status Error
(probe24:mps0:0:24:0): SCSI status: Check Condition
(probe24:mps0:0:24:0): SCSI sense: ILLEGAL REQUEST asc:24,0 (Invalid field in CDB)
(probe24:mps0:0:24:0): Error 22, Unretryable error
(probe24:mps0:0:24:0): SCSI status error
(probe24:mps0:0:24:0): MODE SENSE(6). CDB: 1a 0 a 0 14 0 
(probe24:mps0:0:24:0): CAM status: SCSI Status Error
(probe24:mps0:0:24:0): SCSI status: Check Condition
(probe24:mps0:0:24:0): SCSI sense: ILLEGAL REQUEST asc:24,0 (Invalid field in CDB)
(probe24:mps0:0:24:0): Error 22, Unretryable error
(probe24:mps0:0:24:0): SCSI status error
(probe24:mps0:0:24:0): MODE SENSE(6). CDB: 1a 0 a 0 14 0 
(probe24:mps0:0:24:0): CAM status: SCSI Status Error
(probe24:mps0:0:24:0): SCSI status: Check Condition
(probe24:mps0:0:24:0): SCSI sense: ILLEGAL REQUEST asc:24,0 (Invalid field in CDB)
(probe24:mps0:0:24:0): Error 22, Unretryable error
(probe24:mps0:0:24:0): SCSI status error
(probe24:mps0:0:24:0): MODE SENSE(6). CDB: 1a 0 a 0 14 0 
(probe24:mps0:0:24:0): CAM status: SCSI Status Error
(probe24:mps0:0:24:0): SCSI status: Check Condition
(probe24:mps0:0:24:0): SCSI sense: ILLEGAL REQUEST asc:24,0 (Invalid field in CDB)
(probe24:mps0:0:24:0): Error 22, Unretryable error
(probe24:mps0:0:24:0): SCSI status error
(probe24:mps0:0:24:0): MODE SENSE(6). CDB: 1a 0 a 0 14 0 
(probe24:mps0:0:24:0): CAM status: SCSI Status Error
(probe24:mps0:0:24:0): SCSI status: Check Condition
(probe24:mps0:0:24:0): SCSI sense: ILLEGAL REQUEST asc:24,0 (Invalid field in CDB)
(probe24:mps0:0:24:0): Error 22, Unretryable error
(probe24:mps0:0:24:0): SCSI status error
(probe24:mps0:0:24:0): MODE SENSE(6). CDB: 1a 0 a 0 14 0 
(probe24:mps0:0:24:0): CAM status: SCSI Status Error
(probe24:mps0:0:24:0): SCSI status: Check Condition
(probe24:mps0:0:24:0): SCSI sense: ILLEGAL REQUEST asc:24,0 (Invalid field in CDB)
(probe24:mps0:0:24:0): Error 22, Unretryable error
(probe24:mps0:0:24:0): SCSI status error
(probe24:mps0:0:24:0): MODE SENSE(6). CDB: 1a 0 a 0 14 0 
(probe24:mps0:0:24:0): CAM status: SCSI Status Error
(probe24:mps0:0:24:0): SCSI status: Check Condition
(probe24:mps0:0:24:0): SCSI sense: ILLEGAL REQUEST asc:24,0 (Invalid field in CDB)
(probe24:mps0:0:24:0): Error 22, Unretryable error
(probe24:mps0:0:24:0): SCSI status error
(probe24:mps0:0:24:0): MODE SENSE(6). CDB: 1a 0 a 0 14 0 
(probe24:mps0:0:24:0): CAM status: SCSI Status Error
(probe24:mps0:0:24:0): SCSI status: Check Condition
(probe24:mps0:0:24:0): SCSI sense: ILLEGAL REQUEST asc:24,0 (Invalid field in CDB)
(probe24:mps0:0:24:0): Error 22, Unretryable error
(probe24:mps0:0:24:0): SCSI status error
(probe24:mps0:0:24:0): MODE SENSE(6). CDB: 1a 0 a 0 14 0 
(probe24:mps0:0:24:0): CAM status: SCSI Status Error
(probe24:mps0:0:24:0): SCSI status: Check Condition
(probe24:mps0:0:24:0): SCSI sense: ILLEGAL REQUEST asc:24,0 (Invalid field in CDB)
(probe24:mps0:0:24:0): Error 22, Unretryable error
(probe24:mps0:0:24:0): SCSI status error
(probe24:mps0:0:24:0): MODE SENSE(6). CDB: 1a 0 a 0 14 0 
(probe24:mps0:0:24:0): CAM status: SCSI Status Error
(probe24:mps0:0:24:0): SCSI status: Check Condition
(probe24:mps0:0:24:0): SCSI sense: ILLEGAL REQUEST asc:24,0 (Invalid field in CDB)
(probe24:mps0:0:24:0): Error 22, Unretryable error
(probe24:mps0:0:24:0): SCSI status error
(probe24:mps0:0:24:0): MODE SENSE(6). CDB: 1a 0 a 0 14 0 
(probe24:mps0:0:24:0): CAM status: SCSI Status Error
(probe24:mps0:0:24:0): SCSI status: Check Condition
(probe24:mps0:0:24:0): SCSI sense: ILLEGAL REQUEST asc:24,0 (Invalid field in CDB)
(probe24:mps0:0:24:0): Error 22, Unretryable error
(probe24:mps0:0:24:0): SCSI status error
(probe24:mps0:0:24:0): MODE SENSE(6). CDB: 1a 0 a 0 14 0 
(probe24:mps0:0:24:0): CAM status: SCSI Status Error
(probe24:mps0:0:24:0): SCSI status: Check Condition
(probe24:mps0:0:24:0): SCSI sense: ILLEGAL REQUEST asc:24,0 (Invalid field in CDB)
(probe24:mps0:0:24:0): Error 22, Unretryable error
(probe24:mps0:0:24:0): SCSI status error
(probe24:mps0:0:24:0): MODE SENSE(6). CDB: 1a 0 a 0 14 0 
(probe24:mps0:0:24:0): CAM status: SCSI Status Error
(probe24:mps0:0:24:0): SCSI status: Check Condition
(probe24:mps0:0:24:0): SCSI sense: ILLEGAL REQUEST asc:24,0 (Invalid field in CDB)
(probe24:mps0:0:24:0): Error 22, Unretryable error
da10 at mps0 bus 0 scbus0 target 15 lun 0
da10: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da10: Serial Number      WD-WMAY00063009
da10: 300.000MB/s transfers
da10: Command Queueing enabled
da10: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da14 at mps0 bus 0 scbus0 target 11 lun 0
da14: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da14: Serial Number      WD-WMAY00562999
da14: 300.000MB/s transfers
da14: Command Queueing enabled
da14: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da11 at mps0 bus 0 scbus0 target 14 lun 0
da11: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da11: Serial Number      WD-WMAY00060983
da11: 300.000MB/s transfers
da11: Command Queueing enabled
da11: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da12 at mps0 bus 0 scbus0 target 13 lun 0
da12: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da12: Serial Number      WD-WMAY00060293
da12: 300.000MB/s transfers
da12: Command Queueing enabled
da12: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da13 at mps0 bus 0 scbus0 target 17 lun 0
da13: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da13: Serial Number      WD-WMAY01113837
da13: 300.000MB/s transfers
da13: Command Queueing enabled
da13: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
GEOM: new disk da11
GEOM: new disk da12
GEOM: new disk da13
GEOM: new disk da14
GEOM: new disk da15
GEOM: new disk da16
GEOM: new disk da17da16 at mps0 bus 0 scbus0 target 12 lun 0
GEOM: new disk da18
da16: 
GEOM: new disk da19<ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
GEOM: new disk da20
da16: Serial Number      WD-WMAY00058751
GEOM: new disk da21
da16: 300.000MB/s transfers
GEOM: new disk da22
GEOM: new disk da23
da16: Command Queueing enabled

da16: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da19 at mps0 bus 0 scbus0 target 22 lun 0
da19: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da19: Serial Number      WD-WMAY00760780
da19: 300.000MB/s transfers
da19: Command Queueing enabled
da19: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da18 at mps0 bus 0 scbus0 target 10 lun 0
da18: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da18: Serial Number      WD-WMAY00551108
da18: 300.000MB/s transfers
da18: Command Queueing enabled
da18: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da17 at mps0 bus 0 scbus0 target 20 lun 0
da17: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da17: Serial Number      WD-WMAY01141093
da17: 300.000MB/s transfers
da17: Command Queueing enabled
da17: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da23 at mps0 bus 0 scbus0 target 23 lun 0
da23: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da23: Serial Number      WD-WMAY00644752
da23: 300.000MB/s transfers
da23: Command Queueing enabled
da23: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da22 at mps0 bus 0 scbus0 target 21 lun 0
da22: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da22: Serial Number      WD-WMAY01220605
da22: 300.000MB/s transfers
da22: Command Queueing enabled
da22: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da21 at mps0 bus 0 scbus0 target 19 lun 0
da21: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da21: Serial Number      WD-WMAY01112173
da21: 300.000MB/s transfers
da21: Command Queueing enabled
da21: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da20 at mps0 bus 0 scbus0 target 18 lun 0
da20: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da20: Serial Number      WD-WMAY00608732
da20: 300.000MB/s transfers
da20: Command Queueing enabled
da20: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da15 at mps0 bus 0 scbus0 target 16 lun 0
da15: <ATA WDC WD2003FYYS-0 1D01> Fixed Direct Access SCSI-5 device 
da15: Serial Number      WD-WMAY00058336
da15: 300.000MB/s transfers
da15: Command Queueing enabled
da15: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
Trying to mount root from zfs:m/R
start_init: trying /sbin/init
WARNING: /bootdisk was not properly dismounted
ipfw2 initialized, divert loadable, nat loadable, rule-based forwarding disabled, default to deny, logging disabled
ipfw0: bpf attached
em0: Link is up 1000 Mbps Full Duplex
em0: link state changed to UP


More information about the freebsd-stable mailing list