under ZFS, I can reliably crash my systems

Dennis Glatting freebsd at pki2.com
Fri Oct 5 14:33:58 UTC 2012



I don't know if this will be useful but I have a crash dump caused by
executing a "panic" in an NMI with the kernel configured for DDB. I ran
a few commands under DDB, which looked interesting, but I haven't
figured out how to capture the output.

The crash dump is here:

	http://www.pki2.com:/ZFS.crash.04Oct2012


I have five ZFS systems and can reliably crash four of them -- just
place them under heavy load. The fifth system isn't used for the same
purposes. The four crashing systems are AMD systems whereas the fifth
(the one that doesn't give me grief) is Intel. On the system below I had
just rebuilt the disk-1 array a few hours earlier.

What does "crash" mean? Below is a "top" example where all of the
processes are stuck on I/O. The top was still running, so the network
was fine and the kernel alive. In other widows open to the server, the
network was fine but no command seemed to execute, such as "ps", "ls",
or "reboot" (i.e., I enter the command then nothing).

What do I need to provide you to debug this problem?




last pid: 16210;  load averages:  0.02,  2.40, 17.18    up 0+00:59:57
21:51:27
85 processes:  1 running, 84 sleeping
CPU:  0.0% user,  0.0% nice,  0.0% system,  0.0% interrupt,  100% idle
Mem: 153M Active, 2641M Inact, 16G Wired, 26M Buf, 105G Free
ARC: 14G Total, 1940M MRU, 12G MFU, 58M Anon, 58M Header, 35M Other
Swap: 233G Total, 233G Free

USERNAME    THR PRI NICE   SIZE    RES STATE   C   TIME   WCPU COMMAND
 2817 root         17  52    4   201M   112M tx->tx 34  68:06  0.00%
pbzip2
 2835 root         17  52    4   201M   111M tx->tx 39  67:18  0.00%
pbzip2
 2775 root         17  52    4   205M   114M tx->tx  8  66:51  0.00%
pbzip2
 2826 root         17  52    4   205M   115M tx->tx 40  66:20  0.00%
pbzip2
 2784 root         17  52    4   205M   113M tx->tx 38  66:17  0.00%
pbzip2
 2811 root         17  52    4   205M   116M tx->tx 19  65:56  0.00%
pbzip2
 2805 root         17  52    4   201M   114M tx->tx 24  65:55  0.00%
pbzip2
 2823 root         17  52    4   205M   118M tx->tx 57  65:55  0.00%
pbzip2
 2799 root         17  52    4   201M   114M tx->tx 40  65:23  0.00%
pbzip2
 2820 root         17  52    4   205M   116M tx->tx 55  65:19  0.00%
pbzip2
 2829 root         17  52    4   209M   122M tx->tx 10  65:06  0.00%
pbzip2
 2814 root         17  52    4   205M   114M tx->tx 40  64:54  0.00%
pbzip2
 2808 root         17  52    4   205M   117M tx->tx 14  64:52  0.00%
pbzip2
 2802 root         17  52    4   205M   116M tx->tx 13  64:51  0.00%
pbzip2
 2832 root         17  52    4   201M   115M tx->tx 51  64:49  0.00%
pbzip2
 2790 root         17  52    4   209M   119M tx->tx 53  64:38  0.00%
pbzip2
 2787 root         17  52    4   201M   112M tx->tx 28  64:00  0.00%
pbzip2
 2778 root         17  52    4   205M   117M tx->tx 50  63:51  0.00%
pbzip2
 2766 root         17  52    4   201M   111M tx->tx  4  63:29  0.00%
pbzip2
 2793 root         17  52    4   205M   118M tx->tx  6  63:24  0.00%
pbzip2
 2772 root         17  52    4   201M   115M tx->tx 44  62:57  0.00%
pbzip2
 2781 root         17  52    4   205M   116M tx->tx 55  62:13  0.00%
pbzip2
 2769 root         17  52    4   205M   111M tx->tx 41  62:00  0.00%
pbzip2
 2796 root         17  52    4   201M   118M tx->tx 46  61:51  0.00%
pbzip2
 2828 root          1  20    0 28648K  5444K pipewr 36   3:48  0.00%
john
 2777 root          1  20    0 28648K  5396K pipewr 26   3:00  0.00%
john
 2792 root          1  20    0 28648K  5412K pipewr 62   2:51  0.00%
john
 2795 root          1  20    0 28648K  5432K pipewr 44   2:40  0.00%
john
 2831 root          1  20    0 28648K  5440K pipewr 22   2:38  0.00%
john
 2807 root          1  20    0 28648K  5444K pipewr 23   2:32  0.00%
john
 2819 root          1  20    0 28648K  5440K pipewr 44   2:32  0.00%
john
 2804 root          1  20    0 28648K  5444K pipewr 46   2:31  0.00%
john
 2789 root          1  20    0 28648K  5392K pipewr 60   2:28  0.00%
john
 2786 root          1  20    0 28648K  5392K pipewr 60   2:26  0.00%
john
 2825 root          1  20    0 28648K  5444K pipewr 25   2:24  0.00%
john
 



mc# uname -a
FreeBSD mc 9.1-PRERELEASE FreeBSD 9.1-PRERELEASE #3 r241040M: Tue Oct  2
22:51:12 PDT 2012     root at mc:/sys/amd64/compile/DTRACE  amd64



mc# zpool status
  pool: disk-1
 state: ONLINE
  scan: none requested
config:

	NAME        STATE     READ WRITE CKSUM
	disk-1      ONLINE       0     0     0
	  raidz2-0  ONLINE       0     0     0
	    da5     ONLINE       0     0     0
	    da6     ONLINE       0     0     0
	    da7     ONLINE       0     0     0
	    da2     ONLINE       0     0     0
	    da3     ONLINE       0     0     0
	    da4     ONLINE       0     0     0
	cache
	  da0       ONLINE       0     0     0

errors: No known data errors

  pool: disk-2
 state: ONLINE
  scan: scrub repaired 0 in 0h6m with 0 errors on Thu Oct  4 20:29:35
2012
config:

	NAME        STATE     READ WRITE CKSUM
	disk-2      ONLINE       0     0     0
	  mirror-0  ONLINE       0     0     0
	    da9     ONLINE       0     0     0
	    da10    ONLINE       0     0     0

errors: No known data errors




I do not normally get the swap space error below. I assume this is from
the operating system when I rebooted from the panic. The probe errors
showed up across the servers last summer after I csup them. I remember
reading on one of the lists they are harmless, though it would be nice
if they would go away. :)


mc# dmesg
Copyright (c) 1992-2012 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 9.1-PRERELEASE #3 r241040M: Tue Oct  2 22:51:12 PDT 2012
    root at mc:/sys/amd64/compile/DTRACE amd64
CPU: AMD Opteron(TM) Processor 6274                  (2200.07-MHz
K8-class CPU)
  Origin = "AuthenticAMD"  Id = 0x600f12  Family = 0x15  Model = 0x1
Stepping = 2

Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>

Features2=0x1e98220b<SSE3,PCLMULQDQ,MON,SSSE3,CX16,SSE4.1,SSE4.2,POPCNT,AESNI,XSAVE,OSXSAVE,AVX>
  AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
  AMD
Features2=0x1c9bfff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,XOP,SKINIT,WDT,LWP,FMA4,NodeId,Topology,<b23>,<b24>>
  TSC: P-state invariant, performance statistics
real memory  = 137438953472 (131072 MB)
avail memory = 132423389184 (126288 MB)
Event timer "LAPIC" quality 400
ACPI APIC Table: <120911 APIC1027>
FreeBSD/SMP: Multiprocessor System Detected: 64 CPUs
FreeBSD/SMP: 4 package(s) x 16 core(s)
 cpu0 (BSP): APIC ID: 32
 cpu1 (AP): APIC ID: 33
 cpu2 (AP): APIC ID: 34
 cpu3 (AP): APIC ID: 35
 cpu4 (AP): APIC ID: 36
 cpu5 (AP): APIC ID: 37
 cpu6 (AP): APIC ID: 38
 cpu7 (AP): APIC ID: 39
 cpu8 (AP): APIC ID: 40
 cpu9 (AP): APIC ID: 41
 cpu10 (AP): APIC ID: 42
 cpu11 (AP): APIC ID: 43
 cpu12 (AP): APIC ID: 44
 cpu13 (AP): APIC ID: 45
 cpu14 (AP): APIC ID: 46
 cpu15 (AP): APIC ID: 47
 cpu16 (AP): APIC ID: 64
 cpu17 (AP): APIC ID: 65
 cpu18 (AP): APIC ID: 66
 cpu19 (AP): APIC ID: 67
 cpu20 (AP): APIC ID: 68
 cpu21 (AP): APIC ID: 69
 cpu22 (AP): APIC ID: 70
 cpu23 (AP): APIC ID: 71
 cpu24 (AP): APIC ID: 72
 cpu25 (AP): APIC ID: 73
 cpu26 (AP): APIC ID: 74
 cpu27 (AP): APIC ID: 75
 cpu28 (AP): APIC ID: 76
 cpu29 (AP): APIC ID: 77
 cpu30 (AP): APIC ID: 78
 cpu31 (AP): APIC ID: 79
 cpu32 (AP): APIC ID: 96
 cpu33 (AP): APIC ID: 97
 cpu34 (AP): APIC ID: 98
 cpu35 (AP): APIC ID: 99
 cpu36 (AP): APIC ID: 100
 cpu37 (AP): APIC ID: 101
 cpu38 (AP): APIC ID: 102
 cpu39 (AP): APIC ID: 103
 cpu40 (AP): APIC ID: 104
 cpu41 (AP): APIC ID: 105
 cpu42 (AP): APIC ID: 106
 cpu43 (AP): APIC ID: 107
 cpu44 (AP): APIC ID: 108
 cpu45 (AP): APIC ID: 109
 cpu46 (AP): APIC ID: 110
 cpu47 (AP): APIC ID: 111
 cpu48 (AP): APIC ID: 128
 cpu49 (AP): APIC ID: 129
 cpu50 (AP): APIC ID: 130
 cpu51 (AP): APIC ID: 131
 cpu52 (AP): APIC ID: 132
 cpu53 (AP): APIC ID: 133
 cpu54 (AP): APIC ID: 134
 cpu55 (AP): APIC ID: 135
 cpu56 (AP): APIC ID: 136
 cpu57 (AP): APIC ID: 137
 cpu58 (AP): APIC ID: 138
 cpu59 (AP): APIC ID: 139
 cpu60 (AP): APIC ID: 140
 cpu61 (AP): APIC ID: 141
 cpu62 (AP): APIC ID: 142
 cpu63 (AP): APIC ID: 143
ACPI Warning: Optional field Pm2ControlBlock has zero address or length:
0x0000000000000000/0x1 (20110527/tbfadt-583)
ioapic0 <Version 2.1> irqs 0-23 on motherboard
ioapic1 <Version 2.1> irqs 24-55 on motherboard
kbd1 at kbdmux0
module_register_init: MOD_LOAD (vesa, 0xffffffff80bcb500, 0) error 19
ctl: CAM Target Layer loaded
cryptosoft0: <software crypto> on motherboard
aesni0: <AES-CBC,AES-XTS> on motherboard
acpi0: <120911 XSDT1027> on motherboard
acpi0: Power Button (fixed)
acpi0: reservation of fec00000, 1000 (3) failed
acpi0: reservation of fee00000, 1000 (3) failed
acpi0: reservation of ffb80000, 80000 (3) failed
acpi0: reservation of fec10000, 20 (3) failed
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, dff00000 (3) failed
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
cpu4: <ACPI CPU> on acpi0
cpu5: <ACPI CPU> on acpi0
cpu6: <ACPI CPU> on acpi0
cpu7: <ACPI CPU> on acpi0
cpu8: <ACPI CPU> on acpi0
cpu9: <ACPI CPU> on acpi0
cpu10: <ACPI CPU> on acpi0
cpu11: <ACPI CPU> on acpi0
cpu12: <ACPI CPU> on acpi0
cpu13: <ACPI CPU> on acpi0
cpu14: <ACPI CPU> on acpi0
cpu15: <ACPI CPU> on acpi0
cpu16: <ACPI CPU> on acpi0
cpu17: <ACPI CPU> on acpi0
cpu18: <ACPI CPU> on acpi0
cpu19: <ACPI CPU> on acpi0
cpu20: <ACPI CPU> on acpi0
cpu21: <ACPI CPU> on acpi0
cpu22: <ACPI CPU> on acpi0
cpu23: <ACPI CPU> on acpi0
cpu24: <ACPI CPU> on acpi0
cpu25: <ACPI CPU> on acpi0
cpu26: <ACPI CPU> on acpi0
cpu27: <ACPI CPU> on acpi0
cpu28: <ACPI CPU> on acpi0
cpu29: <ACPI CPU> on acpi0
cpu30: <ACPI CPU> on acpi0
cpu31: <ACPI CPU> on acpi0
cpu32: <ACPI CPU> on acpi0
cpu33: <ACPI CPU> on acpi0
cpu34: <ACPI CPU> on acpi0
cpu35: <ACPI CPU> on acpi0
cpu36: <ACPI CPU> on acpi0
cpu37: <ACPI CPU> on acpi0
cpu38: <ACPI CPU> on acpi0
cpu39: <ACPI CPU> on acpi0
cpu40: <ACPI CPU> on acpi0
cpu41: <ACPI CPU> on acpi0
cpu42: <ACPI CPU> on acpi0
cpu43: <ACPI CPU> on acpi0
cpu44: <ACPI CPU> on acpi0
cpu45: <ACPI CPU> on acpi0
cpu46: <ACPI CPU> on acpi0
cpu47: <ACPI CPU> on acpi0
cpu48: <ACPI CPU> on acpi0
cpu49: <ACPI CPU> on acpi0
cpu50: <ACPI CPU> on acpi0
cpu51: <ACPI CPU> on acpi0
cpu52: <ACPI CPU> on acpi0
cpu53: <ACPI CPU> on acpi0
cpu54: <ACPI CPU> on acpi0
cpu55: <ACPI CPU> on acpi0
cpu56: <ACPI CPU> on acpi0
cpu57: <ACPI CPU> on acpi0
cpu58: <ACPI CPU> on acpi0
cpu59: <ACPI CPU> on acpi0
cpu60: <ACPI CPU> on acpi0
cpu61: <ACPI CPU> on acpi0
cpu62: <ACPI CPU> on acpi0
cpu63: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Timecounter "ACPI-safe" frequency 3579545 Hz quality 850
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pci0: <base peripheral> at device 0.2 (no driver attached)
pcib1: <ACPI PCI-PCI bridge> irq 52 at device 4.0 on pci0
pci5: <ACPI PCI bus> on pcib1
igb0: <Intel(R) PRO/1000 Network Connection version - 2.3.4> port
0xe400-0xe41f mem
0xfeb60000-0xfeb7ffff,0xfeb40000-0xfeb5ffff,0xfeb1c000-0xfeb1ffff irq 44
at device 0.0 on pci5
igb0: Using MSIX interrupts with 9 vectors
igb0: Ethernet address: 00:e0:81:c8:ee:8a
igb0: Bound queue 0 to cpu 0
igb0: Bound queue 1 to cpu 1
igb0: Bound queue 2 to cpu 2
igb0: Bound queue 3 to cpu 3
igb0: Bound queue 4 to cpu 4
igb0: Bound queue 5 to cpu 5
igb0: Bound queue 6 to cpu 6
igb0: Bound queue 7 to cpu 7
igb1: <Intel(R) PRO/1000 Network Connection version - 2.3.4> port
0xe800-0xe81f mem
0xfebe0000-0xfebfffff,0xfebc0000-0xfebdffff,0xfeb9c000-0xfeb9ffff irq 45
at device 0.1 on pci5
igb1: Using MSIX interrupts with 9 vectors
igb1: Ethernet address: 00:e0:81:c8:ee:8b
igb1: Bound queue 0 to cpu 8
igb1: Bound queue 1 to cpu 9
igb1: Bound queue 2 to cpu 10
igb1: Bound queue 3 to cpu 11
igb1: Bound queue 4 to cpu 12
igb1: Bound queue 5 to cpu 13
igb1: Bound queue 6 to cpu 14
igb1: Bound queue 7 to cpu 15
pcib2: <ACPI PCI-PCI bridge> irq 53 at device 9.0 on pci0
pci4: <ACPI PCI bus> on pcib2
em0: <Intel(R) PRO/1000 Network Connection 7.3.2> port 0xd800-0xd81f mem
0xfeae0000-0xfeafffff,0xfeadc000-0xfeadffff irq 48 at device 0.0 on pci4
em0: Using MSIX interrupts with 3 vectors
em0: Ethernet address: 00:e0:81:c8:ee:ff
pcib3: <ACPI PCI-PCI bridge> irq 54 at device 11.0 on pci0
pci3: <ACPI PCI bus> on pcib3
mps0: <LSI SAS2008> port 0xc000-0xc0ff mem
0xfe93c000-0xfe93ffff,0xfe940000-0xfe97ffff irq 32 at device 0.0 on pci3
mps0: Firmware: 14.00.00.00, Driver: 14.00.00.01-fbsd
mps0: IOCCapabilities:
1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc>
pcib4: <ACPI PCI-PCI bridge> irq 54 at device 13.0 on pci0
pci2: <ACPI PCI bus> on pcib4
mps1: <LSI SAS2008> port 0xb000-0xb0ff mem
0xfe83c000-0xfe83ffff,0xfe840000-0xfe87ffff irq 40 at device 0.0 on pci2
mps1: Firmware: 14.00.00.00, Driver: 14.00.00.01-fbsd
mps1: IOCCapabilities:
185c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,IR>
ahci0: <ATI IXP800 AHCI SATA controller> port
0x9000-0x9007,0x8000-0x8003,0x7000-0x7007,0x6000-0x6003,0x5000-0x500f
mem 0xfdefe400-0xfdefe7ff irq 22 at device 17.0 on pci0
ahci0: AHCI v1.10 with 4 3Gbps ports, Port Multiplier supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ohci0: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfdefa000-0xfdefafff
irq 16 at device 18.0 on pci0
usbus0 on ohci0
ohci1: <OHCI (generic) USB controller> mem 0xfdefb000-0xfdefbfff irq 16
at device 18.1 on pci0
usbus1 on ohci1
ehci0: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem
0xfdefe800-0xfdefe8ff irq 17 at device 18.2 on pci0
usbus2: EHCI version 1.0
usbus2 on ehci0
ohci2: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfdefc000-0xfdefcfff
irq 18 at device 19.0 on pci0
usbus3 on ohci2
ohci3: <OHCI (generic) USB controller> mem 0xfdefd000-0xfdefdfff irq 18
at device 19.1 on pci0
usbus4 on ohci3
ehci1: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem
0xfdefec00-0xfdefecff irq 19 at device 19.2 on pci0
usbus5: EHCI version 1.0
usbus5 on ehci1
pci0: <serial bus, SMBus> at device 20.0 (no driver attached)
atapci0: <ATI IXP700/800 UDMA133 controller> port
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xff00-0xff0f at device 20.1 on pci0
ata0: <ATA channel> at channel 0 on atapci0
ata1: <ATA channel> at channel 1 on atapci0
isab0: <PCI-ISA bridge> at device 20.3 on pci0
isa0: <ISA bus> on isab0
pcib5: <ACPI PCI-PCI bridge> at device 20.4 on pci0
pci1: <ACPI PCI bus> on pcib5
vgapci0: <VGA-compatible display> port 0xa800-0xa87f mem
0xfe000000-0xfe7fffff,0xfdfe0000-0xfdffffff irq 23 at device 9.0 on pci1
ohci4: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfdeff000-0xfdefffff
irq 18 at device 20.5 on pci0
usbus6 on ohci4
acpi_button0: <Power Button> on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart1: <Non-standard ns8250 class UART with FIFOs> port 0x2f8-0x2ff irq
3 on acpi0
ppc0: <Parallel port> port 0x378-0x37f irq 7 on acpi0
ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode
ppbus0: <Parallel port bus> on ppc0
plip0: <PLIP network interface> on ppbus0
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
orm0: <ISA Option ROM> at iomem 0xc0000-0xc7fff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: CGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3d0-0x3db iomem 0xb8000-0xbffff on
isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
acpi_throttle0: <ACPI CPU Throttling> on cpu0
Timecounters tick every 1.000 msec
usbus0: 12Mbps Full Speed USB v1.0
usbus1: 12Mbps Full Speed USB v1.0
usbus2: 480Mbps High Speed USB v2.0
usbus3: 12Mbps Full Speed USB v1.0
usbus4: 12Mbps Full Speed USB v1.0
usbus5: 480Mbps High Speed USB v2.0
usbus6: 12Mbps Full Speed USB v1.0
ugen0.1: <ATI> at usbus0
uhub0: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ugen1.1: <ATI> at usbus1
uhub1: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
ugen2.1: <ATI> at usbus2
uhub2: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus2
ugen3.1: <ATI> at usbus3
uhub3: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus3
ugen4.1: <ATI> at usbus4
uhub4: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus4
ugen5.1: <ATI> at usbus5
uhub5: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus5
ugen6.1: <ATI> at usbus6
uhub6: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus6
uhub6: 2 ports with 2 removable, self powered
uhub0: 3 ports with 3 removable, self powered
uhub1: 3 ports with 3 removable, self powered
uhub3: 3 ports with 3 removable, self powered
uhub4: 3 ports with 3 removable, self powered
uhub2: 6 ports with 6 removable, self powered
uhub5: 6 ports with 6 removable, self powered
ugen5.2: <American Megatrends Inc.> at usbus5
uhub7: <Hub Interface> on usbus5
(probe257:mps1:0:2:0): INQUIRY. CDB: 12 0 0 0 24 0 
(probe257:mps1:0:2:0): CAM status: Invalid Target ID
(probe257:mps1:0:2:0): Error 22, Unretryable error
(probe258:mps1:0:3:0): INQUIRY. CDB: 12 0 0 0 24 0 
(probe258:mps1:0:3:0): CAM status: Invalid Target ID
(probe258:mps1:0:3:0): Error 22, Unretryable error
(probe0:mps1:0:2:1): INQUIRY. CDB: 12 20 0 0 24 0 
(probe0:mps1:0:2:1): CAM status: Invalid Target ID
(probe0:mps1:0:2:1): Error 22, Unretryable error
(probe1:mps1:0:3:1): INQUIRY. CDB: 12 20 0 0 24 0 
(probe1:mps1:0:3:1): CAM status: Invalid Target ID
(probe1:mps1:0:3:1): Error 22, Unretryable error
(probe0:mps1:0:2:2): INQUIRY. CDB: 12 40 0 0 24 0 
(probe0:mps1:0:2:2): CAM status: Invalid Target ID
(probe0:mps1:0:2:2): Error 22, Unretryable error
(probe1:mps1:0:3:2): INQUIRY. CDB: 12 40 0 0 24 0 
(probe1:mps1:0:3:2): CAM status: Invalid Target ID
(probe1:mps1:0:3:2): Error 22, Unretryable error
(probe0:mps1:0:2:3): INQUIRY. CDB: 12 60 0 0 24 0 
(probe0:mps1:0:2:3): CAM status: Invalid Target ID
(probe0:mps1:0:2:3): Error 22, Unretryable error
(probe1:mps1:0:3:3): INQUIRY. CDB: 12 60 0 0 24 0 
(probe1:mps1:0:3:3): CAM status: Invalid Target ID
(probe1:mps1:0:3:3): Error 22, Unretryable error
(probe0:mps1:0:2:4): INQUIRY. CDB: 12 80 0 0 24 0 
(probe0:mps1:0:2:4): CAM status: Invalid Target ID
(probe0:mps1:0:2:4): Error 22, Unretryable error
(probe1:mps1:0:3:4): INQUIRY. CDB: 12 80 0 0 24 0 
(probe1:mps1:0:3:4): CAM status: Invalid Target ID
(probe1:mps1:0:3:4): Error 22, Unretryable error
(probe0:mps1:0:2:5): INQUIRY. CDB: 12 a0 0 0 24 0 
(probe0:mps1:0:2:5): CAM status: Invalid Target ID
(probe0:mps1:0:2:5): Error 22, Unretryable error
(probe1:mps1:0:3:5): INQUIRY. CDB: 12 a0 0 0 24 0 
(probe1:mps1:0:3:5): CAM status: Invalid Target ID
(probe1:mps1:0:3:5): Error 22, Unretryable error
(probe0:mps1:0:2:6): INQUIRY. CDB: 12 c0 0 0 24 0 
(probe0:mps1:0:2:6): CAM status: Invalid Target ID
(probe0:mps1:0:2:6): Error 22, Unretryable error
(probe1:mps1:0:3:6): INQUIRY. CDB: 12 c0 0 0 24 0 
(probe1:mps1:0:3:6): CAM status: Invalid Target ID
(probe1:mps1:0:3:6): Error 22, Unretryable error
(probe0:mps1:0:2:7): INQUIRY. CDB: 12 e0 0 0 24 0 
(probe0:mps1:0:2:7): CAM status: Invalid Target ID
(probe0:mps1:0:2:7): Error 22, Unretryable error
(probe1:mps1:0:3:7): INQUIRY. CDB: 12 e0 0 0 24 0 
(probe1:mps1:0:3:7): CAM status: Invalid Target ID
(probe1:mps1:0:3:7): Error 22, Unretryable error
(probe255:mps1:0:0:0): REPORT LUNS. CDB: a0 0 0 0 0 0 0 0 0 10 0 0 
(probe255:mps1:0:0:0): CAM status: SCSI Status Error
(probe255:mps1:0:0:0): SCSI status: Check Condition
(probe255:mps1:0:0:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid
command operation code)
(probe255:mps1:0:0:0): Command Specific Info: 0x2c4803c0
(probe255:mps1:0:0:0): Error 22, Unretryable error
(probe0:mps1:0:3:0): INQUIRY. CDB: 12 0 0 0 24 0 
(probe0:mps1:0:3:0): CAM status: Invalid Target ID
(probe0:mps1:0:3:0): Error 22, Unretryable error
(probe1:mps1:0:2:0): INQUIRY. CDB: 12 0 0 0 24 0 
(probe1:mps1:0:2:0): CAM status: Invalid Target ID
(probe1:mps1:0:2:0): Error 22, Unretryable error
(probe0:mps1:0:3:0): INQUIRY. CDB: 12 0 0 0 24 0 
(probe0:mps1:0:3:0): CAM status: Invalid Target ID
(probe0:mps1:0:3:0): Error 22, Unretryable error
(probe1:mps1:0:2:0): INQUIRY. CDB: 12 0 0 0 24 0 
(probe1:mps1:0:2:0): CAM status: Invalid Target ID
(probe1:mps1:0:2:0): Error 22, Unretryable error
(probe2:mps1:0:3:1): INQUIRY. CDB: 12 20 0 0 24 0 
(probe2:mps1:0:3:1): CAM status: Invalid Target ID
(probe2:mps1:0:3:1): Error 22, Unretryable error
(probe0:mps1:0:2:1): INQUIRY. CDB: 12 20 0 0 24 0 
(probe0:mps1:0:2:1): CAM status: Invalid Target ID
(probe0:mps1:0:2:1): Error 22, Unretryable error
(probe1:mps1:0:3:1): INQUIRY. CDB: 12 20 0 0 24 0 
(probe1:mps1:0:3:1): CAM status: Invalid Target ID
(probe1:mps1:0:3:1): Error 22, Unretryable error
(probe0:mps1:0:2:1): INQUIRY. CDB: 12 20 0 0 24 0 
(probe0:mps1:0:2:1): CAM status: Invalid Target ID
(probe0:mps1:0:2:1): Error 22, Unretryable error
(probe2:mps1:0:3:2): INQUIRY. CDB: 12 40 0 0 24 0 
(probe2:mps1:0:3:2): CAM status: Invalid Target ID
(probe2:mps1:0:3:2): Error 22, Unretryable error
(probe1:mps1:0:2:2): INQUIRY. CDB: 12 40 0 0 24 0 
(probe1:mps1:0:2:2): CAM status: Invalid Target ID
(probe1:mps1:0:2:2): Error 22, Unretryable error
(probe0:mps1:0:3:2): INQUIRY. CDB: 12 40 0 0 24 0 
(probe0:mps1:0:3:2): CAM status: Invalid Target ID
(probe0:mps1:0:3:2): Error 22, Unretryable error
(probe1:mps1:0:2:2): INQUIRY. CDB: 12 40 0 0 24 0 
(probe1:mps1:0:2:2): CAM status: Invalid Target ID
(probe1:mps1:0:2:2): Error 22, Unretryable error
(probe2:mps1:0:3:3): INQUIRY. CDB: 12 60 0 0 24 0 
(probe2:mps1:0:3:3): CAM status: Invalid Target ID
(probe2:mps1:0:3:3): Error 22, Unretryable error
(probe0:mps1:0:2:3): INQUIRY. CDB: 12 60 0 0 24 0 
(probe0:mps1:0:2:3): CAM status: Invalid Target ID
(probe0:mps1:0:2:3): Error 22, Unretryable error
(probe1:mps1:0:3:3): INQUIRY. CDB: 12 60 0 0 24 0 
(probe1:mps1:0:3:3): CAM status: Invalid Target ID
(probe1:mps1:0:3:3): Error 22, Unretryable error
(probe0:mps1:0:2:3): INQUIRY. CDB: 12 60 0 0 24 0 
(probe0:mps1:0:2:3): CAM status: Invalid Target ID
(probe0:mps1:0:2:3): Error 22, Unretryable error
(probe2:mps1:0:3:4): INQUIRY. CDB: 12 80 0 0 24 0 
(probe2:mps1:0:3:4): CAM status: Invalid Target ID
(probe2:mps1:0:3:4): Error 22, Unretryable error
(probe1:mps1:0:2:4): INQUIRY. CDB: 12 80 0 0 24 0 
(probe1:mps1:0:2:4): CAM status: Invalid Target ID
(probe1:mps1:0:2:4): Error 22, Unretryable error
(probe0:mps1:0:3:4): INQUIRY. CDB: 12 80 0 0 24 0 
(probe0:mps1:0:3:4): CAM status: Invalid Target ID
(probe0:mps1:0:3:4): Error 22, Unretryable error
(probe1:mps1:0:2:4): INQUIRY. CDB: 12 80 0 0 24 0 
(probe1:mps1:0:2:4): CAM status: Invalid Target ID
(probe1:mps1:0:2:4): Error 22, Unretryable error
(probe2:mps1:0:3:5): INQUIRY. CDB: 12 a0 0 0 24 0 
(probe2:mps1:0:3:5): CAM status: Invalid Target ID
(probe2:mps1:0:3:5): Error 22, Unretryable error
(probe0:mps1:0:2:5): INQUIRY. CDB: 12 a0 0 0 24 0 
(probe0:mps1:0:2:5): CAM status: Invalid Target ID
(probe0:mps1:0:2:5): Error 22, Unretryable error
(probe1:mps1:0:3:5): INQUIRY. CDB: 12 a0 0 0 24 0 
(probe1:mps1:0:3:5): CAM status: Invalid Target ID
(probe1:mps1:0:3:5): Error 22, Unretryable error
(probe0:mps1:0:2:5): INQUIRY. CDB: 12 a0 0 0 24 0 
(probe0:mps1:0:2:5): CAM status: Invalid Target ID
(probe0:mps1:0:2:5): Error 22, Unretryable error
(probe2:mps1:0:3:6): INQUIRY. CDB: 12 c0 0 0 24 0 
(probe2:mps1:0:3:6): CAM status: Invalid Target ID
(probe2:mps1:0:3:6): Error 22, Unretryable error
(probe1:mps1:0:2:6): INQUIRY. CDB: 12 c0 0 0 24 0 
(probe1:mps1:0:2:6): CAM status: Invalid Target ID
(probe1:mps1:0:2:6): Error 22, Unretryable error
(probe0:mps1:0:3:6): INQUIRY. CDB: 12 c0 0 0 24 0 
(probe0:mps1:0:3:6): CAM status: Invalid Target ID
(probe0:mps1:0:3:6): Error 22, Unretryable error
(probe1:mps1:0:2:6): INQUIRY. CDB: 12 c0 0 0 24 0 
(probe1:mps1:0:2:6): CAM status: Invalid Target ID
(probe1:mps1:0:2:6): Error 22, Unretryable error
(probe2:mps1:0:3:7): INQUIRY. CDB: 12 e0 0 0 24 0 
(probe2:mps1:0:3:7): CAM status: Invalid Target ID
(probe2:mps1:0:3:7): Error 22, Unretryable error
(probe0:mps1:0:2:7): INQUIRY. CDB: 12 e0 0 0 24 0 
(probe0:mps1:0:2:7): CAM status: Invalid Target ID
(probe0:mps1:0:2:7): Error 22, Unretryable error
(probe1:mps1:0:3:7): INQUIRY. CDB: 12 e0 0 0 24 0 
(probe1:mps1:0:3:7): CAM status: Invalid Target ID
(probe1:mps1:0:3:7): Error 22, Unretryable error
(probe0:mps1:0:2:7): INQUIRY. CDB: 12 e0 0 0 24 0 
(probe0:mps1:0:2:7): CAM status: Invalid Target ID
(probe0:mps1:0:2:7): Error 22, Unretryable error
uhub7: 3 ports with 3 removable, self powered
(probe255:mps1:0:0:0): REPORT LUNS. CDB: a0 0 0 0 0 0 0 0 0 10 0 0 
(probe255:mps1:0:0:0): CAM status: SCSI Status Error
(probe255:mps1:0:0:0): SCSI status: Check Condition
(probe255:mps1:0:0:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid
command operation code)
(probe255:mps1:0:0:0): Field Replaceable Unit: 56
(probe255:mps1:0:0:0): Command Specific Info: 0x33353839
(probe255:mps1:0:0:0): Error 22, Unretryable error
da0 at mps0 bus 0 scbus0 target 3 lun 0
da0: <ATA M4-CT256M4SSD2 000F> Fixed Direct Access SCSI-6 device 
da0: 600.000MB/s transfers
da0: Command Queueing enabled
da0: 244198MB (500118192 512 byte sectors: 255H 63S/T 31130C)
da1 at mps0 bus 0 scbus0 target 5 lun 0
da1: <ATA WDC WD2500HHTZ-0 6A00> Fixed Direct Access SCSI-6 device 
da1: 600.000MB/s transfers
da1: Command Queueing enabled
da1: 238475MB (488397168 512 byte sectors: 255H 63S/T 30401C)
da8 at mps1 bus 0 scbus1 target 0 lun 0
da8: <LSI Logical Volume 3000> Fixed Direct Access SCSI-6 device 
da8: 150.000MB/s transfers
da8: Command Queueing enabled
da8: 68664MB (140623872 512 byte sectors: 255H 63S/T 8753C)
da5 at mps0 bus 0 scbus0 target 9 lun 0
da5: <ATA ST3000DM001-1CH1 CC43> Fixed Direct Access SCSI-6 device 
da5: 600.000MB/s transfers
da5: Command Queueing enabled
da5: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C)
da7 at mps0 bus 0 scbus0 target 11 lun 0
da7: <ATA ST3000DM001-1CH1 CC43> Fixed Direct Access SCSI-6 device 
da7: 600.000MB/s transfers
da7: Command Queueing enabled
da7: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C)
da6 at mps0 bus 0 scbus0 target 10 lun 0
da6: <ATA ST3000DM001-1CH1 CC43> Fixed Direct Access SCSI-6 device 
da6: 600.000MB/s transfers
da6: Command Queueing enabled
da6: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C)
SMP: AP CPU #1 Launched!
SMP: AP CPU #47 Launched!
cd0 at ahcich0 bus 0 scbus2 target 0 lun 0
SMP: AP CPU #44 Launched!
cd0: <HL-DT-ST BD-RE  BH10LS30 1.00> Removable CD-ROM SCSI-0 device 
cd0: 150.000MB/s transfers (SATA 1.x, UDMA6, ATAPI 12bytes, PIO
8192bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present
- tray closed
SMP: AP CPU #57 Launched!
da3 at mps0 bus 0 scbus0 target 7 lun 0
da3: <ATA ST3000DM001-9YN1 CC4B> Fixed Direct Access SCSI-6 device 
da3: 600.000MB/s transfers
SMP: AP CPU #56 Launched!
da3: Command Queueing enabled
da3: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C)
SMP: AP CPU #39 Launched!
da2 at mps0 bus 0 scbus0 target 6 lun 0
da2: <ATA ST3000DM001-9YN1 CC4B> Fixed Direct Access SCSI-6 device 
da2: 600.000MB/s transfers
SMP: AP CPU #38 Launched!
da2: Command Queueing enabled
da2: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C)
SMP: AP CPU #33 Launched!
SMP: AP CPU #32 Launched!
SMP: AP CPU #31 Launched!
SMP: AP CPU #30 Launched!
da4 at mps0 bus 0 scbus0 target 8 lun 0
da4: <ATA ST3000DM001-9YN1 CC4B> Fixed Direct Access SCSI-6 device 
SMP: AP CPU #35 Launched!
da4: 600.000MB/s transfers
da4: Command Queueing enabled
da4: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C)
SMP: AP CPU #34 Launched!
SMP: AP CPU #36 Launched!
SMP: AP CPU #41 Launched!
SMP: AP CPU #42 Launched!
SMP: AP CPU #37 Launched!
SMP: AP CPU #25 Launched!
da9 at mps1 bus 0 scbus1 target 9 lun 0
SMP: AP CPU #59 Launched!
da9: <ATA Hitachi HDS5C404 A250> Fixed Direct Access SCSI-6 device 
da9: 600.000MB/s transfers
da9: Command Queueing enabled
SMP: AP CPU #58 Launched!
da9: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da10 at mps1 bus 0 scbus1 target 11 lun 0
da10: <ATA Hitachi HDS5C404 A3B0> Fixed Direct Access SCSI-6 device 
SMP: AP CPU #24 Launched!
da10: 600.000MB/s transfers
da10: Command Queueing enabled
da10: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
SMP: AP CPU #2 Launched!
SMP: AP CPU #29 Launched!
SMP: AP CPU #26 Launched!
SMP: AP CPU #63 Launched!
SMP: AP CPU #28 Launched!
SMP: AP CPU #60 Launched!
SMP: AP CPU #27 Launched!
SMP: AP CPU #5 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #8 Launched!
SMP: AP CPU #7 Launched!
SMP: AP CPU #13 Launched!
SMP: AP CPU #52 Launched!
SMP: AP CPU #49 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #50 Launched!
SMP: AP CPU #48 Launched!
SMP: AP CPU #4 Launched!
SMP: AP CPU #61 Launched!
SMP: AP CPU #51 Launched!
SMP: AP CPU #15 Launched!
SMP: AP CPU #10 Launched!
SMP: AP CPU #17 Launched!
SMP: AP CPU #18 Launched!
SMP: AP CPU #19 Launched!
SMP: AP CPU #62 Launched!
SMP: AP CPU #11 Launched!
SMP: AP CPU #53 Launched!
SMP: AP CPU #20 Launched!
SMP: AP CPU #55 Launched!
SMP: AP CPU #23 Launched!
SMP: AP CPU #16 Launched!
SMP: AP CPU #9 Launched!
SMP: AP CPU #14 Launched!
SMP: AP CPU #54 Launched!
SMP: AP CPU #22 Launched!
SMP: AP CPU #12 Launched!
SMP: AP CPU #21 Launched!
SMP: AP CPU #45 Launched!
SMP: AP CPU #40 Launched!
SMP: AP CPU #46 Launched!
SMP: AP CPU #43 Launched!
Timecounter "TSC-low" frequency 8594016 Hz quality 800
ugen5.3: <American Megatrends Inc.> at usbus5
ukbd0: <Keyboard Interface> on usbus5
kbd2 at ukbd0
ums0: <Mouse Interface> on usbus5
ums0: 3 buttons and [Z] coordinates ID=0
Trying to mount root from ufs:/dev/gpt/disk0 [rw]...
WARNING: / was not properly dismounted
ugen3.2: <BTC> at usbus3
ukbd1: <BTC USB Multimedia Keyboard, class 0/0, rev 1.10/1.00, addr 2>
on usbus3
kbd3 at ukbd1
uhid0: <BTC USB Multimedia Keyboard, class 0/0, rev 1.10/1.00, addr 2>
on usbus3
ZFS filesystem version 5
ZFS storage pool version 28
swap_pager: out of swap space
swap_pager_getswapspace(16): failed
pid 1847 (fstat), uid 0, was killed: out of swap space











More information about the freebsd-fs mailing list