zfs hang in zio->io_cv) with dd read

John Hay jhay at meraka.org.za
Thu Oct 7 12:16:03 UTC 2010


Hi,

I got hold of a SunFire X4500 with 48 X 500G disks and thought to try
FreeBSD 8-stable with zfs on it.

I have setup the two boot disks in a zfs mirror and then the rest in
a pool of 6 X raidz2 of 7 disks each.

I have created a 10G file with dd in the second pool, but if I try to read
it with dd, dd will hang in "zio->io_cv)" according to ^T. This happens
everytime. The first time I saw messages about an interrupt storm, so I
have put "hw.intr_storm_threshold=10000" in /etc/sysctl.conf. According to
"systat -vm 1" there is atapci for 2-3 seconds and then it is quiet.

The commandline that I use:

> cd /export/bonnie/
> ls -l
total 43812978
-rw-------  1 jhay  jhay  34359738368 Oct  5 20:06 Bonnie.20252
-rw-r--r--  1 jhay  jhay  10485760000 Oct  5 20:20 tst.dd
> dd if=tst.dd of=/dev/null bs=64k
^T
load: 0.98  cmd: dd 1391 [zio->io_cv)] 17.77r 0.00u 0.88s 0% 880k
^T
load: 0.00  cmd: dd 1391 [zio->io_cv)] 4473.68r 0.00u 0.88s 0% 880k

thumper1# procstat -k 1391
  PID    TID COMM             TDNAME           KSTACK                       
 1391 100205 dd               -                mi_switch sleepq_wait _cv_wait zio_wait dmu_buf_hold_array_by_dnode dmu_buf_hold_array dmu_read_uio zfs_freebsd_read vn_read dofileread kern_readv read syscall Xfast_syscall 
thumper1#

thumper1# zfs list
NAME             USED  AVAIL  REFER  MOUNTPOINT
dam             12.9G   436G    21K  none
dam/ROOT        12.9G   436G    21K  legacy
dam/ROOT/amd64  12.9G   436G  12.9G  legacy
dam/tmp         22.2M   436G  22.2M  /tmp
dam/usr_local   2.19M   436G  2.19M  /usr/local
dam/var         10.4M   436G  10.4M  /var
meer            41.8G  13.2T  44.8K  none
meer/export     41.8G  13.2T  41.8G  /export

thumper1# zpool status
  pool: dam
 state: ONLINE
 scrub: none requested
config:

	NAME                                            STATE     READ WRITE CKSUM
	dam                                             ONLINE       0     0     0
	  mirror                                        ONLINE       0     0     0
	    gptid/3c3167d3-cc45-11df-b85d-00144f211378  ONLINE       0     0     0
	    gptid/3c6eeb97-cc45-11df-b85d-00144f211378  ONLINE       0     0     0

errors: No known data errors

  pool: meer
 state: ONLINE
 scrub: none requested
config:

	NAME                                            STATE     READ WRITE CKSUM
	meer                                            ONLINE       0     0     0
	  raidz2                                        ONLINE       0     0     0
	    gptid/6e4ae922-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/6e647dae-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/6e7c905b-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/6e961440-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/6ed0304d-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/6ee9d7cb-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/6f0341a4-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	  raidz2                                        ONLINE       0     0     0
	    gptid/6f1fbb2b-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/6f3530cc-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/6f4f7635-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/6f6342f8-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/6f78bd12-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/6f8ec2d0-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/6fa35b89-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	  raidz2                                        ONLINE       0     0     0
	    gptid/6fd319f7-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/6fefa464-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/70084d1a-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/70225bd7-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/703b892d-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/705649a0-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/706f0a93-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	  raidz2                                        ONLINE       0     0     0
	    gptid/7087f6c9-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/70a04cca-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/70bbdc2d-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/70d4b6ed-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/70eabeba-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/7100fc20-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/71165baa-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	  raidz2                                        ONLINE       0     0     0
	    gptid/716a084d-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/71853bf5-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/719e0201-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/71b74306-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/71d1c11d-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/71ea1b93-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/7203c8d9-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	  raidz2                                        ONLINE       0     0     0
	    gptid/721b5a67-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/723a30d3-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/7256a502-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/72707600-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/7289edd1-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/72a21a0f-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	    gptid/72be2559-d067-11df-bc29-00144f211378  ONLINE       0     0     0
	spares
	  gptid/6e378541-d067-11df-bc29-00144f211378    AVAIL   
	  gptid/6fb986d9-d067-11df-bc29-00144f211378    AVAIL   
	  gptid/712f8225-d067-11df-bc29-00144f211378    AVAIL   
	  gptid/72d70248-d067-11df-bc29-00144f211378    AVAIL   

errors: No known data errors
thumper1# dmesg
Copyright (c) 1992-2010 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.1-STABLE #0: Thu Oct  7 10:43:27 UTC 2010
    jhay at thumper1:/usr/obj/usr/src/sys/THUMPER1 amd64
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Dual Core AMD Opteron(tm) Processor 285 (2592.63-MHz K8-class CPU)
  Origin = "AuthenticAMD"  Id = 0x20f12  Family = f  Model = 21  Stepping = 2
  Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
  Features2=0x1<SSE3>
  AMD Features=0xe2500800<SYSCALL,NX,MMX+,FFXSR,LM,3DNow!+,3DNow!>
  AMD Features2=0x3<LAHF,CMP>
real memory  = 17179869184 (16384 MB)
avail memory = 16476504064 (15713 MB)
ACPI APIC Table: <SUN    X4500   >
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 2 package(s) x 2 core(s)
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
 cpu2 (AP): APIC ID:  2
 cpu3 (AP): APIC ID:  3
MADT: Forcing active-low polarity and level trigger for SCI
ioapic0 <Version 1.1> irqs 0-23 on motherboard
ioapic1 <Version 1.1> irqs 24-30 on motherboard
ioapic2 <Version 1.1> irqs 31-37 on motherboard
ioapic3 <Version 1.1> irqs 38-44 on motherboard
ioapic4 <Version 1.1> irqs 45-51 on motherboard
ioapic5 <Version 1.1> irqs 52-58 on motherboard
ioapic6 <Version 1.1> irqs 59-65 on motherboard
ioapic7 <Version 1.1> irqs 66-72 on motherboard
ioapic8 <Version 1.1> irqs 73-79 on motherboard
ioapic9 <Version 1.1> irqs 80-86 on motherboard
ioapic10 <Version 1.1> irqs 87-93 on motherboard
kbd1 at kbdmux0
acpi0: <SUN X4500> on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, f9f00000 (3) failed
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1808-0x180b on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib1
atapci0: <Marvell 88SX6081 SATA300 controller> port 0x7c00-0x7cff mem 0xfae00000-0xfaefffff irq 24 at device 1.0 on pci1
atapci0: [ITHREAD]
ata2: <ATA channel 0> on atapci0
ata2: [ITHREAD]
ata3: <ATA channel 1> on atapci0
ata3: [ITHREAD]
ata4: <ATA channel 2> on atapci0
ata4: [ITHREAD]
ata5: <ATA channel 3> on atapci0
ata5: [ITHREAD]
ata6: <ATA channel 4> on atapci0
ata6: [ITHREAD]
ata7: <ATA channel 5> on atapci0
ata7: [ITHREAD]
ata8: <ATA channel 6> on atapci0
ata8: [ITHREAD]
ata9: <ATA channel 7> on atapci0
ata9: [ITHREAD]
pcib2: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pci2: <ACPI PCI bus> on pcib2
atapci1: <Marvell 88SX6081 SATA300 controller> port 0x8c00-0x8cff mem 0xfb000000-0xfb0fffff irq 32 at device 1.0 on pci2
atapci1: [ITHREAD]
ata10: <ATA channel 0> on atapci1
ata10: [ITHREAD]
ata11: <ATA channel 1> on atapci1
ata11: [ITHREAD]
ata12: <ATA channel 2> on atapci1
ata12: [ITHREAD]
ata13: <ATA channel 3> on atapci1
ata13: [ITHREAD]
ata14: <ATA channel 4> on atapci1
ata14: [ITHREAD]
ata15: <ATA channel 5> on atapci1
ata15: [ITHREAD]
ata16: <ATA channel 6> on atapci1
ata16: [ITHREAD]
ata17: <ATA channel 7> on atapci1
ata17: [ITHREAD]
pcib3: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci3: <ACPI PCI bus> on pcib3
ohci0: <OHCI (generic) USB controller> mem 0xfd1fe000-0xfd1fefff irq 19 at device 0.0 on pci3
ohci0: [ITHREAD]
usbus0: <OHCI (generic) USB controller> on ohci0
ohci1: <OHCI (generic) USB controller> mem 0xfd1fd000-0xfd1fdfff irq 19 at device 0.1 on pci3
ohci1: [ITHREAD]
usbus1: <OHCI (generic) USB controller> on ohci1
vgapci0: <VGA-compatible display> port 0x9800-0x98ff mem 0xfc000000-0xfcffffff,0xfd1ff000-0xfd1fffff irq 16 at device 3.0 on pci3
ohci2: <NEC uPD 9210 USB controller> mem 0xfd1fc000-0xfd1fcfff irq 17 at device 4.0 on pci3
ohci2: [ITHREAD]
usbus2: <NEC uPD 9210 USB controller> on ohci2
ohci3: <NEC uPD 9210 USB controller> mem 0xfd1fb000-0xfd1fbfff irq 18 at device 4.1 on pci3
ohci3: [ITHREAD]
usbus3: <NEC uPD 9210 USB controller> on ohci3
ehci0: <NEC uPD 720100 USB 2.0 controller> mem 0xfd1fac00-0xfd1facff irq 19 at device 4.2 on pci3
ehci0: [ITHREAD]
usbus4: EHCI version 1.0
usbus4: <NEC uPD 720100 USB 2.0 controller> on ehci0
isab0: <PCI-ISA bridge> at device 7.0 on pci0
isa0: <ISA bus> on isab0
atapci2: <AMD 8111 UDMA133 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xffa0-0xffaf at device 7.1 on pci0
ata0: <ATA channel 0> on atapci2
ata0: [ITHREAD]
ata1: <ATA channel 1> on atapci2
ata1: [ITHREAD]
pci0: <serial bus, SMBus> at device 7.2 (no driver attached)
pci0: <bridge> at device 7.3 (no driver attached)
pcib4: <ACPI Host-PCI bridge> on acpi0
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> at device 3.0 on pci4
pci5: <ACPI PCI bus> on pcib5
atapci3: <Marvell 88SX6081 SATA300 controller> port 0xac00-0xacff mem 0xfd700000-0xfd7fffff irq 38 at device 1.0 on pci5
atapci3: [ITHREAD]
ata18: <ATA channel 0> on atapci3
ata18: [ITHREAD]
ata19: <ATA channel 1> on atapci3
ata19: [ITHREAD]
ata20: <ATA channel 2> on atapci3
ata20: [ITHREAD]
ata21: <ATA channel 3> on atapci3
ata21: [ITHREAD]
ata22: <ATA channel 4> on atapci3
ata22: [ITHREAD]
ata23: <ATA channel 5> on atapci3
ata23: [ITHREAD]
ata24: <ATA channel 6> on atapci3
ata24: [ITHREAD]
ata25: <ATA channel 7> on atapci3
ata25: [ITHREAD]
pcib6: <ACPI PCI-PCI bridge> at device 4.0 on pci4
pci6: <ACPI PCI bus> on pcib6
atapci4: <Marvell 88SX6081 SATA300 controller> port 0xbc00-0xbcff mem 0xfd900000-0xfd9fffff irq 46 at device 1.0 on pci6
atapci4: [ITHREAD]
ata26: <ATA channel 0> on atapci4
ata26: [ITHREAD]
ata27: <ATA channel 1> on atapci4
ata27: [ITHREAD]
ata28: <ATA channel 2> on atapci4
ata28: [ITHREAD]
ata29: <ATA channel 3> on atapci4
ata29: [ITHREAD]
ata30: <ATA channel 4> on atapci4
ata30: [ITHREAD]
ata31: <ATA channel 5> on atapci4
ata31: [ITHREAD]
ata32: <ATA channel 6> on atapci4
ata32: [ITHREAD]
ata33: <ATA channel 7> on atapci4
ata33: [ITHREAD]
pcib7: <ACPI PCI-PCI bridge> at device 5.0 on pci4
pci7: <ACPI PCI bus> on pcib7
em0: <Intel(R) PRO/1000 Legacy Network Connection 1.0.1> port 0xcc00-0xcc3f mem 0xfdae0000-0xfdafffff irq 52 at device 1.0 on pci7
em0: [FILTER]
em0: Ethernet address: 00:14:4f:21:13:78
em1: <Intel(R) PRO/1000 Legacy Network Connection 1.0.1> port 0xc800-0xc83f mem 0xfdac0000-0xfdadffff irq 53 at device 1.1 on pci7
em1: [FILTER]
em1: Ethernet address: 00:14:4f:21:13:79
pcib8: <ACPI PCI-PCI bridge> at device 6.0 on pci4
pci8: <ACPI PCI bus> on pcib8
em2: <Intel(R) PRO/1000 Legacy Network Connection 1.0.1> port 0xdc00-0xdc3f mem 0xfdbe0000-0xfdbfffff irq 61 at device 1.0 on pci8
em2: [FILTER]
em2: Ethernet address: 00:14:4f:21:13:7a
em3: <Intel(R) PRO/1000 Legacy Network Connection 1.0.1> port 0xd800-0xd83f mem 0xfdbc0000-0xfdbdffff irq 62 at device 1.1 on pci8
em3: [FILTER]
em3: Ethernet address: 00:14:4f:21:13:7b
pcib9: <ACPI Host-PCI bridge> on acpi0
pci12: <ACPI PCI bus> on pcib9
pcib10: <ACPI PCI-PCI bridge> at device 9.0 on pci12
pci13: <ACPI PCI bus> on pcib10
pcib11: <ACPI PCI-PCI bridge> at device 10.0 on pci12
pci14: <ACPI PCI bus> on pcib11
pcib12: <ACPI Host-PCI bridge> on acpi0
pci9: <ACPI PCI bus> on pcib12
pcib13: <ACPI PCI-PCI bridge> at device 7.0 on pci9
pci10: <ACPI PCI bus> on pcib13
atapci5: <Marvell 88SX6081 SATA300 controller> port 0xec00-0xecff mem 0xfe300000-0xfe3fffff irq 68 at device 1.0 on pci10
atapci5: [ITHREAD]
ata34: <ATA channel 0> on atapci5
ata34: [ITHREAD]
ata35: <ATA channel 1> on atapci5
ata35: [ITHREAD]
ata36: <ATA channel 2> on atapci5
ata36: [ITHREAD]
ata37: <ATA channel 3> on atapci5
ata37: [ITHREAD]
ata38: <ATA channel 4> on atapci5
ata38: [ITHREAD]
ata39: <ATA channel 5> on atapci5
ata39: [ITHREAD]
ata40: <ATA channel 6> on atapci5
ata40: [ITHREAD]
ata41: <ATA channel 7> on atapci5
ata41: [ITHREAD]
pcib14: <ACPI PCI-PCI bridge> at device 8.0 on pci9
pci11: <ACPI PCI bus> on pcib14
atapci6: <Marvell 88SX6081 SATA300 controller> port 0xfc00-0xfcff mem 0xfe500000-0xfe5fffff irq 76 at device 1.0 on pci11
atapci6: [ITHREAD]
ata42: <ATA channel 0> on atapci6
ata42: [ITHREAD]
ata43: <ATA channel 1> on atapci6
ata43: [ITHREAD]
ata44: <ATA channel 2> on atapci6
ata44: [ITHREAD]
ata45: <ATA channel 3> on atapci6
ata45: [ITHREAD]
ata46: <ATA channel 4> on atapci6
ata46: [ITHREAD]
ata47: <ATA channel 5> on atapci6
ata47: [ITHREAD]
ata48: <ATA channel 6> on atapci6
ata48: [ITHREAD]
ata49: <ATA channel 7> on atapci6
ata49: [ITHREAD]
acpi_button0: <Power Button> on acpi0
atrtc0: <AT realtime clock> port 0x70-0x71 on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart0: [FILTER]
acpi_hpet0: <High Precision Event Timer> iomem 0xfec01000-0xfec013ff irq 0,8 on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 900
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc9fff,0xca000-0xcafff,0xcb000-0xcbfff,0xcc000-0xccfff,0xcd000-0xcdfff,0xce000-0xcefff,0xcf000-0xd57ff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
ppc0: cannot reserve I/O port range
powernow0: <Cool`n'Quiet K8> on cpu0
powernow1: <Cool`n'Quiet K8> on cpu1
powernow2: <Cool`n'Quiet K8> on cpu2
powernow3: <Cool`n'Quiet K8> on cpu3
ZFS filesystem version 4
ZFS storage pool version 15
Timecounters tick every 1.000 msec
usbus0: 12Mbps Full Speed USB v1.0
usbus1: 12Mbps Full Speed USB v1.0
usbus2: 12Mbps Full Speed USB v1.0
usbus3: 12Mbps Full Speed USB v1.0
usbus4: 480Mbps High Speed USB v2.0
ugen0.1: <AMD> at usbus0
uhub0: <AMD OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ugen1.1: <AMD> at usbus1
uhub1: <AMD OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
ugen2.1: <NEC> at usbus2
uhub2: <NEC OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
ugen3.1: <NEC> at usbus3
uhub3: <NEC OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus3
ugen4.1: <NEC> at usbus4
uhub4: <NEC EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus4
ad4: 476940MB <HITACHI HDS7250SASUN500G 0648KNL59H K2AOAJ0A> at ata2-master UDMA100 SATA 3Gb/s
ad6: 476940MB <HITACHI HDS7250SASUN500G 0647KN9HZH K2AOAJ0A> at ata3-master UDMA100 SATA 3Gb/s
ad8: 476940MB <HITACHI HDS7250SASUN500G 0647KN9B1H K2AOAJ0A> at ata4-master UDMA100 SATA 3Gb/s
ad10: 476940MB <HITACHI HDS7250SASUN500G 0648KPM5LF K2AOAJ0A> at ata5-master UDMA100 SATA 3Gb/s
ad12: 476940MB <HITACHI HDS7250SASUN500G 0648KP6VGH K2AOAJ0A> at ata6-master UDMA100 SATA 3Gb/s
ad14: 476940MB <HITACHI HDS7250SASUN500G 0647KN2AMH K2AOAJ0A> at ata7-master UDMA100 SATA 3Gb/s
uhub0: 3 ports with 3 removable, self powered
uhub1: 3 ports with 3 removable, self powered
ad16: 476940MB <HITACHI HDS7250SASUN500G 0647KN62DH K2AOAJ0A> at ata8-master UDMA100 SATA 3Gb/s
uhub3: 2 ports with 2 removable, self powered
ad18: 476940MB <HITACHI HDS7250SASUN500G 0647KN9P4H K2AOAJ0A> at ata9-master UDMA100 SATA 3Gb/s
ad20: 476940MB <HITACHI HDS7250SASUN500G 0648KP6VDH K2AOAJ0A> at ata10-master UDMA100 SATA 3Gb/s
uhub2: 3 ports with 3 removable, self powered
ad22: 476940MB <HITACHI HDS7250SASUN500G 0647KMTZNH K2AOAJ0A> at ata11-master UDMA100 SATA 3Gb/s
ad24: 476940MB <HITACHI HDS7250SASUN500G 0648KPAHNH K2AOAJ0A> at ata12-master UDMA100 SATA 3Gb/s
ad26: 476940MB <HITACHI HDS7250SASUN500G 0648KPU2EF K2AOAJ0A> at ata13-master UDMA100 SATA 3Gb/s
ad28: 476940MB <HITACHI HDS7250SASUN500G 0648KNHH8H K2AOAJ0A> at ata14-master UDMA100 SATA 3Gb/s
ad30: 476940MB <HITACHI HDS7250SASUN500G 0647KN3E4H K2AOAJ0A> at ata15-master UDMA100 SATA 3Gb/s
ad32: 476940MB <HITACHI HDS7250SASUN500G 0647KMR6JH K2AOAJ0A> at ata16-master UDMA100 SATA 3Gb/s
ad34: 476940MB <HITACHI HDS7250SASUN500G 0648KPS1SF K2AOAJ0A> at ata17-master UDMA100 SATA 3Gb/s
ad36: 476940MB <HITACHI HDS7250SASUN500G 0648KPPL1F K2AOAJ0A> at ata18-master UDMA100 SATA 3Gb/s
ad38: 476940MB <HITACHI HDS7250SASUN500G 0647KLU58H K2AOAJ0A> at ata19-master UDMA100 SATA 3Gb/s
ad40: 476940MB <HITACHI HDS7250SASUN500G 0648KPL4EF K2AOAJ0A> at ata20-master UDMA100 SATA 3Gb/s
ad42: 476940MB <HITACHI HDS7250SASUN500G 0648KPS29F K2AOAJ0A> at ata21-master UDMA100 SATA 3Gb/s
ad44: 476940MB <HITACHI HDS7250SASUN500G 0648KPR1NF K2AOAJ0A> at ata22-master UDMA100 SATA 3Gb/s
ad46: 476940MB <HITACHI HDS7250SASUN500G 0647KN2ATH K2AOAJ0A> at ata23-master UDMA100 SATA 3Gb/s
ad48: 476940MB <HITACHI HDS7250SASUN500G 0648KPPG1F K2AOAJ0A> at ata24-master UDMA100 SATA 3Gb/s
ad50: 476940MB <HITACHI HDS7250SASUN500G 0647KN9BLH K2AOAJ0A> at ata25-master UDMA100 SATA 3Gb/s
ad52: 476940MB <HITACHI HDS7250SASUN500G 0648KPL9UF K2AOAJ0A> at ata26-master UDMA100 SATA 3Gb/s
ad54: 476940MB <HITACHI HDS7250SASUN500G 0647KGH3BH K2AOAJ0A> at ata27-master UDMA100 SATA 3Gb/s
ad56: 476940MB <HITACHI HDS7250SASUN500G 0647KMR52H K2AOAJ0A> at ata28-master UDMA100 SATA 3Gb/s
ad58: 476940MB <HITACHI HDS7250SASUN500G 0648KLWYSH K2AOAJ0A> at ata29-master UDMA100 SATA 3Gb/s
ad60: 476940MB <HITACHI HDS7250SASUN500G 0648KPPG0F K2AOAJ0A> at ata30-master UDMA100 SATA 3Gb/s
ad62: 476940MB <HITACHI HDS7250SASUN500G 0647KMY5PF K2AOAJ0A> at ata31-master UDMA100 SATA 3Gb/s
ad64: 476940MB <HITACHI HDS7250SASUN500G 0648KPPGSF K2AOAJ0A> at ata32-master UDMA100 SATA 3Gb/s
ad66: 476940MB <HITACHI HDS7250SASUN500G 0648KPTDAF K2AOAJ0A> at ata33-master UDMA100 SATA 3Gb/s
ad68: 476940MB <HITACHI HDS7250SASUN500G 0648KMXMVF K2AOAJ0A> at ata34-master UDMA100 SATA 3Gb/s
ad70: 476940MB <HITACHI HDS7250SASUN500G 0647KM7K9H K2AOAJ0A> at ata35-master UDMA100 SATA 3Gb/s
ad72: 476940MB <HITACHI HDS7250SASUN500G 0648KPL53F K2AOAJ0A> at ata36-master UDMA100 SATA 3Gb/s
ad74: 476940MB <HITACHI HDS7250SASUN500G 0647KN86EH K2AOAJ0A> at ata37-master UDMA100 SATA 3Gb/s
ad76: 476940MB <HITACHI HDS7250SASUN500G 0648KNATSH K2AOAJ0A> at ata38-master UDMA100 SATA 3Gb/s
ad78: 476940MB <HITACHI HDS7250SASUN500G 0647KMY5HF K2AOAJ0A> at ata39-master UDMA100 SATA 3Gb/s
ad80: 476940MB <HITACHI HDS7250SASUN500G 0648KPPGZF K2AOAJ0A> at ata40-master UDMA100 SATA 3Gb/s
ad82: 476940MB <HITACHI HDS7250SASUN500G 0648KPP5BF K2AOAJ0A> at ata41-master UDMA100 SATA 3Gb/s
ad84: 476940MB <HITACHI HDS7250SASUN500G 0648KNHHDH K2AOAJ0A> at ata42-master UDMA100 SATA 3Gb/s
ugen0.2: <American Megatrends Inc.> at usbus0
ukbd0: <Keyboard Interface> on usbus0
ad86: 476940MB <HITACHI HDS7250SASUN500G 0647KMY73F K2AOAJ0A> at ata43-master UDMA100 SATA 3Gb/s
kbd2 at ukbd0
ums0: <Mouse Interface> on usbus0
ums0: 3 buttons and [XY] coordinates ID=0
ad88: 476940MB <HITACHI HDS7250SASUN500G 0648KPLRHF K2AOAJ0A> at ata44-master UDMA100 SATA 3Gb/s
ad90: 476940MB <HITACHI HDS7250SASUN500G 0647KN2B7H K2AOAJ0A> at ata45-master UDMA100 SATA 3Gb/s
ad92: 476940MB <HITACHI HDS7250SASUN500G 0648KN0JSF K2AOAJ0A> at ata46-master UDMA100 SATA 3Gb/s
ad94: 476940MB <HITACHI HDS7250SASUN500G 0647KN866H K2AOAJ0A> at ata47-master UDMA100 SATA 3Gb/s
ad96: 476940MB <HITACHI HDS7250SASUN500G 0647KN62EH K2AOAJ0A> at ata48-master UDMA100 SATA 3Gb/s
ad98: 476940MB <HITACHI HDS7250SASUN500G 0648KNZ3KF K2AOAJ0A> at ata49-master UDMA100 SATA 3Gb/s
SMP: AP CPU #1 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #3 Launched!
Root mount waiting for: usbus4
uhub4: 5 ports with 5 removable, self powered
ugen4.2: <vendor 0x04b4> at usbus4
uhub5: <vendor 0x04b4 product 0x6560, class 9/0, rev 2.00/0.0b, addr 2> on usbus4
Root mount waiting for: usbus4
uhub5: 4 ports with 4 removable, self powered
ugen4.3: <Kingston> at usbus4
umass0: <Kingston DataTraveler 2.0, class 0/0, rev 2.00/1.10, addr 3> on usbus4
umass0:  SCSI over Bulk-Only; quirks = 0x0000
Root mount waiting for: usbus4
umass0:0:0:-1: Attached to scbus0
Trying to mount root from zfs:dam/ROOT/amd64
(probe0:umass-sim0:0:0:0): TEST UNIT READY. CDB: 0 0 0 0 0 0 
(probe0:umass-sim0:0:0:0): CAM status: SCSI Status Error
(probe0:umass-sim0:0:0:0): SCSI status: Check Condition
(probe0:umass-sim0:0:0:0): SCSI sense: UNIT ATTENTION asc:28,0 (Not ready to ready change, medium may have changed)
da0 at umass-sim0 bus 0 scbus0 target 0 lun 0
da0: <Kingston DataTraveler 2.0 PMAP> Removable Direct Access SCSI-0 device 
da0: 40.000MB/s transfers
da0: 7636MB (15638528 512 byte sectors: 255H 63S/T 973C)
em0: link state changed to UP
lagg0: link state changed to UP
lagg0.6: link state changed to UP
em2: link state changed to UP
em1: link state changed to UP
em3: link state changed to UP
thumper1# glabel status
                                      Name  Status  Components
gptid/6e378541-d067-11df-bc29-00144f211378     N/A  ad4p1
gptid/6e4ae922-d067-11df-bc29-00144f211378     N/A  ad6p1
gptid/6e647dae-d067-11df-bc29-00144f211378     N/A  ad8p1
gptid/6e7c905b-d067-11df-bc29-00144f211378     N/A  ad10p1
gptid/6e961440-d067-11df-bc29-00144f211378     N/A  ad12p1
gptid/6ed0304d-d067-11df-bc29-00144f211378     N/A  ad14p1
gptid/6ee9d7cb-d067-11df-bc29-00144f211378     N/A  ad16p1
gptid/6f0341a4-d067-11df-bc29-00144f211378     N/A  ad18p1
gptid/6f1fbb2b-d067-11df-bc29-00144f211378     N/A  ad20p1
gptid/6f3530cc-d067-11df-bc29-00144f211378     N/A  ad22p1
gptid/6f4f7635-d067-11df-bc29-00144f211378     N/A  ad24p1
gptid/6f6342f8-d067-11df-bc29-00144f211378     N/A  ad26p1
gptid/6f78bd12-d067-11df-bc29-00144f211378     N/A  ad28p1
gptid/6f8ec2d0-d067-11df-bc29-00144f211378     N/A  ad30p1
gptid/6fa35b89-d067-11df-bc29-00144f211378     N/A  ad32p1
gptid/6fb986d9-d067-11df-bc29-00144f211378     N/A  ad34p1
gptid/6fd319f7-d067-11df-bc29-00144f211378     N/A  ad36p1
gptid/6fefa464-d067-11df-bc29-00144f211378     N/A  ad38p1
gptid/70084d1a-d067-11df-bc29-00144f211378     N/A  ad40p1
gptid/70225bd7-d067-11df-bc29-00144f211378     N/A  ad42p1
gptid/703b892d-d067-11df-bc29-00144f211378     N/A  ad44p1
gptid/705649a0-d067-11df-bc29-00144f211378     N/A  ad46p1
gptid/706f0a93-d067-11df-bc29-00144f211378     N/A  ad48p1
gptid/7087f6c9-d067-11df-bc29-00144f211378     N/A  ad50p1
gptid/3c0ebfcf-cc45-11df-b85d-00144f211378     N/A  ad52p1
gptid/3c3167d3-cc45-11df-b85d-00144f211378     N/A  ad52p3
gptid/70a04cca-d067-11df-bc29-00144f211378     N/A  ad54p1
gptid/70bbdc2d-d067-11df-bc29-00144f211378     N/A  ad56p1
gptid/70d4b6ed-d067-11df-bc29-00144f211378     N/A  ad58p1
gptid/3c4c7865-cc45-11df-b85d-00144f211378     N/A  ad60p1
gptid/3c635efe-cc45-11df-b85d-00144f211378     N/A  ad60p2
gptid/3c6eeb97-cc45-11df-b85d-00144f211378     N/A  ad60p3
gptid/70eabeba-d067-11df-bc29-00144f211378     N/A  ad62p1
gptid/7100fc20-d067-11df-bc29-00144f211378     N/A  ad64p1
gptid/71165baa-d067-11df-bc29-00144f211378     N/A  ad66p1
gptid/712f8225-d067-11df-bc29-00144f211378     N/A  ad68p1
gptid/716a084d-d067-11df-bc29-00144f211378     N/A  ad70p1
gptid/71853bf5-d067-11df-bc29-00144f211378     N/A  ad72p1
gptid/719e0201-d067-11df-bc29-00144f211378     N/A  ad74p1
gptid/71b74306-d067-11df-bc29-00144f211378     N/A  ad76p1
gptid/71d1c11d-d067-11df-bc29-00144f211378     N/A  ad78p1
gptid/71ea1b93-d067-11df-bc29-00144f211378     N/A  ad80p1
gptid/7203c8d9-d067-11df-bc29-00144f211378     N/A  ad82p1
gptid/721b5a67-d067-11df-bc29-00144f211378     N/A  ad84p1
gptid/723a30d3-d067-11df-bc29-00144f211378     N/A  ad86p1
gptid/7256a502-d067-11df-bc29-00144f211378     N/A  ad88p1
gptid/72707600-d067-11df-bc29-00144f211378     N/A  ad90p1
gptid/7289edd1-d067-11df-bc29-00144f211378     N/A  ad92p1
gptid/72a21a0f-d067-11df-bc29-00144f211378     N/A  ad94p1
gptid/72be2559-d067-11df-bc29-00144f211378     N/A  ad96p1
gptid/72d70248-d067-11df-bc29-00144f211378     N/A  ad98p1
                    ufsid/49a828ef1a6a2de8     N/A  da0s1a
                                ufs/flash1     N/A  da0s1a
                    ufsid/49a8c69e60e10953     N/A  da0s2a
                                ufs/flash2     N/A  da0s2a
                    ufsid/49b383f54383bf0d     N/A  da0s3a
                                ufs/flash3     N/A  da0s3a
                    ufsid/49b383fca9c7233b     N/A  da0s4a
                                ufs/flash4     N/A  da0s4a

thumper1# vmstat -i
interrupt                          total       rate
irq17: ohci2                      451815         98
irq18: ohci3                      167391         36
irq19: ohci0 ohci1+               137556         30
irq24: atapci0                     19644          4
irq32: atapci1                     15102          3
irq38: atapci3                     19532          4
irq46: atapci4                     23575          5
irq52: em0                           452          0
irq53: em1                          7582          1
irq61: em2                          2319          0
irq62: em3                          1427          0
irq68: atapci5                     17632          3
irq76: atapci6                     18112          3
cpu0: timer                      9133048       1999
cpu1: timer                      9126434       1998
cpu2: timer                      9130320       1999
cpu3: timer                      9130448       1999
Total                           37402389       8189

John
-- 
John Hay -- jhay at meraka.csir.co.za / jhay at FreeBSD.org


More information about the freebsd-stable mailing list