zfs, crash, 7-CURRENT

Tue Jul 17 16:55:46 UTC 2007

Hello all,

I am using CURRENT, experimenting with ZFS, and I am getting a
consistent crash with any substantial file system IO.  It usually takes 
just a few seconds of heavy use.

I have a standard ATA drive connected via ATA100 off the
motherboard that I use as the source of files (ad1s1a, UFS2).

The ZFS file system sits on a ZFS pool created with:

zpool create zp0 raidz /dev/ad4 /dev/ad6 /dev/ad10 /dev/ad12

The devices ad4 and ad6 are connected via a PCI SATA card:

atapci0: <Promise PDC20575 SATA150 controller> port
0xec00-0xec7f,0xe800-0xe8ff mem
0xdffff000-0xdfffffff,0xdffc0000-0xdffdffff irq 11 at device 5.0 on pci0

And ad10 and ad12 are on another PCI SATA card:

atapci1: <SiI 3112 SATA150 controller> port
0xdc00-0xdc07,0xd800-0xd803,0xd400-0
xd407,0xd000-0xd003,0xcc00-0xcc0f mem 0xdfffec00-0xdfffedff irq 9 at
device 8.0 on pci0

When not being used as part of the ZFS pool, each of the four drives
(disks/devices) can be read/written at any rate and load without
creating instability (thank you FreeBSD).  Before trying ZFS I had 
standard UFS2 file systems on each one.

When the crash occurs, the following appears on the console (typed in):
---begin console message---

ad4: WARNING - WRITE_DMA UDMA ICRC error (retrying request) LBA = xxxx
ad4: FAILURE - device attached
subdisk4: detached
ad4: detached

Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address = 0x2c
fault code            = supervisor read, page not present
instruction pointer   = 0x20:0xc073ee36
stack pointer         = 0x28:0xdc6c4c58
frame pointer         = 0x28:0xdc6c4c78
code segment          = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, def32 1, gran 1
processor eflags      = interrupt enabled, resume IOPL = 0
current process       = 3 (g_up)
[thread pid 3 tid 100011 ]
stopped at     _mtx_lock_flags+0x46: movl 0x10(%ebx),%eax
db>

---end console message---

The output of dmesg for my machine is attached.  It's a MSI motherboard
with 5PCI slots and a Athlon XP 1800+ with 768MB RAM.  Happy to
provide more information (crashdumps?) to help solve the bug.
ZFS is so cool, it will be great to have it stable on FreeBSD.

You can email me at thede at loder.com (there might be a challenge since I 
use Boxbe, but even if you decide not to take it, I'll search for your 
message so I can reply).

Cheers,
Thede

-------------- next part --------------
Copyright (c) 1992-2007 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 7.0-CURRENT #4: Sat Jul 14 08:58:50 PDT 2007
    root at davros.loder.com:/evol/vol01/obj/usr/src/sys/GENERIC
WARNING: WITNESS option enabled, expect reduced performance.
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: AMD Athlon(tm) XP 1800+ (1533.40-MHz 686-class CPU)
  Origin = "AuthenticAMD"  Id = 0x662  Stepping = 2
  Features=0x383f9ff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
  AMD Features=0xc0400800<SYSCALL,MMX+,3DNow!+,3DNow!>
real memory  = 805306368 (768 MB)
avail memory = 774152192 (738 MB)
kbd1 at kbdmux0
ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413)
cpu0 on motherboard
pcib0: <Host to PCI bridge> pcibus 0 on motherboard
pir0: <PCI Interrupt Routing Table: 11 Entries> on motherboard
pci0: <PCI bus> on pcib0
agp0: <VIA 8367 (KT266/KY266x/KT333) host to PCI bridge> on hostb0
pcib1: <PCI-PCI bridge> at device 1.0 on pci0
pci1: <PCI bus> on pcib1
vgapci0: <VGA-compatible display> mem 0xde000000-0xdeffffff,0xda000000-0xdbffffff irq 11 at device 0.0 on pci1
atapci0: <Promise PDC20575 SATA150 controller> port 0xec00-0xec7f,0xe800-0xe8ff mem 0xdffff000-0xdfffffff,0xdffc0000-0xdffdffff irq 11 at device 5.0 on pci0
atapci0: [ITHREAD]
atapci0: [ITHREAD]
ata2: <ATA channel 0> on atapci0
ata2: [ITHREAD]
ata3: <ATA channel 1> on atapci0
ata3: [ITHREAD]
ata4: <ATA channel 2> on atapci0
ata4: [ITHREAD]
rl0: <D-Link DFE-530TX+ 10/100BaseTX> port 0xe400-0xe4ff mem 0xdfffef00-0xdfffefff irq 10 at device 6.0 on pci0
miibus0: <MII bus> on rl0
rlphy0: <RealTek internal media interface> PHY 0 on miibus0
rlphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
rl0: Ethernet address: 00:05:5d:32:83:a4
rl0: [ITHREAD]
dc0: <ADMtek AN985 10/100BaseTX> port 0xe000-0xe0ff mem 0xdfffe800-0xdfffebff irq 12 at device 7.0 on pci0
miibus1: <MII bus> on dc0
ukphy0: <Generic IEEE 802.3u media interface> PHY 1 on miibus1
ukphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
dc0: Ethernet address: 00:50:bf:96:fd:d2
dc0: [ITHREAD]
atapci1: <SiI 3112 SATA150 controller> port 0xdc00-0xdc07,0xd800-0xd803,0xd400-0xd407,0xd000-0xd003,0xcc00-0xcc0f mem 0xdfffec00-0xdfffedff irq 9 at device 8.0 on pci0
atapci1: [ITHREAD]
ata5: <ATA channel 0> on atapci1
ata5: [ITHREAD]
ata6: <ATA channel 1> on atapci1
ata6: [ITHREAD]
uhci0: <VIA 83C572 USB controller> port 0xc000-0xc01f irq 11 at device 16.0 on pci0
uhci0: [GIANT-LOCKED]
uhci0: [ITHREAD]
usb0: <VIA 83C572 USB controller> on uhci0
usb0: USB revision 1.0
uhub0: <VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb0
uhub0: 2 ports with 2 removable, self powered
uhci1: <VIA 83C572 USB controller> port 0xc400-0xc41f irq 10 at device 16.1 on pci0
uhci1: [GIANT-LOCKED]
uhci1: [ITHREAD]
usb1: <VIA 83C572 USB controller> on uhci1
usb1: USB revision 1.0
uhub1: <VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb1
uhub1: 2 ports with 2 removable, self powered
uhci2: <VIA 83C572 USB controller> port 0xc800-0xc81f irq 12 at device 16.2 on pci0
uhci2: [GIANT-LOCKED]
uhci2: [ITHREAD]
usb2: <VIA 83C572 USB controller> on uhci2
usb2: USB revision 1.0
uhub2: <VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb2
uhub2: 2 ports with 2 removable, self powered
ehci0: <VIA VT6202 USB 2.0 controller> mem 0xdfffee00-0xdfffeeff irq 9 at device 16.3 on pci0
ehci0: [GIANT-LOCKED]
ehci0: [ITHREAD]
usb3: EHCI version 1.0
usb3: companion controllers, 2 ports each: usb0 usb1 usb2
usb3: <VIA VT6202 USB 2.0 controller> on ehci0
usb3: USB revision 2.0
uhub3: <VIA EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb3
uhub3: 6 ports with 6 removable, self powered
isab0: <PCI-ISA bridge> at device 17.0 on pci0
isa0: <ISA bus> on isab0
atapci2: <VIA 8235 UDMA133 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xfc00-0xfc0f at device 17.1 on pci0
ata0: <ATA channel 0> on atapci2
ata0: [ITHREAD]
ata1: <ATA channel 1> on atapci2
ata1: [ITHREAD]
pci0: <multimedia, audio> at device 17.5 (no driver attached)
pmtimer0 on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
fdc0: <Enhanced floppy controller> at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0
fdc0: [FILTER]
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
ppc0: <Parallel port> at port 0x378-0x37f irq 7 on isa0
ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode
ppc0: FIFO with 16/16/9 bytes threshold
ppbus0: <Parallel port bus> on ppc0
plip0: <PLIP network interface> on ppbus0
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
ppc0: [GIANT-LOCKED]
ppc0: [ITHREAD]
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
sio0: type 16550A
sio0: [FILTER]
sio1 at port 0x2f8-0x2ff irq 3 on isa0
sio1: type 16550A
sio1: [FILTER]
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
unknown: <PNP0c01> can't assign resources (memory)
unknown: <PNP0303> can't assign resources (port)
unknown: <PNP0501> can't assign resources (port)
unknown: <PNP0501> can't assign resources (port)
unknown: <PNP0401> can't assign resources (port)
unknown: <PNP0700> can't assign resources (port)
Timecounter "TSC" frequency 1533399720 Hz quality 800
Timecounters tick every 1.000 msec
ad0: 152627MB <Seagate ST3160812A 3.AAD> at ata0-master UDMA100
ad1: 238475MB <WDC WD2500JB-00REA0 20.00K20> at ata0-slave UDMA100
acd0: CDRW <SONY CD-RW CRX230EE/2YS8> at ata1-master UDMA33
ad4: 238475MB <WDC WD2500JD-50GBB0 02.05D02> at ata2-master SATA150
ad6: 238475MB <Seagate ST3250823AS 3.01> at ata3-master SATA150
ad10: 238475MB <MD02500 BJDW 02.05D02> at ata5-master SATA150
ad12: 238475MB <MD02500 BJDW 21.02J21> at ata6-master SATA150
WARNING: WITNESS option enabled, expect reduced performance.
Trying to mount root from ufs:/dev/ad0s1a
ipfw2 (+ipv6) initialized, divert loadable, rule-based forwarding disabled, default to deny, logging disabled