gmirrored boot drives locks up during buildworld

[Michael Boers]

I recently installed FreeBSD 5.3 on a machine to be my primary mysql  
server.  The machine failed after about 3 weeks of heavy use.  The  
machine did not panic, it just froze and some random characters  
appeared on the console.  A reboot restored the system for another few  
weeks.  On the third failure I took it out of production.

The machine consists of a Intel Pentium 4 EE HT with a pair of 80  
gigabyte IDE gmirrored boot drives and a pair of 250 gigabyte IDE  
gmirror data drives.

With the machine out of production, I used

while (true) do make clean; make buildworld; done

to exercise the machine until it failed.  Usually within three days.  I  
swapped video cards, memory, hard drives, and played with bios settings  
to no avail.  Finally I determined that when I ran without using  
gmirror, the machine would build indefinitely.

Finally, I tried the buildworld test on a completely different (amd vs  
intel, scsi vs ide disks) machine and it failed in less than 3 hours.

Because the system freezes rather than panics, I have no diagnostic  
information to provide.

If this is a possible gmirror bug, please let me know if there is any  
other information I can provide.  I am very interested in using gmirror  
but I want to make sure it is safe.  Please feel free to call me at the  
below number if necessary.

--
Michael Boers
Datacomp
877-406-0231


Details on First Machine

uname output:

FreeBSD saturn.datacomp-intranet.com 5.3-RELEASE FreeBSD 5.3-RELEASE  
#0: Fri Mar 11 13:37:46 EST 2005      
msb at saturn.datacomp-intranet.com:/usr/src/sys/i386/compile/SATURN  i386

dmesg boot info:

Copyright (c) 1992-2004 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
         The Regents of the University of California. All rights  
reserved.
FreeBSD 5.3-RELEASE #0: Fri Mar 11 13:37:46 EST 2005
     msb at saturn.datacomp-intranet.com:/usr/src/sys/i386/compile/SATURN
ACPI APIC Table: <AMIINT INTEL865>
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Pentium(R) 4 CPU 3.40GHz (3400.13-MHz 686-class CPU)
   Origin = "GenuineIntel"  Id = 0xf25  Stepping = 5
    
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE 
,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
   Hyperthreading: 2 logical CPUs
real memory  = 1073676288 (1023 MB)
avail memory = 1045311488 (996 MB)
ioapic0 <Version 2.0> irqs 0-23 on motherboard
npx0: [FAST]
npx0: <math processor> on motherboard
npx0: INT 16 interface
acpi0: <AMIINT INTEL865> on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
cpu0: <ACPI CPU> on acpi0
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
agp0: <Intel 82865 host to AGP bridge> mem 0xf8000000-0xfbffffff at  
device 0.0 on pci0
pcib1: <PCI-PCI bridge> at device 1.0 on pci0
pci1: <PCI bus> on pcib1
pci1: <display, VGA> at device 0.0 (no driver attached)
uhci0: <Intel 82801EB (ICH5) USB controller USB-A> port 0xcc00-0xcc1f  
irq 16 at device 29.0 on pci0
uhci0: [GIANT-LOCKED]
usb0: <Intel 82801EB (ICH5) USB controller USB-A> on uhci0
usb0: USB revision 1.0
uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhci1: <Intel 82801EB (ICH5) USB controller USB-B> port 0xd000-0xd01f  
irq 19 at device 29.1 on pci0
uhci1: [GIANT-LOCKED]
usb1: <Intel 82801EB (ICH5) USB controller USB-B> on uhci1
usb1: USB revision 1.0
uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
uhci2: <Intel 82801EB (ICH5) USB controller USB-C> port 0xd400-0xd41f  
irq 18 at device 29.2 on pci0
uhci2: [GIANT-LOCKED]
usb2: <Intel 82801EB (ICH5) USB controller USB-C> on uhci2
usb2: USB revision 1.0
uhub2: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub2: 2 ports with 2 removable, self powered
uhci3: <Intel 82801EB (ICH5) USB controller USB-D> port 0xd800-0xd81f  
irq 16 at device 29.3 on pci0
uhci3: [GIANT-LOCKED]
usb3: <Intel 82801EB (ICH5) USB controller USB-D> on uhci3
usb3: USB revision 1.0
uhub3: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub3: 2 ports with 2 removable, self powered
pci0: <serial bus, USB> at device 29.7 (no driver attached)
pcib2: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci2: <ACPI PCI bus> on pcib2
em0: <Intel(R) PRO/1000 Network Connection, Version - 1.7.35> port  
0xbc00-0xbc3f mem 0xfeaa0000-0xfeabffff,0xfeac0000-0xfeadffff irq 19 at  
device 3.0 on pci2
em0: Ethernet address: 00:0e:0c:33:2c:96
em0:  Speed:N/A  Duplex:N/A
re0: <RealTek 8169S Single-chip Gigabit Ethernet> port 0xb800-0xb8ff  
mem 0xfeafff00-0xfeafffff irq 20 at device 6.0 on pci2
miibus0: <MII bus> on re0
rgephy0: <RTL8169S/8110S media interface> on miibus0
rgephy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX,  
1000baseTX-FDX, auto
re0: Ethernet address: 00:11:09:81:40:a9
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel ICH5 UDMA100 controller> port  
0xfc00-0xfc0f,0x376,0x170-0x177,0x3f6,0x1f0-0x1f7 at device 31.1 on  
pci0
ata0: channel #0 on atapci0
ata1: channel #1 on atapci0
atapci1: <Intel ICH5 SATA150 controller> port  
0xdc00-0xdc0f,0xe000-0xe003,0xe400-0xe407,0xe800-0xe803,0xec00-0xec07  
irq 18 at device 31.2 on pci0
ata2: channel #0 on atapci1
ata3: channel #1 on atapci1
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
pci0: <multimedia, audio> at device 31.5 (no driver attached)
atkbdc0: <Keyboard controller (i8042)> port 0x64,0x60 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on  
acpi0
sio0: type 16550A
sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0
sio1: type 16550A
ppc0: <ECP parallel printer port> port 0x778-0x77b,0x378-0x37f irq 7  
drq 3 on acpi0
ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode
ppc0: FIFO with 16/16/9 bytes threshold
ppbus0: <Parallel port bus> on ppc0
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
pmtimer0 on isa0
orm0: <ISA Option ROMs> at iomem  
0xe0000-0xe0fff,0xcf800-0xd07ff,0xc0000-0xcf7ff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on  
isa0
Timecounter "TSC" frequency 3400132108 Hz quality 800
Timecounters tick every 10.000 msec
ipfw2 initialized, divert disabled, rule-based forwarding disabled,  
default to deny, logging limited to 1 packets/entry by default
acpi_cpu: throttling enabled, 8 steps (100% to 12.5%), currently 100.0%
ad0: 76319MB <WDC WD800JB-00JJA0/05.01C05> [155061/16/63] at  
ata0-master UDMA100
ad1: 76319MB <WDC WD800JB-00JJA0/05.01C05> [155061/16/63] at ata0-slave  
UDMA100
acd0: CDROM <CD-532E-B/1.0A> at ata1-master PIO4
ad4: 238475MB <HDS722525VLSA80/V36OA63A> [484521/16/63] at ata2-master  
SATA150
GEOM_MIRROR: Device boot created (id=1429322453).
GEOM_MIRROR: Device boot: provider ad0 detected.
ad6: 238475MB <HDS722525VLSA80/V36OA63A> [484521/16/63] at ata3-master  
SATA150
GEOM_MIRROR: Device boot: provider ad1 detected.
GEOM_MIRROR: Device boot: provider ad1 activated.
GEOM_MIRROR: Device boot: provider mirror/boot launched.
GEOM_MIRROR: Device boot: rebuilding provider ad0.
GEOM_MIRROR: Device databases created (id=59908152).
GEOM_MIRROR: Device databases: provider ad4 detected.
GEOM_MIRROR: Device databases: provider ad6 detected.
GEOM_MIRROR: Device databases: provider ad6 activated.
GEOM_MIRROR: Device databases: provider mirror/databases launched.
GEOM_MIRROR: Device databases: rebuilding provider ad4.
Mounting root from ufs:/dev/mirror/boota
em0: Link is up 100 Mbps Full Duplex