FreeBSD 6 Hard Lock no logs

Tue Jul 25 18:19:40 UTC 2006

Hi,

I have a web/mail server thats running the lastest version of FreeBSD 
6.0-RELEASE-p9 #4. In the last month or so it's started hard locking..
when the machine locks up i can still ping it and get connects from 
telneting to 80,22,etc sometimes i get a banner and sometimes i dont.. 
but there are
no errors on the console or in the logs.

The odd thing is the locking seems to happen within a certain time 
window (mon,tues) and never end of the week or weekend.. i suspected it 
could have been
a bad cron job but nothing falls into that time frame.

As a test i've been rebooting the server everynight to see if that would 
help the machine get past the begining of the week with out a hang and 
again this morning
even though i rebooted last night at 10pm hung around 9:47am.

The machine is a Dell PowerEdge 2550, I've had dell come and replace the 
MB and have ran all their diagnostics aswell with no errors reported..
I've been reading alot about APIC and ACPI and people having similar 
issues but nothing that fits the bill... below is the dmesg and output 
of vmstat -i.. another odd thing is the rate for the CPU timer is 
extremely high compared to other machines with similar hardware or 
faster hardware.

Any help on where to look next would be awesome.

interrupt                          total       rate
irq1: atkbd0                         107          0
irq6: fdc0                            10          0
irq13: npx0                            1          0
irq14: ata0                           74          0
irq16: fxp0                        27110         12
irq20: amr0                       105950         48
cpu0: timer                      4385477       1999
cpu1: timer                      4369967       1992
Total                            8888696       4053

Copyright (c) 1992-2005 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD 6.0-RELEASE-p9 #4: Thu Jun 22 14:54:15 PDT 2006
    root at taurus.packetsafe.net:/usr/src/sys/i386/compile/SMP
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Pentium(R) III CPU family      1266MHz (1258.22-MHz 
686-class CPU)
  Origin = "GenuineIntel"  Id = 0x6b1  Stepping = 1

Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
real memory  = 1073676288 (1023 MB)
avail memory = 1041612800 (993 MB)
ACPI APIC Table: <DELL   PE2550  >
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
 cpu0 (BSP): APIC ID:  1
 cpu1 (AP): APIC ID:  0
ioapic0: Changing APIC ID to 2
ioapic1: Changing APIC ID to 3
MADT: Forcing active-low polarity and level trigger for SCI
ioapic0 <Version 1.1> irqs 0-15 on motherboard
ioapic1 <Version 1.1> irqs 16-31 on motherboard
npx0: [FAST]
npx0: <math processor> on motherboard
npx0: INT 16 interface
acpi0: <DELL PE2550> on motherboard
acpi0: Power Button (fixed)
pci_link0: <ACPI PCI Link LNK0> irq 5 on acpi0
pci_link1: <ACPI PCI Link LNK1> irq 10 on acpi0
pci_link2: <ACPI PCI Link LNK2> on acpi0
pci_link3: <ACPI PCI Link LNK3> on acpi0
pci_link4: <ACPI PCI Link LNK4> irq 5 on acpi0
pci_link5: <ACPI PCI Link LNK5> irq 10 on acpi0
pci_link6: <ACPI PCI Link LNK6> on acpi0
pci_link7: <ACPI PCI Link LNK7> on acpi0
pci_link8: <ACPI PCI Link LNK8> on acpi0
pci_link9: <ACPI PCI Link LNK9> on acpi0
pci_link10: <ACPI PCI Link LNKA> on acpi0
pci_link11: <ACPI PCI Link LNKB> on acpi0
pci_link12: <ACPI PCI Link LNKC> on acpi0
pci_link13: <ACPI PCI Link LNKD> on acpi0
pci_link14: <ACPI PCI Link LNKE> on acpi0
pci_link15: <ACPI PCI Link LNKF> irq 10 on acpi0
pci_link16: <ACPI PCI Link LUSB> irq 11 on acpi0
Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <PCI-PCI bridge> at device 2.0 on pci0
pci1: <PCI bus> on pcib1
pcib2: <PCI-PCI bridge> at device 0.0 on pci1
pci2: <PCI bus> on pcib2
amr0: <LSILogic MegaRAID 1.51> mem 0xf0000000-0xf7ffffff irq 20 at 
device 0.0 on pci2
amr0: <LSILogic PERC 3/DC> Firmware 197O, BIOS 3.35, 128MB RAM
pci1: <mass storage, SCSI> at device 1.0 (no driver attached)
pci0: <display, VGA> at device 14.0 (no driver attached)
isab0: <PCI-ISA bridge> port 0x8a0-0x8af at device 15.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <ServerWorks ROSB4 UDMA33 controller> port 
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x8b0-0x8bf at device 15.1 on pci0
ata0: <ATA channel 0> on atapci0
ata1: <ATA channel 1> on atapci0
ohci0: <OHCI (generic) USB controller> mem 0xfe400000-0xfe400fff irq 11 
at device 15.2 on pci0
ohci0: [GIANT-LOCKED]
usb0: OHCI version 1.0, legacy support
usb0: <OHCI (generic) USB controller> on ohci0
usb0: USB revision 1.0
uhub0: (0x1166) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
pcib3: <ACPI Host-PCI bridge> on acpi0
pci3: <ACPI PCI bus> on pcib3
bge0: <Broadcom BCM5700 Gigabit Ethernet, ASIC rev. 0x7104> mem 
0xfeb00000-0xfeb0ffff irq 17 at device 8.0 on pci3
miibus0: <MII bus> on bge0
brgphy0: <BCM5401 10/100/1000baseTX PHY> on miibus0
brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 
1000baseTX-FDX, auto
bge0: Ethernet address: 00:06:5b:f5:87:93
pcib4: <ACPI Host-PCI bridge> on acpi0
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> at device 2.0 on pci4
pci5: <ACPI PCI bus> on pcib5
fxp0: <Intel 82559 Pro/100 Ethernet> port 0xbcc0-0xbcff mem 
0xfe900000-0xfe900fff,0xfe700000-0xfe7fffff irq 16 at device 4.0 on pci4
miibus1: <MII bus> on fxp0
inphy0: <i82555 10/100 media interface> on miibus1
inphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp0: Ethernet address: 00:06:5b:f5:87:92
fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: [FAST]
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on 
acpi0
sio0: type 16550A
sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0
sio1: type 16550A
ppc0: <ECP parallel printer port> port 0x378-0x37f,0x778-0x77f irq 7 drq 
1 on acpi0
ppc0: Generic chipset (ECP/PS2/NIBBLE) in COMPATIBLE mode
ppc0: FIFO with 16/16/8 bytes threshold
ppbus0: <Parallel port bus> on ppc0
plip0: <PLIP network interface> on ppbus0
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
pmtimer0 on isa0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xec000-0xeffff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
acd0: CDROM <SAMSUNG CD-ROM SN-124/q009> at ata0-master PIO4
amrd0: <LSILogic MegaRAID logical drive> on amr0
amrd0: 104040MB (213073920 sectors) RAID 5 (optimal)
ses0 at amr0 bus 0 target 6 lun 0
ses0: <DELL 1x4 U2W SCSI BP 1.32> Fixed Processor SCSI-2 device
ses0: SAF-TE Compliant Device
SMP: AP CPU #1 Launched!
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/x-pkcs7-signature
Size: 2773 bytes
Desc: S/MIME Cryptographic Signature
Url : http://lists.freebsd.org/pipermail/freebsd-questions/attachments/20060725/a284c18b/smime.bin