FreeBSD 6 Hard Lock no logs

Tue Jul 25 19:45:30 UTC 2006

First look for the obvious problems like low disk or swap space.  If these 
are OK, you might need to run a script that logs various things and sift 
through it.  I would suggest writing a shell script that sleeps for say 30 
to 60 seconds, then opens a log file and does
ps -ax
and some other echo to give separation and see what is running, then closes 
the file and sleeps again.

Obviously you will only be interested in the last couple of entries in this 
file.

         -Derek

At 01:19 PM 7/25/2006, Rob Connon (Info) wrote:
>Hi,
>
>I have a web/mail server thats running the lastest version of FreeBSD 
>6.0-RELEASE-p9 #4. In the last month or so it's started hard locking..
>when the machine locks up i can still ping it and get connects from 
>telneting to 80,22,etc sometimes i get a banner and sometimes i dont.. but 
>there are
>no errors on the console or in the logs.
>
>The odd thing is the locking seems to happen within a certain time window 
>(mon,tues) and never end of the week or weekend.. i suspected it could 
>have been
>a bad cron job but nothing falls into that time frame.
>
>As a test i've been rebooting the server everynight to see if that would 
>help the machine get past the begining of the week with out a hang and 
>again this morning
>even though i rebooted last night at 10pm hung around 9:47am.
>
>The machine is a Dell PowerEdge 2550, I've had dell come and replace the 
>MB and have ran all their diagnostics aswell with no errors reported..
>I've been reading alot about APIC and ACPI and people having similar 
>issues but nothing that fits the bill... below is the dmesg and output of 
>vmstat -i.. another odd thing is the rate for the CPU timer is extremely 
>high compared to other machines with similar hardware or faster hardware.
>
>Any help on where to look next would be awesome.
>
>interrupt                          total       rate
>irq1: atkbd0                         107          0
>irq6: fdc0                            10          0
>irq13: npx0                            1          0
>irq14: ata0                           74          0
>irq16: fxp0                        27110         12
>irq20: amr0                       105950         48
>cpu0: timer                      4385477       1999
>cpu1: timer                      4369967       1992
>Total                            8888696       4053
>
>
>Copyright (c) 1992-2005 The FreeBSD Project.
>Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
>        The Regents of the University of California. All rights reserved.
>FreeBSD 6.0-RELEASE-p9 #4: Thu Jun 22 14:54:15 PDT 2006
>    root at taurus.packetsafe.net:/usr/src/sys/i386/compile/SMP
>Timecounter "i8254" frequency 1193182 Hz quality 0
>CPU: Intel(R) Pentium(R) III CPU family      1266MHz (1258.22-MHz 
>686-class CPU)
>  Origin = "GenuineIntel"  Id = 0x6b1  Stepping = 1
>
>Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
>real memory  = 1073676288 (1023 MB)
>avail memory = 1041612800 (993 MB)
>ACPI APIC Table: <DELL   PE2550  >
>FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
>cpu0 (BSP): APIC ID:  1
>cpu1 (AP): APIC ID:  0
>ioapic0: Changing APIC ID to 2
>ioapic1: Changing APIC ID to 3
>MADT: Forcing active-low polarity and level trigger for SCI
>ioapic0 <Version 1.1> irqs 0-15 on motherboard
>ioapic1 <Version 1.1> irqs 16-31 on motherboard
>npx0: [FAST]
>npx0: <math processor> on motherboard
>npx0: INT 16 interface
>acpi0: <DELL PE2550> on motherboard
>acpi0: Power Button (fixed)
>pci_link0: <ACPI PCI Link LNK0> irq 5 on acpi0
>pci_link1: <ACPI PCI Link LNK1> irq 10 on acpi0
>pci_link2: <ACPI PCI Link LNK2> on acpi0
>pci_link3: <ACPI PCI Link LNK3> on acpi0
>pci_link4: <ACPI PCI Link LNK4> irq 5 on acpi0
>pci_link5: <ACPI PCI Link LNK5> irq 10 on acpi0
>pci_link6: <ACPI PCI Link LNK6> on acpi0
>pci_link7: <ACPI PCI Link LNK7> on acpi0
>pci_link8: <ACPI PCI Link LNK8> on acpi0
>pci_link9: <ACPI PCI Link LNK9> on acpi0
>pci_link10: <ACPI PCI Link LNKA> on acpi0
>pci_link11: <ACPI PCI Link LNKB> on acpi0
>pci_link12: <ACPI PCI Link LNKC> on acpi0
>pci_link13: <ACPI PCI Link LNKD> on acpi0
>pci_link14: <ACPI PCI Link LNKE> on acpi0
>pci_link15: <ACPI PCI Link LNKF> irq 10 on acpi0
>pci_link16: <ACPI PCI Link LUSB> irq 11 on acpi0
>Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000
>acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
>cpu0: <ACPI CPU> on acpi0
>cpu1: <ACPI CPU> on acpi0
>pcib0: <ACPI Host-PCI bridge> on acpi0
>pci0: <ACPI PCI bus> on pcib0
>pcib1: <PCI-PCI bridge> at device 2.0 on pci0
>pci1: <PCI bus> on pcib1
>pcib2: <PCI-PCI bridge> at device 0.0 on pci1
>pci2: <PCI bus> on pcib2
>amr0: <LSILogic MegaRAID 1.51> mem 0xf0000000-0xf7ffffff irq 20 at device 
>0.0 on pci2
>amr0: <LSILogic PERC 3/DC> Firmware 197O, BIOS 3.35, 128MB RAM
>pci1: <mass storage, SCSI> at device 1.0 (no driver attached)
>pci0: <display, VGA> at device 14.0 (no driver attached)
>isab0: <PCI-ISA bridge> port 0x8a0-0x8af at device 15.0 on pci0
>isa0: <ISA bus> on isab0
>atapci0: <ServerWorks ROSB4 UDMA33 controller> port 
>0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x8b0-0x8bf at device 15.1 on pci0
>ata0: <ATA channel 0> on atapci0
>ata1: <ATA channel 1> on atapci0
>ohci0: <OHCI (generic) USB controller> mem 0xfe400000-0xfe400fff irq 11 at 
>device 15.2 on pci0
>ohci0: [GIANT-LOCKED]
>usb0: OHCI version 1.0, legacy support
>usb0: <OHCI (generic) USB controller> on ohci0
>usb0: USB revision 1.0
>uhub0: (0x1166) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
>uhub0: 2 ports with 2 removable, self powered
>pcib3: <ACPI Host-PCI bridge> on acpi0
>pci3: <ACPI PCI bus> on pcib3
>bge0: <Broadcom BCM5700 Gigabit Ethernet, ASIC rev. 0x7104> mem 
>0xfeb00000-0xfeb0ffff irq 17 at device 8.0 on pci3
>miibus0: <MII bus> on bge0
>brgphy0: <BCM5401 10/100/1000baseTX PHY> on miibus0
>brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 
>1000baseTX-FDX, auto
>bge0: Ethernet address: 00:06:5b:f5:87:93
>pcib4: <ACPI Host-PCI bridge> on acpi0
>pci4: <ACPI PCI bus> on pcib4
>pcib5: <ACPI PCI-PCI bridge> at device 2.0 on pci4
>pci5: <ACPI PCI bus> on pcib5
>fxp0: <Intel 82559 Pro/100 Ethernet> port 0xbcc0-0xbcff mem 
>0xfe900000-0xfe900fff,0xfe700000-0xfe7fffff irq 16 at device 4.0 on pci4
>miibus1: <MII bus> on fxp0
>inphy0: <i82555 10/100 media interface> on miibus1
>inphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
>fxp0: Ethernet address: 00:06:5b:f5:87:92
>fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
>fdc0: [FAST]
>fd0: <1440-KB 3.5" drive> on fdc0 drive 0
>atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
>atkbd0: <AT Keyboard> irq 1 on atkbdc0
>kbd0 at atkbd0
>atkbd0: [GIANT-LOCKED]
>sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
>sio0: type 16550A
>sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0
>sio1: type 16550A
>ppc0: <ECP parallel printer port> port 0x378-0x37f,0x778-0x77f irq 7 drq 1 
>on acpi0
>ppc0: Generic chipset (ECP/PS2/NIBBLE) in COMPATIBLE mode
>ppc0: FIFO with 16/16/8 bytes threshold
>ppbus0: <Parallel port bus> on ppc0
>plip0: <PLIP network interface> on ppbus0
>lpt0: <Printer> on ppbus0
>lpt0: Interrupt-driven port
>ppi0: <Parallel I/O> on ppbus0
>pmtimer0 on isa0
>orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xec000-0xeffff on isa0
>sc0: <System console> at flags 0x100 on isa0
>sc0: VGA <16 virtual consoles, flags=0x300>
>vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
>Timecounters tick every 1.000 msec
>acd0: CDROM <SAMSUNG CD-ROM SN-124/q009> at ata0-master PIO4
>amrd0: <LSILogic MegaRAID logical drive> on amr0
>amrd0: 104040MB (213073920 sectors) RAID 5 (optimal)
>ses0 at amr0 bus 0 target 6 lun 0
>ses0: <DELL 1x4 U2W SCSI BP 1.32> Fixed Processor SCSI-2 device
>ses0: SAF-TE Compliant Device
>SMP: AP CPU #1 Launched!
>
>

-- 
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.
MailScanner thanks transtec Computers for their support.