6.0 Stable reboots randomly during high load.

Hendry Sarumpaet list-freebsd-stable at ezekiel.jasatel.net.id
Wed Nov 23 15:35:19 GMT 2005


Hello kama,

Wednesday, November 23, 2005, 8:04:36 PM, you wrote:

> I have a HP DL380G3 Dual 2.4 w HT disabled.

> This server is running as a newsserver (Diablo) and recieving more or less
> a full feed. aprox 200Mbps in and out. When the load rises the system
> reboots.

> I can occupy it with high CPU load w/o problem, but once I allow
> connections to the machine, it will operate for a couple of hours and then
> reboot. It gets aprox 100 connections to the machine, all of them either
> write or read from disk.

 Just for the sharing, We've HP Proliant DL380 G4 with  Dual 3.4 Ghz
 HTT enabled 2 MB RAM.
 this hardware act as our production router it seems
 pretty robust on our lab enviroment with netperf we can succesfully forwarded packet up to
 600Mbps(symetric) through bge(configured with 10 vlan) connected to
 catalyst Trunk port. CPU load around 60 % under the circumtances
 above. currently it run as router with Full internet BGP feed (160K
 prefix) with 3 neighbor upstream and moderate IPFW rule as
 lightweight packet filter and bandwidth shapper.
 nothing special on the configuration it runs with polling and IP
 fastforwarding turn on with USB disabled via BIOS and ACPI turn off.
 It runs on RELENG_6 latelly as of  Nov 11 2005.
 
 attached boot message and kernel configuration.

 
 



> The kernel is GENERIC with small changes. (look at diff below)

> This system had a working 5.4 system installed before, that did not suffer
> from these reboots.

> How do I proceed for further gathering of information before I downgrade
> it to 5.4 again?

> /Bjorn

> - snip -

> Copyright (c) 1992-2005 The FreeBSD Project.
> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
>         The Regents of the University of California. All rights reserved.
> FreeBSD 6.0-STABLE #8: Mon Nov 21 14:45:30 CET 2005
>     root at newspeer3:/usr/obj/usr/src/sys/newspeer
> ACPI APIC Table: <COMPAQ 00000083>
> Timecounter "i8254" frequency 1193182 Hz quality 0
> CPU: Intel(R) Xeon(TM) CPU 2.40GHz (2387.52-MHz 686-class CPU)
>   Origin = "GenuineIntel"  Id = 0xf29  Stepping = 9

> Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
>   Features2=0x4400<CNTX-ID,<b14>>
>   Hyperthreading: 2 logical CPUs
> real memory  = 4110393344 (3919 MB)
> avail memory = 4022607872 (3836 MB)
> FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
>  cpu0 (BSP): APIC ID:  0
>  cpu1 (AP): APIC ID:  6
> MADT: Forcing active-low polarity and level trigger for SCI
> ioapic0 <Version 1.1> irqs 0-15 on motherboard
> ioapic1 <Version 1.1> irqs 16-31 on motherboard
> ioapic2 <Version 1.1> irqs 32-47 on motherboard
> ioapic3 <Version 1.1> irqs 48-63 on motherboard
> npx0: [FAST]
> npx0: <math processor> on motherboard
> npx0: INT 16 interface
> acpi0: <COMPAQ P29> on motherboard
> acpi0: Power Button (fixed)
> pci_link0: <ACPI PCI Link IUSB> on acpi0
> pci_link1: <ACPI PCI Link IN16> on acpi0
> pci_link2: <ACPI PCI Link IN17> on acpi0
> pci_link3: <ACPI PCI Link IN18> on acpi0
> pci_link4: <ACPI PCI Link IN19> on acpi0
> pci_link5: <ACPI PCI Link IN20> on acpi0
> pci_link6: <ACPI PCI Link IN21> on acpi0
> pci_link7: <ACPI PCI Link IN22> on acpi0
> pci_link8: <ACPI PCI Link IN23> on acpi0
> pci_link9: <ACPI PCI Link IN24> on acpi0
> pci_link10: <ACPI PCI Link IN25> on acpi0
> pci_link11: <ACPI PCI Link IN26> on acpi0
> pci_link12: <ACPI PCI Link IN27> on acpi0
> pci_link13: <ACPI PCI Link IN28> on acpi0
> pci_link14: <ACPI PCI Link IN29> on acpi0
> pci_link15: <ACPI PCI Link IN30> on acpi0
> pci_link16: <ACPI PCI Link IN31> on acpi0
> pci_link17: <ACPI PCI Link IN32> on acpi0
> pci_link18: <ACPI PCI Link IN33> on acpi0
> pci_link19: <ACPI PCI Link IN34> on acpi0
> Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000
> acpi_timer0: <32-bit timer at 3.579545MHz> port 0x920-0x923 on acpi0
> cpu0: <ACPI CPU> on acpi0
> cpu1: <ACPI CPU> on acpi0
> pcib0: <ACPI Host-PCI bridge> on acpi0
> pci0: <ACPI PCI bus> on pcib0
> pci0: <display, VGA> at device 3.0 (no driver attached)
> pci0: <base peripheral> at device 4.0 (no driver attached)
> pci0: <base peripheral> at device 4.2 (no driver attached)
> isab0: <PCI-ISA bridge> at device 15.0 on pci0
> isa0: <ISA bus> on isab0
> atapci0: <ServerWorks CSB5 UDMA100 controller> port
> 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x2000-0x200f at device 15.1 on pci0
> ata0: <ATA channel 0> on atapci0
> ata1: <ATA channel 1> on atapci0
> ohci0: <OHCI (generic) USB controller> mem 0xf5ef0000-0xf5ef0fff irq 7 at
> device 15.2 on pci0
> ohci0: [GIANT-LOCKED]
> usb0: OHCI version 1.0, legacy support
> usb0: SMM does not respond, resetting
> usb0: <OHCI (generic) USB controller> on ohci0
> usb0: USB revision 1.0
> uhub0: (0x1166) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
> uhub0: 4 ports with 4 removable, self powered
> pcib1: <ACPI Host-PCI bridge> on acpi0
> pci1: <ACPI PCI bus> on pcib1
> ciss0: <Compaq Smart Array 5i> port 0x3000-0x30ff mem
> 0xf7cc0000-0xf7cfffff,0xf7bf0000-0xf7bf3fff irq 30 at device 3.0 on pci1
> ciss0: [GIANT-LOCKED]
> pcib2: <ACPI Host-PCI bridge> on acpi0
> pci2: <ACPI PCI bus> on pcib2
> bge0: <Broadcom BCM5703 Gigabit Ethernet, ASIC rev. 0x1002> mem
> 0xf7df0000-0xf7dfffff irq 29 at device 1.0 on pci2
> miibus0: <MII bus> on bge0
> brgphy0: <BCM5703 10/100/1000baseTX PHY> on miibus0
> brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX,
> 1000baseTX-FDX, auto
> bge0: Ethernet address: 00:0b:cd:f3:af:4d
> bge1: <Broadcom BCM5703 Gigabit Ethernet, ASIC rev. 0x1002> mem
> 0xf7de0000-0xf7deffff irq 31 at device 2.0 on pci2
> miibus1: <MII bus> on bge1
> brgphy1: <BCM5703 10/100/1000baseTX PHY> on miibus1
> brgphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX,
> 1000baseTX-FDX, auto
> bge1: Ethernet address: 00:0b:cd:f3:af:4c
> pcib3: <ACPI Host-PCI bridge> on acpi0
> pci3: <ACPI PCI bus> on pcib3
> pcib4: <PCI-PCI bridge> at device 1.0 on pci3
> pci4: <PCI bus> on pcib4
> ciss1: <HP Smart Array 6400> port 0x4000-0x40ff mem 0xf7ef0000-0xf7ef1fff
> irq 20 at device 4.0 on pci4
> ciss1: [GIANT-LOCKED]
> ciss2: <HP Smart Array 6400 EM> port 0x4400-0x44ff mem
> 0xf7e70000-0xf7e71fff irq 21 at device 5.0 on pci4
> ciss2: [GIANT-LOCKED]
> pcib5: <ACPI Host-PCI bridge> on acpi0
> pci6: <ACPI PCI bus> on pcib5
> pci6: <base peripheral, PCI hot-plug controller> at device 30.0 (no driver
> attached)
> acpi_tz0: <Thermal Zone> on acpi0
> atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
> atkbd0: <AT Keyboard> irq 1 on atkbdc0
> kbd0 at atkbd0
> atkbd0: [GIANT-LOCKED]
> sio0: <Standard PC COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
> sio0: type 16550A
> fdc0: <floppy drive controller (FDE)> port 0x3f2-0x3f5 irq 6 drq 2 on
> acpi0
> fdc0: [FAST]
> fd0: <1440-KB 3.5" drive> on fdc0 drive 0
> pmtimer0 on isa0
> orm0: <ISA Option ROMs> at iomem
> 0xc0000-0xc7fff,0xc8000-0xcbfff,0xcc000-0xcffff,0xd0000-0xd17ff,0xee000-0xeffff
> on isa0
> ppc0: parallel port not found.
> sc0: <System console> at flags 0x100 on isa0
> sc0: VGA <16 virtual consoles, flags=0x300>
> sio1: configured irq 3 not in bitmap of probed irqs 0
> sio1: port may not be enabled
> vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
> Timecounters tick every 1.000 msec
> acd0: CDROM <COMPAQ CD-ROM SN-124/N104> at ata0-master PIO4
> da0 at ciss0 bus 0 target 0 lun 0
> da0: <COMPAQ RAID 1  VOLUME OK> Fixed Direct Access SCSI-0 device
> da0: 135.168MB/s transfers
> da0: 17359MB (35553120 512 byte sectors: 255H 32S/T 4357C)
> da1 at ciss0 bus 0 target 1 lun 0
> da1: <COMPAQ RAID 1  VOLUME OK> Fixed Direct Access SCSI-0 device
> da1: 135.168MB/s transfers
> da1: 17359MB (35553120 512 byte sectors: 255H 32S/T 4357C)
> da2 at ciss1 bus 0 target 0 lun 0
> da2: <COMPAQ RAID 1  VOLUME OK> Fixed Direct Access SCSI-0 device
> da2: 135.168MB/s transfers
> da2: 138919MB (284506560 512 byte sectors: 255H 32S/T 34866C)
> SMP: AP CPU #1 Launched!
> Trying to mount root from ufs:/dev/da0s1a
> WARNING: / was not properly dismounted
> WARNING: /usr was not properly dismounted
> WARNING: /var was not properly dismounted
> bge0: link state changed to UP
> bge1: link state changed to UP

> # diff -ub GENERIC newspeer
> --- GENERIC     Fri Oct 28 21:21:27 2005
> +++ newspeer    Mon Nov 21 14:02:53 2005
> @@ -19,10 +19,10 @@
>  # $FreeBSD: src/sys/i386/conf/GENERIC,v 1.429.2.4 2005/10/28 19:21:27 jhb
> Exp $

>  machine                i386
> -cpu            I486_CPU
> -cpu            I586_CPU
> +#cpu           I486_CPU
> +#cpu           I586_CPU
>  cpu            I686_CPU
> -ident          GENERIC
> +ident          newspeer

>  # To statically compile in device wiring instead of /boot/device.hints
>  #hints         "GENERIC.hints"         # Default places to look for
> devices.
> @@ -33,7 +33,7 @@
>  options        SCHED_4BSD              # 4BSD scheduler
>  options        PREEMPTION              # Enable kernel thread preemption
>  options        INET                    # InterNETworking
> -options        INET6                   # IPv6 communications protocols
> +#options       INET6                   # IPv6 communications protocols
>  options        FFS                     # Berkeley Fast Filesystem
>  options        SOFTUPDATES             # Enable FFS soft updates support
>  options        UFS_ACL                 # Support for access control lists
> @@ -62,6 +62,11 @@
>  options        AHD_REG_PRETTY_PRINT    # Print register bitfields in
> debug
>                                         # output.  Adds ~215k to driver.
>  options        ADAPTIVE_GIANT          # Giant mutex is adaptive.
> +
> +options                DEVICE_POLLING
> +
> +# To make an SMP kernel, the next line is needed
> +options        SMP                     # Symmetric MultiProcessor Kernel

>  device         apic                    # I/O APIC

> _______________________________________________
> freebsd-stable at freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-stable
> To unsubscribe, send any mail to
> "freebsd-stable-unsubscribe at freebsd.org"


-------------- next part --------------
A non-text attachment was scrubbed...
Name: KERNEL
Type: application/octet-stream
Size: 9554 bytes
Desc: not available
Url : http://lists.freebsd.org/pipermail/freebsd-stable/attachments/20051123/92c6f29e/KERNEL.obj
-------------- next part --------------
Copyright (c) 1992-2005 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD 6.0-STABLE #4: Fri Nov 11 17:38:53 WIT 2005
    hsa at BORG.JASATEL.NET:/usr/obj/usr/src/sys/BORG
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(TM) CPU 3.40GHz (3400.13-MHz 686-class CPU)
  Origin = "GenuineIntel"  Id = 0xf41  Stepping = 1
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x649d<SSE3,RSVD2,MON,DS_CPL,EST,CNTX-ID,CX16,<b14>>
  AMD Features=0x20000000<LM>
  Hyperthreading: 2 logical CPUs
real memory  = 2147430400 (2047 MB)
avail memory = 2096279552 (1999 MB)
MPTable: <HP       PROLIANT    >
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  6
ioapic0: Assuming intbase of 0
ioapic1: Assuming intbase of 24
ioapic2: Assuming intbase of 48
ioapic3: Assuming intbase of 72
ioapic4: Assuming intbase of 96
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
ioapic2 <Version 2.0> irqs 48-71 on motherboard
ioapic3 <Version 2.0> irqs 72-95 on motherboard
ioapic4 <Version 2.0> irqs 96-119 on motherboard
npx0: [FAST]
npx0: <math processor> on motherboard
npx0: INT 16 interface
cpu0 on motherboard
cpu1 on motherboard
pcib0: <MPTable Host-PCI bridge> pcibus 0 on motherboard
pci0: <PCI bus> on pcib0
pcib1: <MPTable PCI-PCI bridge> at device 2.0 on pci0
pci2: <PCI bus> on pcib1
pcib2: <MPTable PCI-PCI bridge> at device 0.0 on pci2
pci3: <PCI bus> on pcib2
bge0: <Broadcom BCM5704C Dual Gigabit Ethernet, ASIC rev. 0x2100> mem 0xfdef0000-0xfdefffff irq 25 at device 1.0 on pci3
miibus0: <MII bus> on bge0
brgphy0: <BCM5704 10/100/1000baseTX PHY> on miibus0
brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 1000baseTX-FDX, auto
bge0: Ethernet address: 00:13:21:c8:4f:e1
bge1: <Broadcom BCM5704C Dual Gigabit Ethernet, ASIC rev. 0x2100> mem 0xfdee0000-0xfdeeffff irq 26 at device 1.1 on pci3
miibus1: <MII bus> on bge1
brgphy1: <BCM5704 10/100/1000baseTX PHY> on miibus1
brgphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 1000baseTX-FDX, auto
bge1: Ethernet address: 00:13:21:c8:4f:e0
pcib3: <MPTable PCI-PCI bridge> at device 0.2 on pci2
pci4: <PCI bus> on pcib3
ciss0: <HP Smart Array 6i> port 0x4000-0x40ff mem 0xfdff0000-0xfdff1fff,0xfdf80000-0xfdfbffff irq 51 at device 3.0 on pci4
ciss0: [GIANT-LOCKED]
pcib4: <MPTable PCI-PCI bridge> at device 6.0 on pci0
pci5: <PCI bus> on pcib4
pcib5: <MPTable PCI-PCI bridge> at device 0.0 on pci5
pci6: <PCI bus> on pcib5
pcib6: <MPTable PCI-PCI bridge> at device 0.2 on pci5
pci10: <PCI bus> on pcib6
pcib7: <MPTable PCI-PCI bridge> at device 30.0 on pci0
pci1: <PCI bus> on pcib7
pci1: <display, VGA> at device 3.0 (no driver attached)
pci1: <base peripheral> at device 4.0 (no driver attached)
pci1: <base peripheral> at device 4.2 (no driver attached)
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel ICH5 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x500-0x50f at device 31.1 on pci0
ata0: <ATA channel 0> on atapci0
ata1: <ATA channel 1> on atapci0
eisa0: <EISA bus> on motherboard
mainboard0: <CPQ074d (System Board)> on eisa0 slot 0
pnpbios: error 1/82 getting device count/size limit
pmtimer0 on isa0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xcbfff,0xcc000-0xcd7ff,0xee000-0xeffff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: model IntelliMouse Explorer, device ID 4
ppc0: parallel port not found.
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
sio0: type 16550A
sio1 at port 0x2f8-0x2ff irq 3 on isa0
sio1: type 16550A
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
ipfw2 (+ipv6) initialized, divert loadable, rule-based forwarding enabled, default to accept, logging disabled
acd0: CDROM <COMPAQ CD-ROM SN-124/N104> at ata0-master PIO4
SMP: AP CPU #1 Launched!
da0 at ciss0 bus 0 target 0 lun 0
da0: <COMPAQ RAID 0  VOLUME OK> Fixed Direct Access SCSI-0 device 
da0: 135.168MB/s transfers
da0: 34727MB (71122560 512 byte sectors: 255H 32S/T 8716C)
Trying to mount root from ufs:/dev/da0s1a


More information about the freebsd-stable mailing list