frebsd 5.4 repeated crash in sched_4bsd.c
Cedric Tabary
tabary at efrei.fr
Tue Oct 18 08:08:17 PDT 2005
Hello,
This is a dell 1850 server witn 1 Xeon 2.8G
NOT SMP kernel
It was running Zeus web server, avg load 0.50, 40%cpu, 60mbps output on em0
mounting nfs
here is the kgdb output :
[GDB will not be able to debug user-mode threads:
/usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"]
GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "i386-marcel-freebsd".
Unread portion of the kernel message buffer:
panic: vm_page_free: freeing wired page
Uptime: 1h24m4s
Dumping 1023 MB
16 32 48 64 80 96 112 128 144 160 176 192 208 224 240 256 272 288 304
320 336 352 368 384 400 416 432 448 464 480 496 512 528 544 560 576 592
608 624 640 656 672 688 704 720 736 752 768 784 800 816 832 848 864 880
896 912 928 944 960 976 992 1008
#0 doadump () at pcpu.h:160
160 pcpu.h: No such file or directory.
in pcpu.h
(kgdb) bt
#0 doadump () at pcpu.h:160
#1 0xc06786e1 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:412
#2 0xc06789e8 in panic (fmt=0xc08b918b "vm_page_free: freeing wired page") at /usr/src/sys/kern/kern_shutdown.c:568
#3 0xc07e853a in vm_page_free_toq (m=0xc10f9ed0) at /usr/src/sys/vm/vm_page.c:1039
#4 0xc07e79ef in vm_page_free (m=0xc10f9ed0) at /usr/src/sys/vm/vm_page.c:398
#5 0xc07e6b60 in vm_object_backing_scan (object=0xc407c8c4, op=4) at /usr/src/sys/vm/vm_object.c:1536
#6 0xc07e6db5 in vm_object_collapse (object=0xc407c8c4) at /usr/src/sys/vm/vm_object.c:1642
#7 0xc07e489e in vm_object_deallocate (object=0xc407c8c4) at /usr/src/sys/vm/vm_object.c:551
#8 0xc07e0b6d in vm_map_entry_delete (map=0xc28e6708, entry=0xc2b3e0cc) at /usr/src/sys/vm/vm_map.c:2207
#9 0xc07e0da0 in vm_map_delete (map=0xc28e6708, start=3266569824, end=3217031168) at /usr/src/sys/vm/vm_map.c:2300
#10 0xc07e0e14 in vm_map_remove (map=0xc28e6708, start=0, end=3217031168) at /usr/src/sys/vm/vm_map.c:2319
#11 0xc065c6cc in exit1 (td=0xc58a0300, rv=0) at vm_map.h:211 #12 0xc065beed in sys_exit (td=0x0, uap=0x0) at /usr/src/sys/kern/kern_exit.c:94
#13 0xc084208b in syscall (frame= {tf_fs = 352649263, tf_es = 340525103, tf_ds = 340394031, tf_edi =
-1077943344, tf_esi = -1077943248, tf_ebp = 4, tf_isp = -396563100,
tf_ebx = -1077943312, tf_edx = 0, tf_ecx = 141558720, tf_eax = 1,
tf_trapno = 12, tf_err = 2, tf_eip = -2060377917, tf_cs = 31, tf_eflags
= 658, tf_esp = -1077943476, tf_ss = 47}) at
/usr/src/sys/i386/i386/trap.c:1009
#14 0xc082fb6f in Xint0x80_syscall () at /usr/src/sys/i386/i386/exception.s:201
#15 0x1505002f in ?? ()
#16 0x144c002f in ?? ()
#17 0x144a002f in ?? ()
#18 0xbfbfe3d0 in ?? ()
#19 0xbfbfe430 in ?? ()
#20 0x00000004 in ?? ()
#21 0xe85ced64 in ?? ()
#22 0xbfbfe3f0 in ?? ()
#23 0x00000000 in ?? ()
#24 0x087003c0 in ?? ()
#25 0x00000001 in ?? ()
#26 0x0000000c in ?? ()
#27 0x00000002 in ?? ()
#28 0x853120c3 in ?? ()
#29 0x0000001f in ?? ()
#30 0x00000292 in ?? ()
#31 0xbfbfe34c in ?? ()
#32 0x0000002f in ?? ()
#33 0x00000000 in ?? ()
#34 0x00000000 in ?? ()
#35 0x00000000 in ?? ()
#36 0x00000000 in ?? ()
#37 0x2f4e0000 in ?? ()
#38 0xc58a3000 in ?? ()
#39 0xc58a0300 in ?? ()
---Type <return> to continue, or q <return> to quit---
#40 0xe85cec98 in ?? ()
#41 0xe85cec80 in ?? ()
#42 0xc2315600 in ?? ()
#43 0xc068b0f2 in sched_switch (td=0xbfbfe430, newtd=0xbfbfe3f0,
flags=Cannot access memory at address 0x14
) at /usr/src/sys/kern/sched_4bsd.c:881
Previous frame inner to this frame (corrupt stack?)
(kgdb)
Kernel config :
machine i386
cpu I686_CPU ident CED maxusers 512
# To statically compile in device wiring instead of /boot/device.hints
#hints "GENERIC.hints" # Default places to look for devices.
makeoptions DEBUG=-g
options PERFMON
options HZ=2000
options DEVICE_POLLING
options SCHED_4BSD # 4BSD scheduler
options INET # InterNETworking
#options INET6 # IPv6 communications protocols
options FFS # Berkeley Fast Filesystem
options SOFTUPDATES # Enable FFS soft updates support
options UFS_ACL # Support for access control lists
options UFS_DIRHASH # Improve performance on big directories
#options MD_ROOT # MD is a potential root device
options NFSCLIENT # Network Filesystem Client
options NFSSERVER # Network Filesystem Server
#options NFS_ROOT # NFS usable as /, requires NFSCLIENT
options MSDOSFS # MSDOS Filesystem
options CD9660 # ISO 9660 Filesystem
options PROCFS # Process filesystem (requires PSEUDOFS)
options PSEUDOFS # Pseudo-filesystem framework
options GEOM_GPT # GUID Partition Tables.
options COMPAT_43 # Compatible with BSD 4.3 [KEEP THIS!]
options COMPAT_FREEBSD4 # Compatible with FreeBSD4
options SCSI_DELAY=15000 # Delay (in ms) before probing SCSI
options KTRACE # ktrace(1) support
options SYSVSHM # SYSV-style shared memory
options SYSVMSG # SYSV-style message queues
options SYSVSEM # SYSV-style semaphores
options _KPOSIX_PRIORITY_SCHEDULING # POSIX P1003_1B real-time extensions
options KBD_INSTALL_CDEV # install a CDEV entry in /dev
options AHC_REG_PRETTY_PRINT # Print register bitfields in debug
# output. Adds ~128k to driver.
options AHD_REG_PRETTY_PRINT # Print register bitfields in debug
# output. Adds ~215k to driver.
options ADAPTIVE_GIANT # Giant mutex is adaptive.
options IPFILTER
options IPFILTER_LOG #ipfilter logging
options IPSTEALTH #support for stealth forwarding
options TCP_DROP_SYNFIN #drop TCP packets with SYN+FIN
options ZERO_COPY_SOCKETS
[...] + generic device list
sysctl.conf :
security.bsd.see_other_uids=0
kern.polling.enable=1
kern.maxfiles=1048576
kern.maxfilesperproc=524288
net.inet.tcp.delayed_ack=0
net.inet.tcp.sendspace=65535
net.inet.tcp.recvspace=8192
net.inet.ip.redirect=0
net.inet.icmp.drop_redirect=1
net.inet.icmp.log_redirect=0
net.inet.ip.forwarding=1
net.inet.icmp.icmplim=5000
kern.ipc.somaxconn=8192
kern.ipc.nmbclusters=262144
kern.ipc.maxsockbuf=2097152
dmesg :
Copyright (c) 1992-2005 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights
reserved.
FreeBSD 5.4-STABLE #4: Sat Oct 15 10:44:12 CEST 2005
*****************:/usr/obj/usr/src/sys/CED
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(TM) CPU 2.80GHz (2793.01-MHz 686-class CPU)
Origin = "GenuineIntel" Id = 0xf41 Stepping = 1
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Hyperthreading: 2 logical CPUs
real memory = 1073479680 (1023 MB)
avail memory = 1040789504 (992 MB)
ACPI APIC Table: <DELL PE BKC >
ioapic0: Changing APIC ID to 2
ioapic1: Changing APIC ID to 3
ioapic1: WARNING: intbase 32 != expected base 24
ioapic2: Changing APIC ID to 4
ioapic2: WARNING: intbase 64 != expected base 56
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 32-55 on motherboard
ioapic2 <Version 2.0> irqs 64-87 on motherboard
npx0: <math processor> on motherboard
npx0: INT 16 interface
acpi0: <DELL PE BKC> on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
cpu0: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> at device 0.0 on pci1
pci2: <ACPI PCI bus> on pcib2
amr0: <LSILogic MegaRAID 1.51> mem
0xdfee0000-0xdfefffff,0xd80f0000-0xd80fffff irq 46 at device 14.0 on
pci2
amr0: <LSILogic PERC 4e/Si> Firmware 513O, BIOS H418, 256MB RAM
pcib3: <ACPI PCI-PCI bridge> at device 0.2 on pci1
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> at device 4.0 on pci0
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> at device 5.0 on pci0
pci5: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> at device 0.0 on pci5
pci6: <ACPI PCI bus> on pcib6
em0: <Intel(R) PRO/1000 Network Connection, Version - 1.7.35> port
0xecc0-0xecff mem 0xdfbe0000-0xdfbfffff irq 64 at device 7.0 on pci6
em0: Ethernet address: 00:11:43:36:39:e5
em0: Speed:N/A Duplex:N/A
pcib7: <ACPI PCI-PCI bridge> at device 0.2 on pci5
pci7: <ACPI PCI bus> on pcib7
em1: <Intel(R) PRO/1000 Network Connection, Version - 1.7.35> port
0xdcc0-0xdcff mem 0xdf9e0000-0xdf9fffff irq 65 at device 8.0 on pci7
em1: Ethernet address: 00:11:43:36:39:e6
em1: Speed:N/A Duplex:N/A
pcib8: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci8: <ACPI PCI bus> on pcib8
pcib9: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci9: <ACPI PCI bus> on pcib9
pci9: <display, VGA> at device 13.0 (no driver attached)
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel ICH5 UDMA100 controller> port
0xfc00-0xfc0f,0x376,0x170-0x177,0x3f6,0x1f0-0x1f7 at device 31.1 on pci0
ata0: channel #0 on atapci0
ata1: channel #1 on atapci0
fdc0: <floppy drive controller> port 0x3f7,0x3f0-0x3f5 irq 6 drq 2 on
acpi0
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on
acpi0
sio0: type 16550A
orm0: <ISA Option ROMs> at iomem
0xec000-0xeffff,0xce800-0xcf7ff,0xcb000-0xcbfff,0xc0000-0xcafff on isa0
pmtimer0 on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x64,0x60 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
ppc0: parallel port not found.
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on
isa0
Timecounter "TSC" frequency 2793014952 Hz quality 800
Timecounters tick every 1.000 msec
IP Filter: v3.4.35 initialized. Default = pass all, Logging = enabled
acd0: CDROM <SAMSUNG CD-ROM SN-124/N104> at ata0-master PIO4
amrd0: <LSILogic MegaRAID logical drive> on amr0
amrd0: 69880MB (143114240 sectors) RAID 1 (optimal)
ses0 at amr0 bus 0 target 6 lun 0
ses0: <PE/PV 1x2 SCSI BP 1.0> Fixed Processor SCSI-2 device
ses0: SAF-TE Compliant Device
Mounting root from ufs:/dev/amrd0s1a
WARNING: / was not properly dismounted
WARNING: /tmp was not properly dismounted
WARNING: /usr was not properly dismounted
WARNING: /var was not properly dismounted
/var: mount pending error: blocks 4 files 1
em0: Link is up 100 Mbps Full Duplex
em1: Link is up 100 Mbps Full Duplex
Cédric
More information about the freebsd-stable
mailing list