Daily Panics on 6.2-STABLE (page fault/Fatal trap 12)

Mark Kane mark at mkproductions.org
Wed Feb 21 04:41:28 UTC 2007


Hi everyone.

I'm getting kernel panics daily or even multiple times a day on a new
machine. When it's running everything works well, but over the last day
or two I've been getting multiple panics per day at seemingly random
times.

When the first panic happened, all I did was open up a new tab in my
graphical terminal. The second one I had VNC open to another FBSD box
and was maximizing the VNC window here to continue working on it. The
third one I was running a simple command via SSH on another machine (in
a graphical terminal). The fourth one was just pulling a website up in
my browser. The latest one was also working on another machine via SSH
in a graphical terminal. I had just switched terminal tabs and then it
panicked.

The CPU is nowhere near loaded at the times it panics, and since it
has happened several different times while doing different things each
time, I'm not exactly sure of one single event that triggers it. The
programs I have open when it panics are XChat, Opera or Firefox, XMMS,
a Terminal with some tabs, sometimes mplayer playing audio, and Claws
Mail. I've tested my RAM (brand new) with three passes of memtest86+
and there were zero errors. I have included some kgdb output, a dmesg,
and my kernel configuration. 

This is the first real panicking problem I've ever experienced with
FreeBSD, so please let me know if there is any additional information I
can provide.

Thanks very much in advance.

-Mark

==================== KGDB OUTPUT ====================

[GDB will not be able to debug user-mode
threads: /usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"]
GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and
you are
welcome to change it and/or distribute copies of it under certain
conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for
details.
This GDB was configured as "amd64-marcel-freebsd".

Unread portion of the kernel message buffer:


Fatal trap 12: page fault while in kernel mode
cpuid = 1; apic id = 01
fault virtual address   = 0x30
fault code              = supervisor write data, page not present
instruction pointer     = 0x8:0xffffffff803b7db4
stack pointer           = 0x10:0xffffffffb4eee6d0
frame pointer           = 0x10:0x0
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 1638 (xmms)
trap number             = 12
panic: page fault
cpuid = 1
Uptime: 2h6m25s
Dumping 2047 MB (2 chunks)
  chunk 0: 1MB (156 pages) ... ok
  chunk 1: 2047MB (523984 pages) 2031 2015 1999 1983 1967 1951 1935
1919 1903 1887 1871 1855 1839 1823 1807 1791 1775 1759 1743 1727 1711
1695 1679 1663 1647 1631 1615 1599 1583 1567 1551 1535 1519 1503 1487
1471 1455 1439 1423 1407 1391 1375 1359 1343 1327 1311 1295 1279 1263
1247 1231 1215 1199 1183 1167 1151 1135 1119 1103 1087 1071 1055 1039
1023 1007 991 975 959 943 927 911 895 879 863 847 831 815 799 783 767
751 735 719 703 687 671 655 639 623 607 591 575 559 543 527 511 495 479
463 447 431 415 399 383 367 351 335 319 303 287 271 255 239 223 207 191
175 159 143 127 111 95 79 63 47 31 15

#0  doadump () at pcpu.h:172
172     pcpu.h: No such file or directory.
        in pcpu.h
(kgdb) list *0xffffffff803b7db4
0xffffffff803b7db4 is in devfs_open
(/usr/src/sys/fs/devfs/devfs_vnops.c:798).
793              * the file *.
794              */
795             fp = ap->a_td->td_proc->p_fd->fd_ofiles[ap->a_fdidx];
796             KASSERT(fp->f_ops == &badfileops,
797                  ("Could not vnode bypass device on fdops %p",
fp->f_ops));
798             fp->f_ops = &devfs_ops_f;
799             fp->f_data = dev;
800             return (error);
801     }
802
(kgdb) backtrace
#0  doadump () at pcpu.h:172
#1  0x0000000000000004 in ?? ()
#2  0xffffffff804194d7 in boot (howto=260)
at /usr/src/sys/kern/kern_shutdown.c:409
#3  0xffffffff80419b71 in panic (fmt=0xffffff004bff4260 "X�eb")
at /usr/src/sys/kern/kern_shutdown.c:565
#4  0xffffffff8063588f in trap_fatal (frame=0xffffff004bff4260,
eva=18446742975848768344) at /usr/src/sys/amd64/amd64/trap.c:668
#5  0xffffffff80635c0c in trap_pfault (frame=0xffffffffb4eee620,
usermode=0) at /usr/src/sys/amd64/amd64/trap.c:580
#6  0xffffffff80635ec3 in trap (frame=
      {tf_rdi = -1097447831552, tf_rsi = -1098236607904, tf_rdx = 7,
tf_rcx = 4, tf_r8 = 1, tf_r9 = -1098342836736, tf_rax = 0, tf_rbx =
-1098236607904, tf_rbp = 0, tf_r10 = -1098486072152, tf_r11 = 7, tf_r12
= 0, tf_r13 = -1098486072320, tf_r14 = -1097860783272, tf_r15 =
-1097447831552, tf_trapno = 12, tf_addr = 48, tf_flags =
-1098236607904, tf_err = 2, tf_rip = -2143584844, tf_cs = 8, tf_rflags
= 66118, tf_rsp = -1259411744, tf_ss = 16})
    at /usr/src/sys/amd64/amd64/trap.c:353
#7  0xffffffff806210ab in calltrap ()
at /usr/src/sys/amd64/amd64/exception.S:168
#8  0xffffffff803b7db4 in devfs_open (ap=0xffffff006265e358)
at /usr/src/sys/fs/devfs/devfs_vnops.c:795
#9  0xffffffff8068956a in VOP_OPEN_APV (vop=0x0, a=0xffffff004bff4260)
at vnode_if.c:372
#10 0xffffffff804949d0 in vn_open_cred (ndp=0xffffffffb4eee9c0,
flagp=0xffffffffb4eee90c, cmode=1553653760, cred=0xffffff0045aa5600,
fdidx=7)
    at vnode_if.h:198
#11 0xffffffff8048aa5f in kern_open (td=0xffffff004bff4260,
path=0x6d94a0 <Address 0x6d94a0 out of bounds>, pathseg=UIO_USERSPACE,
flags=1, 
    mode=-1259411008) at /usr/src/sys/kern/vfs_syscalls.c:1009
#12 0xffffffff8048b202 in open (td=0xffffff007b030800,
uap=0xffffffffb4eeebc0) at /usr/src/sys/kern/vfs_syscalls.c:973
#13 0xffffffff80636741 in syscall (frame=
      {tf_rdi = 7181472, tf_rsi = 0, tf_rdx = 0, tf_rcx = 6291552,
tf_r8 = 0, tf_r9 = 0, tf_rax = 5, tf_rbx = 0, tf_rbp = 0, tf_r10 = 1,
tf_r11 = 1, tf_r12 = 6291456, tf_r13 = 7181472, tf_r14 = 7352160,
tf_r15 = 140737488349408, tf_trapno = 22, tf_addr = 0, tf_flags = 9,
tf_err = 2, tf_rip = 34389146812, tf_cs = 43, tf_rflags = 582, tf_rsp =
140737488348792, tf_ss = 35}) at /usr/src/sys/amd64/amd64/trap.c:803
#14 0xffffffff80621248 in Xfast_syscall ()
at /usr/src/sys/amd64/amd64/exception.S:270
#15 0x0000000801c0bcbc in ?? ()
Previous frame inner to this frame (corrupt stack?)
(kgdb) q

==================== DMESG ====================

Copyright (c) 1992-2007 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 6.2-STABLE #4: Tue Feb 20 18:16:50 CST 2007
    mixx941 at amd64.localhost:/usr/obj/usr/src/sys/AMD645200
ACPI APIC Table: <A M I  OEMAPIC >
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: AMD Athlon(tm) 64 X2 Dual Core Processor 5200+ (2613.40-MHz
K8-class CPU)
  Origin = "AuthenticAMD"  Id = 0x40f32  Stepping = 2
  Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
  Features2=0x2001<SSE3,CX16>
  AMD
Features=0xea500800<SYSCALL,NX,MMX+,FFXSR,RDTSCP,LM,3DNow!+,3DNow!>
  AMD Features2=0x1f<LAHF,CMP,SVM,ExtAPIC,CR8>
  Cores per package: 2
real memory  = 2147287040 (2047 MB)
avail memory = 2061553664 (1966 MB)
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
ioapic0 <Version 1.1> irqs 0-23 on motherboard
kbd1 at kbdmux0
ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413,
RF5413)
acpi0: <A M I OEMRSDT> on motherboard
acpi0: Power Button (fixed)
acpi0: reservation of fec00000, 1000 (3) failed
acpi0: reservation of fee00000, 1000 (3) failed
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x2008-0x200b on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pci0: <memory, RAM> at device 0.0 (no driver attached)
isab0: <PCI-ISA bridge> at device 1.0 on pci0
isa0: <ISA bus> on isab0
pci0: <serial bus, SMBus> at device 1.1 (no driver attached)
ohci0: <OHCI (generic) USB controller> mem 0xfeafb000-0xfeafbfff irq 21
at device 2.0 on pci0
ohci0: [GIANT-LOCKED]
usb0: OHCI version 1.0, legacy support
usb0: SMM does not respond, resetting
usb0: <OHCI (generic) USB controller> on ohci0
usb0: USB revision 1.0
uhub0: nVidia OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 10 ports with 10 removable, self powered
ehci0: <EHCI (generic) USB 2.0 controller> mem 0xfeafac00-0xfeafacff
irq 22 at device 2.1 on pci0
ehci0: [GIANT-LOCKED]
usb1: EHCI version 1.0
usb1: companion controller, 10 ports each: usb0
usb1: <EHCI (generic) USB 2.0 controller> on ehci0
usb1: USB revision 2.0
uhub1: nVidia EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub1: 10 ports with 10 removable, self powered
atapci0: <nVidia nForce MCP55 UDMA133 controller> port
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xffa0-0xffaf at device 4.0 on pci0
ata0: <ATA channel 0> on atapci0
ata1: <ATA channel 1> on atapci0
atapci1: <nVidia nForce MCP55 SATA300 controller> port
0xc480-0xc487,0xc400-0xc403,0xc080-0xc087,0xc000-0xc003,0xbc00-0xbc0f
mem 0xfeaf9000-0xfeaf9fff irq 23 at device 5.0 on pci0
ata2: <ATA channel 0> on atapci1
ata3: <ATA channel 1> on atapci1
atapci2: <nVidia nForce MCP55 SATA300 controller> port
0xb880-0xb887,0xb800-0xb803,0xb480-0xb487,0xb400-0xb403,0xb080-0xb08f
mem 0xfeaf8000-0xfeaf8fff irq 20 at device 5.1 on pci0
ata4: <ATA channel 0> on atapci2
ata5: <ATA channel 1> on atapci2
atapci3: <nVidia nForce MCP55 SATA300 controller> port
0xb000-0xb007,0xac00-0xac03,0xa880-0xa887,0xa800-0xa803,0xa480-0xa48f
mem 0xfeaf7000-0xfeaf7fff irq 21 at device 5.2 on pci0
ata6: <ATA channel 0> on atapci3
ata7: <ATA channel 1> on atapci3
pcib1: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcm0: <Creative Audigy 2 (EMU10K2)> port 0xec00-0xec3f irq 16 at device
0.0 on pci1
pcm0: <SigmaTel STAC9721/23 AC97 Codec>
fwohci0: <1394 Open Host Controller Interface> mem
0xfebff800-0xfebfffff,0xfebf8000-0xfebfbfff irq 17 at device 0.2 on pci1
fwohci0: OHCI version 1.10 (ROM=0)
fwohci0: No. of Isochronous channels is 4.
fwohci0: EUI64 00:02:3c:00:91:01:6c:20
fwohci0: Phy 1394a available S400, 2 ports.
fwohci0: Link S400, max_rec 2048 bytes.
firewire0: <IEEE1394(FireWire) bus> on fwohci0
fwe0: <Ethernet over FireWire> on firewire0
if_fwe0: Fake Ethernet address: 02:02:3c:01:6c:20
fwe0: Ethernet address: 02:02:3c:01:6c:20
fwe0: if_start running deferred for Giant
sbp0: <SBP-2/SCSI over FireWire> on firewire0
fwohci0: Initiate bus reset
fwohci0: node_id=0xc800ffc0, gen=1, CYCLEMASTER mode
firewire0: 1 nodes, maxhop <= 0, cable IRM = 0 (me)
firewire0: bus manager 0 (me)
pci1: <display, VGA> at device 1.0 (no driver attached)
pci1: <display> at device 1.1 (no driver attached)
ahc0: <Adaptec 3960D Ultra160 SCSI adapter> port 0xd800-0xd8ff mem
0xfebfe000-0xfebfefff irq 18 at device 2.0 on pci1
ahc0: [GIANT-LOCKED]
aic7899: Ultra160 Wide Channel A, SCSI Id=7, 32/253 SCBs
ahc1: <Adaptec 3960D Ultra160 SCSI adapter> port 0xd400-0xd4ff mem
0xfebfd000-0xfebfdfff irq 19 at device 2.1 on pci1
ahc1: [GIANT-LOCKED]
aic7899: Ultra160 Wide Channel B, SCSI Id=7, 32/253 SCBs
fwohci1: <VIA Fire II (VT6306)> port 0xe800-0xe87f mem
0xfebff000-0xfebff7ff irq 19 at device 4.0 on pci1
fwohci1: OHCI version 1.10 (ROM=1)
fwohci1: No. of Isochronous channels is 4.
fwohci1: EUI64 00:10:dc:00:01:05:97:2e
fwohci1: Phy 1394a available S400, 2 ports.
fwohci1: Link S400, max_rec 2048 bytes.
firewire1: <IEEE1394(FireWire) bus> on fwohci1
fwe1: <Ethernet over FireWire> on firewire1
if_fwe1: Fake Ethernet address: 02:10:dc:05:97:2e
fwe1: Ethernet address: 02:10:dc:05:97:2e
fwe1: if_start running deferred for Giant
sbp1: <SBP-2/SCSI over FireWire> on firewire1
fwohci1: Initiate bus reset
fwohci1: node_id=0xc800ffc0, gen=1, CYCLEMASTER mode
firewire1: 1 nodes, maxhop <= 0, cable IRM = 0 (me)
firewire1: bus manager 0 (me)
pci0: <multimedia> at device 6.1 (no driver attached)
nfe0: <NVIDIA nForce MCP55 Networking Adapter> port 0xa400-0xa407 mem
0xfeaf6000-0xfeaf6fff,0xfeafa800-0xfeafa8ff,0xfeafa400-0xfeafa40f irq
23 at device 8.0 on pci0
nfe0: Ethernet address: 00:16:17:ec:1d:e1
miibus0: <MII bus> on nfe0
ukphy0: <Generic IEEE 802.3u media interface> on miibus0
ukphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
1000baseT-FDX, auto
nfe0: [FAST]
nfe1: <NVIDIA nForce MCP55 Networking Adapter> port 0xa080-0xa087 mem
0xfeaf5000-0xfeaf5fff,0xfeafa000-0xfeafa0ff,0xfeaf4c00-0xfeaf4c0f irq
20 at device 9.0 on pci0
nfe1: Ethernet address: 00:16:17:ec:20:df
miibus1: <MII bus> on nfe1
ukphy1: <Generic IEEE 802.3u media interface> on miibus1
ukphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
1000baseT-FDX, auto
nfe1: [FAST]
pcib2: <ACPI PCI-PCI bridge> at device 10.0 on pci0
pci2: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> at device 11.0 on pci0
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> at device 12.0 on pci0
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> at device 13.0 on pci0
pci5: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> at device 14.0 on pci0
pci6: <ACPI PCI bus> on pcib6
pcib7: <ACPI PCI-PCI bridge> at device 15.0 on pci0
pci7: <ACPI PCI bus> on pcib7
acpi_button0: <Power Button> on acpi0
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on
acpi0
sio0: type 16550A
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
sio1: <Generic IRDA-compatible device> port 0x2f8-0x2ff irq 3 on acpi0
sio1: type 16550A
ppc0: <Standard parallel printer port> port 0x378-0x37f irq 7 on acpi0
ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode
ppbus0: <Parallel port bus> on ppc0
plip0: <PLIP network interface> on ppbus0
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
orm0: <ISA Option ROM> at iomem 0xc0000-0xccfff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on
isa0
ums0: Microsoft Microsoft 5-Button Mouse with IntelliEye(TM), rev
1.10/3.00, addr 2, iclass 3/1
ums0: 5 buttons and Z dir.
Timecounters tick every 1.000 msec
acd0: DMA limited to UDMA33, device found non-ATA66 cable
acd0: DVDR <LITE-ON DVDRW LH-20A1P/KL02> at ata0-master UDMA33
ad4: 305245MB <Seagate ST3320620AS 3.AAD> at ata2-master SATA150
Waiting 5 seconds for SCSI devices to settle
SMP: AP CPU #1 Launched!
da0 at ahc1 bus 0 target 15 lun 0
da0: <FUJITSU MAX3073NP 0104> Fixed Direct Access SCSI-3 device 
da0: 160.000MB/s transfers (80.000MHz, offset 127, 16bit), Tagged
Queueing Enabled
da0: 70136MB (143638992 512 byte sectors: 255H 63S/T 8941C)
cd0 at ata0 bus 0 target 0 lun 0
cd0: <LITE-ON DVDRW LH-20A1P KL02> Removable CD-ROM SCSI-0 device 
cd0: 33.000MB/s transfers
cd0: Attempt to query device size failed: NOT READY, Medium not present
Trying to mount root from ufs:/dev/da0s1a
WARNING: / was not properly dismounted
WARNING: /tmp was not properly dismounted
WARNING: /usr was not properly dismounted
WARNING: /var was not properly dismounted

==================== KERNEL CONFIG ====================
GENERIC plus:

options         SMP
device          atapicam
device          sound
device          "snd_emu10k1"
options         DEVICE_POLLING

-- 
Internet Radio:
Party107 (Trance/Electronic) - http://www.party107.com
Rock 101.9 The Edge (Rock) - http://www.rock1019.net

IRC:
MIXXnet IRC Network - irc.mixxnet.net (Nick: MIXX941)


More information about the freebsd-stable mailing list