i386/122989: [swi] [panic] 6.3 kernel panic in swi1: net

Tue Apr 22 13:30:01 UTC 2008

>Number:         122989
>Category:       i386
>Synopsis:       [swi] [panic] 6.3 kernel panic in swi1: net
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    freebsd-i386
>State:          open
>Quarter:        
>Keywords:       
>Date-Required:
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Tue Apr 22 13:30:00 UTC 2008
>Closed-Date:
>Last-Modified:
>Originator:     Molokanov kaN5300 Ilya
>Release:        6.3
>Organization:
IIF
>Environment:
FreeBSD nas1 6.3-RELEASE FreeBSD 6.3-RELEASE #0: Fri Apr 11 22:57:41 MSD 2008     root at nas1:/usr/obj/usr/src/sys/NAS1_NO_SMP  i386

>Description:
Id Refs Address    Size     Name
 1   19 0xc0400000 2de680   kernel
 2    1 0xc06df000 5c304    acpi.ko
 3    1 0xc4b3d000 3000     ng_tee.ko
 4   12 0xc4b40000 a000     netgraph.ko
 5    1 0xc4b4e000 2000     ng_ipfw.ko
 6    1 0xc4b50000 2000     ng_nat.ko
 7    1 0xc4b52000 9000     libalias.ko
 8    1 0xc4b5d000 4000     ng_socket.ko
 9    1 0xc4cad000 3000     ng_mppc.ko
10    1 0xc4cb0000 2000     rc4.ko
11    1 0xc4ceb000 4000     ng_pptpgre.ko
12    1 0xc4d14000 4000     ng_ksocket.ko
13    1 0xc4dfc000 3000     ng_iface.ko
14    1 0xc4e08000 6000     ng_ppp.ko
15    1 0xc4e1d000 4000     ng_netflow.ko
16    1 0xc4e12000 2000     ng_tcpmss.ko
17    1 0xc50f5000 4000     ng_vjc.ko

Our NAS is running mpd5 (netflow), ng_nat, ipfw pipes and act as pptp-gate (400 online connections).

CPU states for now:
CPU states:  0.0% user,  0.0% nice,  3.9% system, 25.5% interrupt, 70.7% idle

top -S:

  PID USERNAME  THR PRI NICE   SIZE    RES STATE    TIME   WCPU COMMAND
   10 root        1 171   52     0K     8K RUN     18.7H 67.82% idle
   13 root        1 -44 -163     0K     8K WAIT   209:46 18.21% swi1: net
   24 root        1 -68    0     0K     8K -       48:50  2.88% dummynet
   19 root        1 -68 -187     0K     8K WAIT    26:08  1.86% irq10: em0 atap
   20 root        1 -68 -187     0K     8K WAIT    18:43  1.03% irq11: em1
   11 root        1 -32 -151     0K     8K WAIT    11:25  1.03% swi4: clock
   30 root        1  20    0     0K     8K syncer   0:46  0.05% syncer
 3824 root        4  20    0 13032K 10008K kserel   9:59  0.00% mpd5

System can stay uptime for one week or crash hourly.

Fatal trap 12: page fault while in kernel mode
fault virtual address   = 0x78
fault code              = supervisor read, page not present
instruction pointer     = 0x20:0xc04dee5d
stack pointer           = 0x28:0xe31efc1c
frame pointer           = 0x28:0xe31efc20
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, def32 1, gran 1
processor eflags        = resume, IOPL = 0
current process         = 13 (swi1: net)
trap number             = 12
panic: page fault
Uptime: 16h58m24s

(kgdb) bt
#0  doadump () at pcpu.h:165
#1  0xc04be166 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:409
#2  0xc04be3fc in panic (fmt=0xc05fb65e "%s") at /usr/src/sys/kern/kern_shutdown.c:565
#3  0xc05ddb54 in trap_fatal (frame=0xe31efbdc, eva=120) at /usr/src/sys/i386/i386/trap.c:838
#4  0xc05dd336 in trap (frame=
      {tf_fs = 8, tf_es = 40, tf_ds = 40, tf_edi = 0, tf_esi = -999617920, tf_ebp = -484508640, tf_isp = -484508664, tf_ebx = -999699264, tf_edx = 0, tf_ecx = 4, tf_eax = -999617888, tf_trapno = 12, tf_err = 0, tf_eip = -1068634531, tf_cs = 32, tf_eflags = 65538, tf_esp = -999617920, tf_ss = -484508604}) at /usr/src/sys/i386/i386/trap.c:270
#5  0xc05cf10a in calltrap () at /usr/src/sys/i386/i386/exception.s:139
#6  0xc04dee5d in turnstile_setowner (ts=0xc469ccc0, owner=0x4) at /usr/src/sys/kern/subr_turnstile.c:456
#7  0xc04df1ba in turnstile_wait (lock=0xc4775660, owner=0x4, queue=0) at /usr/src/sys/kern/subr_turnstile.c:661
#8  0xc04b505a in _mtx_lock_sleep (m=0xc4775660, tid=3295349376, opts=0, file=0x0, line=0) at /usr/src/sys/kern/kern_mutex.c:579
#9  0xc0552b69 in ip_input (m=0xc5953d00) at /usr/src/sys/netinet/ip_input.c:624
#10 0xc0537077 in netisr_processqueue (ni=0xc064e418) at /usr/src/sys/net/netisr.c:236
#11 0xc0537272 in swi_net (dummy=0x0) at /usr/src/sys/net/netisr.c:349
#12 0xc04a83dd in ithread_execute_handlers (p=0xc46af648, ie=0xc46ad400) at /usr/src/sys/kern/kern_intr.c:682
#13 0xc04a84f8 in ithread_loop (arg=0xc4697700) at /usr/src/sys/kern/kern_intr.c:766
#14 0xc04a7364 in fork_exit (callout=0xc04a84a4 <ithread_loop>, arg=0xc4697700, frame=0xe31efd38)
    at /usr/src/sys/kern/kern_fork.c:788
#15 0xc05cf16c in fork_trampoline () at /usr/src/sys/i386/i386/exception.s:208

>How-To-Repeat:

>Fix:

>Release-Note:
>Audit-Trail:
>Unformatted: