Crashing repeatedly: 6.2-RELEASE-p5 and MySQL 5.0.41

Primeroz lists primeroz.lists at googlemail.com
Fri Feb 8 14:40:43 UTC 2008


Server keeps crashing, I maged to have a new coredump that should be
reliable this time.

Here is the debugging of the kernel ... i'm not really an expert in this
topic so if you need any more information just let me know and i will do my
best to provide it.

[GDB will not be able to debug user-mode threads: /usr/lib/libthread_db.so:
Undefined symbol "ps_pglobal_lookup"]
GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain
conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "amd64-marcel-freebsd".

Unread portion of the kernel message buffer:


Fatal trap 9: general protection fault while in kernel mode
cpuid = 5; apic id = 05
instruction pointer     = 0x8:0xffffffff802af5e3
stack pointer           = 0x10:0xffffffffba224980
frame pointer           = 0x10:0x156a9
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 1070 (mysqld)
trap number             = 9
panic: general protection fault
cpuid = 5
Uptime: 1d0h22m1s
Dumping 8191 MB (3 chunks)
  chunk 0: 1MB (156 pages) ... ok
  chunk 1: 3327MB (851624 pages) 3311 3295 3279 3263 3247 3231 3215 3199
3183 3167 3151 3135 3119 3103 3087 3071 3055 3039 3023 3007 2991 2975 2959
2943 2927 2911 2895 2879 2863 2847 2831 2815 2799 2783 2767 2751 2735 2719
2703 2687 2671 2655 2639 2623 2607 2591 2575 2559 2543 2527 2511 2495 2479
2463 2447 2431 2415 2399 2383 2367 2351 2335 2319 2303 2287 2271 2255 2239
2223 2207 2191 2175 2159 2143 2127 2111 2095 2079 2063 2047 2031 2015 1999
1983 1967 1951 1935 1919 1903 1887 1871 1855 1839 1823 1807 1791 1775 1759
1743 1727 1711 1695 1679 1663 1647 1631 1615 1599 1583 1567 1551 1535 1519
1503 1487 1471 1455 1439 1423 1407 1391 1375 1359 1343 1327 1311 1295 1279
1263 1247 1231 1215 1199 1183 1167 1151 1135 1119 1103 1087 1071 1055 1039
1023 1007 991 975 959 943 927 911 895 879 863 847 831 815 799 783 767 751
735 719 703 687 671 655 639 623 607 591 575 559 543 527 511 495 479 463 447
431 415 399 383 367 351 335 319 303 287 271 255 239 223 207 191 175 159 143
127 111 95 79 63 47 31 15 ... ok
  chunk 2: 4864MB (1245184 pages) 4849 4833 4817 4801 4785 4769 4753 4737
4721 4705 4689 4673 4657 4641 4625 4609 4593 4577 4561 4545 4529 4513 4497
4481 4465 4449 4433 4417 4401 4385 4369 4353 4337 4321 4305 4289 4273 4257
4241 4225 4209 4193 4177 4161 4145 4129 4113 4097 4081 4065 4049 4033 4017
4001 3985 3969 3953 3937 3921 3905 3889 3873 3857 3841 3825 3809 3793 3777
3761 3745 3729 3713 3697 3681 3665 3649 3633 3617 3601 3585 3569 3553 3537
3521 3505 3489 3473 3457 3441 3425 3409 3393 3377 3361 3345 3329 3313 3297
3281 3265 3249 3233 3217 3201 3185 3169 3153 3137 3121 3105 3089 3073 3057
3041 3025 3009 2993 2977 2961 2945 2929 2913 2897 2881 2865 2849 2833 2817
2801 2785 2769 2753 2737 2721 2705 2689 2673 2657 2641 2625 2609 2593 2577
2561 2545 2529 2513 2497 2481 2465 2449 2433 2417 2401 2385 2369 2353 2337
2321 2305 2289 2273 2257 2241 2225 2209 2193 2177 2161 2145 2129 2113 2097
2081 2065 2049 2033 2017 2001 1985 1969 1953 1937 1921 1905 1889 1873 1857
1841 1825 1809 1793 1777 1761 1745 1729 1713 1697 1681 1665 1649 1633 1617
1601 1585 1569 1553 1537 1521 1505 1489 1473 1457 1441 1425 1409 1393 1377
1361 1345 1329 1313 1297 1281 1265 1249 1233 1217 1201 1185 1169 1153 1137
1121 1105 1089 1073 1057 1041 1025 1009 993 977 961 945 929 913 897 881 865
849 833 817 801 785 769 753 737 721 705 689 673 657 641 625 609 593 577 561
545 529 513 497 481 465 449 433 417 401 385 369 353 337 321 305 289 273 257
241 225 209 193 177 161 145 129 113 97 81 65 49 33 17 1

#0  doadump () at pcpu.h:172
172     pcpu.h: No such file or directory.
        in pcpu.h
(kgdb) list *0xffffffff802af5e3
0xffffffff802af5e3 is in _sx_xlock (/usr/src/sys/kern/kern_sx.c:192).
187             LOCK_LOG_LOCK("XLOCK", &sx->sx_object, 0, 0, file, line);
188             WITNESS_LOCK(&sx->sx_object, LOP_EXCLUSIVE, file, line);
189             curthread->td_locks++;
190
191             mtx_unlock(sx->sx_lock);
192     }
193
194     int
195     _sx_try_xlock(struct sx *sx, const char *file, int line)
196     {
(kgdb) bt
#0  doadump () at pcpu.h:172
#1  0x0000000000000004 in ?? ()
#2  0xffffffff802a7d67 in boot (howto=260) at
/usr/src/sys/kern/kern_shutdown.c:409
#3  0xffffffff802a8401 in panic (fmt=0xffffff00b723f260
"�&�\207\001���\200d\027�\001�����#�")
    at /usr/src/sys/kern/kern_shutdown.c:565
#4  0xffffffff80425f7f in trap_fatal (frame=0xffffff00b723f260,
eva=18446742980773947056) at /usr/src/sys/amd64/amd64/trap.c:660
#5  0xffffffff80426422 in trap (frame=
      {tf_rdi = -2140937936, tf_rsi = 4, tf_rdx = -2140937936, tf_rcx = 1,
tf_r8 = -1092771434344, tf_r9 = -1172157920, tf_rax = 1, tf_rbx =
-2144664899, tf_rbp = 87721, tf_r10 = -1096439041440, tf_r11 = 435836590,
tf_r12 = -1097457880000, tf_r13 = -1092771434352, tf_r14 = 435835520, tf_r15
= -1172157928, tf_trapno = 9, tf_addr = 0, tf_flags = -2144607018, tf_err =
0, tf_rip = -2144668189, tf_cs = 8, tf_rflags = 66182, tf_rsp = -1172158056,
tf_ss = 16}) at /usr/src/sys/amd64/amd64/trap.c:469
#6  0xffffffff8041173b in calltrap () at
/usr/src/sys/amd64/amd64/exception.S:168
#7  0xffffffff802af5e3 in _sx_xlock (sx=0xffffffff802b02bd, file=0x4
<Address 0x4 out of bounds>, line=-2140937936)
    at /usr/src/sys/kern/kern_sx.c:192
#8  0xffffff0191bf3098 in ?? ()
#9  0x02ffff00b723f260 in ?? ()
#10 0xffffffffba224a10 in ?? ()
#11 0xffffff0191bf3090 in ?? ()
#12 0x0000000019fa5280 in ?? ()
#13 0xffffff00b723f260 in ?? ()
#14 0xffffff0191bf3090 in ?? ()
#15 0x0000000000000004 in ?? ()
#16 0x0000000000000000 in ?? ()
#17 0xffffffff802b845e in umtx_key_get (td=0xffffff007a69b440,
umtx=0xffffffffba224a20, key=0x156a9)
    at /usr/src/sys/kern/kern_umtx.c:312
#18 0xffffffff802b8578 in _do_lock (td=0xffffff00b723f260, umtx=0x19fa5280,
id=100654, timo=0)
    at /usr/src/sys/kern/kern_umtx.c:362
#19 0xffffffff802b99e9 in _umtx_op (td=0xffffff00b723f260, uap=0x1892e) at
/usr/src/sys/kern/kern_umtx.c:545
#20 0xffffffff80426dd1 in syscall (frame=
      {tf_rdi = 435835520, tf_rsi = 0, tf_rdx = 100654, tf_rcx = 0, tf_r8 =
0, tf_r9 = 140737437464344, tf_rax = 454, tf_rbx = 100654, tf_rbp =
435835520, tf_r10 = 1, tf_r11 = 582, tf_r12 = 9982128, tf_r13 = 1024, tf_r14
= 0, tf_r15 = 0, tf_trapno = 12, tf_addr = 1399795712, tf_flags =
4294902004, tf_err = 2, tf_rip = 34378206780, tf_cs = 43, tf_rflags = 582,
tf_rsp = 140737437464232, tf_ss = 35}) at
/usr/src/sys/amd64/amd64/trap.c:792
#21 0xffffffff804118d8 in Xfast_syscall () at
/usr/src/sys/amd64/amd64/exception.S:270
#22 0x000000080119ce3c in ?? ()
Previous frame inner to this frame (corrupt stack?)
(kgdb) up 7
#7  0xffffffff802af5e3 in _sx_xlock (sx=0xffffffff802b02bd, file=0x4
<Address 0x4 out of bounds>, line=-2140937936)
    at /usr/src/sys/kern/kern_sx.c:192
192     }
(kgdb) up
#8  0xffffff0191bf3098 in ?? ()
(kgdb) up
#9  0x02ffff00b723f260 in ?? ()
(kgdb) up
#10 0xffffffffba224a10 in ?? ()
(kgdb) up
#11 0xffffff0191bf3090 in ?? ()
(kgdb) up
#12 0x0000000019fa5280 in ?? ()
(kgdb) up
#13 0xffffff00b723f260 in ?? ()
(kgdb) up
#14 0xffffff0191bf3090 in ?? ()
(kgdb) up
#15 0x0000000000000004 in ?? ()
(kgdb) up
#16 0x0000000000000000 in ?? ()
(kgdb) up
#17 0xffffffff802b845e in umtx_key_get (td=0xffffff007a69b440,
umtx=0xffffffffba224a20, key=0x156a9)
    at /usr/src/sys/kern/kern_umtx.c:312
312             if (vm_map_lookup(&map, (vm_offset_t)umtx, VM_PROT_WRITE,
(kgdb) up
#18 0xffffffff802b8578 in _do_lock (td=0xffffff00b723f260, umtx=0x19fa5280,
id=100654, timo=0)
    at /usr/src/sys/kern/kern_umtx.c:362
362             if ((error = umtx_key_get(td, umtx, &uq->uq_key)) != 0)
(kgdb) list
357     static inline int
358     umtxq_queue_me(struct thread *td, struct umtx *umtx, struct umtx_q
*uq)
359     {
360             int error;
361
362             if ((error = umtx_key_get(td, umtx, &uq->uq_key)) != 0)
363                     return (error);
364
365             uq->uq_addr = (vm_offset_t)umtx;
366             uq->uq_thread = td;
(kgdb) up
#19 0xffffffff802b99e9 in _umtx_op (td=0xffffff00b723f260, uap=0x1892e) at
/usr/src/sys/kern/kern_umtx.c:545
545                     error = _do_lock(td, umtx, id, 0);
(kgdb) up
#20 0xffffffff80426dd1 in syscall (frame=
      {tf_rdi = 435835520, tf_rsi = 0, tf_rdx = 100654, tf_rcx = 0, tf_r8 =
0, tf_r9 = 140737437464344, tf_rax = 454, tf_rbx = 100654, tf_rbp =
435835520, tf_r10 = 1, tf_r11 = 582, tf_r12 = 9982128, tf_r13 = 1024, tf_r14
= 0, tf_r15 = 0, tf_trapno = 12, tf_addr = 1399795712, tf_flags =
4294902004, tf_err = 2, tf_rip = 34378206780, tf_cs = 43, tf_rflags = 582,
tf_rsp = 140737437464232, tf_ss = 35}) at
/usr/src/sys/amd64/amd64/trap.c:792
792                             error = (*callp->sy_call)(td, argp);
(kgdb) list
787                     if ((callp->sy_narg & SYF_MPSAFE) == 0) {
788                             mtx_lock(&Giant);
789                             error = (*callp->sy_call)(td, argp);
790                             mtx_unlock(&Giant);
791                     } else
792                             error = (*callp->sy_call)(td, argp);
793             }
794
795             switch (error) {
796             case 0:
(kgdb)


More information about the freebsd-stable mailing list