kern/157770: iscsi_initiator panic
Martin Birgmeier
martin.birgmeier at aon.at
Sat Jun 11 14:20:06 UTC 2011
>Number: 157770
>Category: kern
>Synopsis: iscsi_initiator panic
>Confidential: no
>Severity: serious
>Priority: medium
>Responsible: freebsd-bugs
>State: open
>Quarter:
>Keywords:
>Date-Required:
>Class: sw-bug
>Submitter-Id: current-users
>Arrival-Date: Sat Jun 11 14:20:05 UTC 2011
>Closed-Date:
>Last-Modified:
>Originator: Martin Birgmeier
>Release: 8.2 amd64
>Organization:
MBi at home
>Environment:
FreeBSD hal.xyzzy 8.2-RELEASE FreeBSD 8.2-RELEASE #1: Sun Feb 20 17:29:54 CET 2011 root at hal.xyzzy:/z/OBJ/FreeBSD/amd64/RELENG_8_2_0_RELEASE/src/sys/XYZZY_SMP amd64
>Description:
The setup involves an iSCSI target server ("hal"), using ports/net/istgt. The target disks are on a ZFS volume as plain files. This works fine with an initiator on a Windows XP client (using Microsoft iSCSI Software Initiator Version 2.08).
The next step was to use the same machine also as an iSCSI initiator. For this, I loaded iscsi_initiator via kldload.
Then I executed "iscontrol -d -t hal.xyzzy" several times, because initially it did not succeed due to parameter problems ("FirstBurstLength(262144) > MaxBurstLength(131072)").
During the execution of these commands, the system became very unresponsive. System load did not increase, however. "systat -vm 1" paused intermittently for several seconds. Because of the parameter problem, the "iscontrol" command would not succeed, but instead hang non-interruptibly until some timeout. After the timeout, the machine seemed to become somewhat more responsive again.
After fixing the iscsi configuration, the above iscontrol command succeeded, printing the available targets.
Shortly afterwards, the machine paniced. I have included a kgdb output as an attachment.
>How-To-Repeat:
Presumably using the same sequence of commands - which I do not want to try, as this is a production server.
>Fix:
Patch attached with submission follows:
[0]# cd /var/crash
[0]# kgdb /boot/kernel/kernel vmcore.2
GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "amd64-marcel-freebsd"...
Unread portion of the kernel message buffer:
Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address = 0x308
fault code = supervisor read data, page not present
instruction pointer = 0x20:0xffffffff8024c0be
stack pointer = 0x28:0xffffff8476358aa0
frame pointer = 0x28:0xffffff8476358ac0
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags = interrupt enabled, resume, IOPL = 0
current process = 23976 (isc_out 0)
trap number = 12
panic: page fault
cpuid = 0
Uptime: 8h3m47s
Physical memory: 16115 MB
Dumping 12162 MB: 12147 12131 12115 12099 12083 12067 12051 12035 12019 12003 11987 11971 11955 11939 11923 11907 11891 11875 11859 11843 11827 11811 11795 11779 11763 11747 11731 11715 11699 11683 11667 11651 11635 11619 11603 11587 11571 11555 11539 11523 11507 11491 11475 11459 11443 11427 11411 11395 11379 11363 11347 11331 11315 11299 11283 11267 11251 11235 11219 11203 11187 11171 11155 11139 11123 11107 11091 11075 11059 11043 11027 11011 10995 10979 10963 10947 10931 10915 10899 10883 10867 10851 10835 10819 10803 10787 10771 10755 10739 10723 10707 10691 10675 10659 10643 10627 10611 10595 10579 10563 10547 10531 10515 10499 10483 10467 10451 10435 10419 10403 10387 10371 10355 10339 10323 10307 10291 10275 10259 10243 10227 10211 10195 10179 10163 10147 10131 10115 10099 10083 10067 10051 10035 10019 10003 9987 9971 9955 9939 9923 9907 9891 9875 9859 9843 9827 9811 9795 9779 9763 9747 9731 9715 9699 9683 9667 9651 9635 9619 9603 9587 9571 9555 9539 9523 9507 9491 94
75 9459 9443 9427 9411 9395 9379 9363 9347 9331 9315 9299 9283 9267 9251 9235 9219 9203 9187 9171 9155 9139 9123 9107 9091 9075 9059 9043 9027 9011 8995 8979 8963 8947 8931 8915 8899 8883 8867 8851 8835 8819 8803 8787 8771 8755 8739 8723 8707 8691 8675 8659 8643 8627 8611 8595 8579 8563 8547 8531 8515 8499 8483 8467 8451 8435 8419 8403 8387 8371 8355 8339 8323 8307 8291 8275 8259 8243 8227 8211 8195 8179 8163 8147 8131 8115 8099 8083 8067 8051 8035 8019 8003 7987 7971 7955 7939 7923 7907 7891 7875 7859 7843 7827 7811 7795 7779 7763 7747 7731 7715 7699 7683 7667 7651 7635 7619 7603 7587 7571 7555 7539 7523 7507 7491 7475 7459 7443 7427 7411 7395 7379 7363 7347 7331 7315 7299 7283 7267 7251 7235 7219 7203 7187 7171 7155 7139 7123 7107 7091 7075 7059 7043 7027 7011 6995 6979 6963 6947 6931 6915 6899 6883 6867 6851 6835 6819 6803 6787 6771 6755 6739 6723 6707 6691 6675 6659 6643 6627 6611 6595 6579 6563 6547 6531 6515 6499 6483 6467 6451 6435 6419 6403 6387 6371 6355 6339 6323 6
307 6291 6275 6259 6243 6227 6211 6195 6179 6163 6147 6131 6!
115 6099 6083 6067 6051 6035 6019 6003 5987 5971 5955 5939 5923 5907 5891 5875 5859 5843 5827 5811 5795 5779 5763 5747 5731 5715 5699 5683 5667 5651 5635 5619 5603 5587 5571 5555 5539 5523 5507 5491 5475 5459 5443 5427 5411 5395 5379 5363 5347 5331 5315 5299 5283 5267 5251 5235 5219 5203 5187 5171 5155 5139 5123 5107 5091 5075 5059 5043 5027 5011 4995 4979 4963 4947 4931 4915 4899 4883 4867 4851 4835 4819 4803 4787 4771 4755 4739 4723 4707 4691 4675 4659 4643 4627 4611 4595 4579 4563 4547 4531 4515 4499 4483 4467 4451 4435 4419 4403 4387 4371 4355 4339 4323 4307 4291 4275 4259 4243 4227 4211 4195 4179 4163 4147 4131 4115 4099 4083 4067 4051 4035 4019 4003 3987 3971 3955 3939 3923 3907 3891 3875 3859 3843 3827 3811 3795 3779 3763 3747 3731 3715 3699 3683 3667 3651 3635 3619 3603 3587 3571 3555 3539 3523 3507 3491 3475 3459 3443 3427 3411 3395 3379 3363 3347 3331 3315 3299 3283 3267 3251 3235 3219 3203 3187 3171 3155 3139 3123 3107 3091 3075 3059 3043 3027 3011 2995 2979 2963
2947 2931 2915 2899 2883 2867 2851 2835 2819 2803 2787 2771 2755 2739 2723 2707 2691 2675 2659 2643 2627 2611 2595 2579 2563 2547 2531 2515 2499 2483 2467 2451 2435 2419 2403 2387 2371 2355 2339 2323 2307 2291 2275 2259 2243 2227 2211 2195 2179 2163 2147 2131 2115 2099 2083 2067 2051 2035 2019 2003 1987 1971 1955 1939 1923 1907 1891 1875 1859 1843 1827 1811 1795 1779 1763 1747 1731 1715 1699 1683 1667 1651 1635 1619 1603 1587 1571 1555 1539 1523 1507 1491 1475 1459 1443 1427 1411 1395 1379 1363 1347 1331 1315 1299 1283 1267 1251 1235 1219 1203 1187 1171 1155 1139 1123 1107 1091 1075 1059 1043 1027 1011 995 979 963 947 931 915 899 883 867 851 835 819 803 787 771 755 739 723 707 691 675 659 643 627 611 595 579 563 547 531 515 499 483 467 451 435 419 403 387 371 355 339 323 307 291 275 259 243 227 211 195 179 163 147 131 115 99 83 67 51 35 19 3
Reading symbols from /boot/kernel/zfs.ko...Reading symbols from /boot/kernel/zfs.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/zfs.ko
Reading symbols from /boot/kernel/opensolaris.ko...Reading symbols from /boot/kernel/opensolaris.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/opensolaris.ko
Reading symbols from /boot/kernel/geom_label.ko...Reading symbols from /boot/kernel/geom_label.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/geom_label.ko
Reading symbols from /boot/kernel/firewire.ko...Reading symbols from /boot/kernel/firewire.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/firewire.ko
Reading symbols from /boot/kernel/if_re.ko...Reading symbols from /boot/kernel/if_re.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/if_re.ko
Reading symbols from /boot/kernel/miibus.ko...Reading symbols from /boot/kernel/miibus.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/miibus.ko
Reading symbols from /boot/kernel/snd_hda.ko...Reading symbols from /boot/kernel/snd_hda.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/snd_hda.ko
Reading symbols from /boot/kernel/sound.ko...Reading symbols from /boot/kernel/sound.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/sound.ko
Reading symbols from /boot/kernel/usb.ko...Reading symbols from /boot/kernel/usb.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/usb.ko
Reading symbols from /boot/kernel/uhid.ko...Reading symbols from /boot/kernel/uhid.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/uhid.ko
Reading symbols from /boot/kernel/ums.ko...Reading symbols from /boot/kernel/ums.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/ums.ko
Reading symbols from /boot/kernel/umass.ko...Reading symbols from /boot/kernel/umass.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/umass.ko
Reading symbols from /boot/kernel/aio.ko...Reading symbols from /boot/kernel/aio.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/aio.ko
Reading symbols from /boot/kernel/agp.ko...Reading symbols from /boot/kernel/agp.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/agp.ko
Reading symbols from /boot/kernel/accf_data.ko...Reading symbols from /boot/kernel/accf_data.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/accf_data.ko
Reading symbols from /boot/kernel/accf_http.ko...Reading symbols from /boot/kernel/accf_http.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/accf_http.ko
Reading symbols from /boot/kernel/random.ko...Reading symbols from /boot/kernel/random.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/random.ko
Reading symbols from /boot/kernel/speaker.ko...Reading symbols from /boot/kernel/speaker.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/speaker.ko
Reading symbols from /boot/kernel/amdtemp.ko...Reading symbols from /boot/kernel/amdtemp.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/amdtemp.ko
Reading symbols from /boot/kernel/ehci.ko...Reading symbols from /boot/kernel/ehci.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/ehci.ko
Reading symbols from /boot/kernel/geom_part_gpt.ko...Reading symbols from /boot/kernel/geom_part_gpt.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/geom_part_gpt.ko
Reading symbols from /boot/kernel/intpm.ko...Reading symbols from /boot/kernel/intpm.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/intpm.ko
Reading symbols from /boot/kernel/smbus.ko...Reading symbols from /boot/kernel/smbus.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/smbus.ko
Reading symbols from /boot/kernel/ohci.ko...Reading symbols from /boot/kernel/ohci.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/ohci.ko
Reading symbols from /boot/kernel/smb.ko...Reading symbols from /boot/kernel/smb.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/smb.ko
Reading symbols from /boot/modules/vboxdrv.ko...done.
Loaded symbols for /boot/modules/vboxdrv.ko
Reading symbols from /boot/kernel/geom_md.ko...Reading symbols from /boot/kernel/geom_md.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/geom_md.ko
Reading symbols from /boot/kernel/procfs.ko...Reading symbols from /boot/kernel/procfs.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/procfs.ko
Reading symbols from /boot/kernel/pseudofs.ko...Reading symbols from /boot/kernel/pseudofs.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/pseudofs.ko
Reading symbols from /boot/kernel/fdescfs.ko...Reading symbols from /boot/kernel/fdescfs.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/fdescfs.ko
Reading symbols from /boot/modules/vboxnetflt.ko...done.
Loaded symbols for /boot/modules/vboxnetflt.ko
Reading symbols from /boot/kernel/netgraph.ko...Reading symbols from /boot/kernel/netgraph.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/netgraph.ko
Reading symbols from /boot/kernel/ng_ether.ko...Reading symbols from /boot/kernel/ng_ether.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/ng_ether.ko
Reading symbols from /boot/modules/vboxnetadp.ko...done.
Loaded symbols for /boot/modules/vboxnetadp.ko
Reading symbols from /boot/kernel/green_saver.ko...Reading symbols from /boot/kernel/green_saver.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/green_saver.ko
Reading symbols from /boot/kernel/radeon.ko...Reading symbols from /boot/kernel/radeon.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/radeon.ko
Reading symbols from /boot/kernel/drm.ko...Reading symbols from /boot/kernel/drm.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/drm.ko
Reading symbols from /boot/kernel/iscsi_initiator.ko...Reading symbols from /boot/kernel/iscsi_initiator.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/iscsi_initiator.ko
#0 doadump () at pcpu.h:224
224 pcpu.h: No such file or directory.
in pcpu.h
(kgdb) where
#0 doadump () at pcpu.h:224
#1 0xffffffff8025b9fe in boot (howto=260) at /z/SRC/FreeBSD/RELENG_8_2_0_RELEASE/src/sys/kern/kern_shutdown.c:419
#2 0xffffffff8025be13 in panic (fmt=0x0) at /z/SRC/FreeBSD/RELENG_8_2_0_RELEASE/src/sys/kern/kern_shutdown.c:592
#3 0xffffffff8044a42d in trap_fatal (frame=0xffffff02577448c0, eva=Variable "eva" is not available.
)
at /z/SRC/FreeBSD/RELENG_8_2_0_RELEASE/src/sys/amd64/amd64/trap.c:783
#4 0xffffffff8044a7ef in trap_pfault (frame=0xffffff84763589f0, usermode=0)
at /z/SRC/FreeBSD/RELENG_8_2_0_RELEASE/src/sys/amd64/amd64/trap.c:699
#5 0xffffffff8044abef in trap (frame=0xffffff84763589f0)
at /z/SRC/FreeBSD/RELENG_8_2_0_RELEASE/src/sys/amd64/amd64/trap.c:449
#6 0xffffffff80432f54 in calltrap () at /z/SRC/FreeBSD/RELENG_8_2_0_RELEASE/src/sys/amd64/amd64/exception.S:224
#7 0xffffffff8024c0be in _mtx_lock_sleep (m=0xffffff0007aeed30, tid=18446742982146670592, opts=Variable "opts" is not available.
)
at /z/SRC/FreeBSD/RELENG_8_2_0_RELEASE/src/sys/kern/kern_mutex.c:369
#8 0xffffffff80264641 in _sleep (ident=Variable "ident" is not available.
) at /z/SRC/FreeBSD/RELENG_8_2_0_RELEASE/src/sys/kern/kern_synch.c:243
#9 0xffffffff80cbae28 in ism_out (vp=Variable "vp" is not available.
)
at /z/SRC/FreeBSD/RELENG_8_2_0_RELEASE/src/sys/modules/iscsi/initiator/../../../dev/iscsi/initiator/isc_sm.c:554
#10 0xffffffff80232328 in fork_exit (callout=0xffffffff80cba680 <ism_out>, arg=0xffffff0007aeec00,
frame=0xffffff8476358c40) at /z/SRC/FreeBSD/RELENG_8_2_0_RELEASE/src/sys/kern/kern_fork.c:845
#11 0xffffffff8043341e in fork_trampoline ()
at /z/SRC/FreeBSD/RELENG_8_2_0_RELEASE/src/sys/amd64/amd64/exception.S:565
#12 0x0000000000000000 in ?? ()
#13 0x0000000000000000 in ?? ()
#14 0x0000000000000001 in ?? ()
#15 0x0000000000000000 in ?? ()
#16 0x0000000000000000 in ?? ()
#17 0x0000000000000000 in ?? ()
#18 0x0000000000000000 in ?? ()
#19 0x0000000000000000 in ?? ()
#20 0x0000000000000000 in ?? ()
#21 0x0000000000000000 in ?? ()
#22 0x0000000000000000 in ?? ()
#23 0x0000000000000000 in ?? ()
#24 0x0000000000000000 in ?? ()
#25 0x0000000000000000 in ?? ()
#26 0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---
#27 0x0000000000000000 in ?? ()
#28 0x0000000000000000 in ?? ()
#29 0x0000000000000000 in ?? ()
#30 0x0000000000000000 in ?? ()
#31 0x0000000000000000 in ?? ()
#32 0x0000000000000000 in ?? ()
#33 0x0000000000000000 in ?? ()
#34 0x0000000000000000 in ?? ()
#35 0x0000000000000000 in ?? ()
#36 0xffffffff80675640 in affinity ()
#37 0x0000000000000000 in ?? ()
#38 0x0000000000000000 in ?? ()
#39 0xffffff01d9c84000 in ?? ()
#40 0xffffff84763580e0 in ?? ()
#41 0xffffff8476358088 in ?? ()
#42 0xffffff000678c8c0 in ?? ()
#43 0xffffffff802810e9 in sched_switch (td=0xffffffff80cba680, newtd=0xffffff0007aeec00, flags=Variable "flags" is not available.
)
at /z/SRC/FreeBSD/RELENG_8_2_0_RELEASE/src/sys/kern/sched_ule.c:1852
Previous frame inner to this frame (corrupt stack?)
(kgdb)
>Release-Note:
>Audit-Trail:
>Unformatted:
More information about the freebsd-bugs
mailing list