bin/72539: Panic: vm_page_remove(): page not found in hash

Matthew Seaman m.seaman at infracaninophile.co.uk
Mon Oct 11 11:00:44 PDT 2004


>Number:         72539
>Category:       bin
>Synopsis:       Panic: vm_page_remove(): page not found in hash
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    freebsd-bugs
>State:          open
>Quarter:        
>Keywords:       
>Date-Required:
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Mon Oct 11 18:00:43 GMT 2004
>Closed-Date:
>Last-Modified:
>Originator:     Matthew Seaman
>Release:        FreeBSD 4.10-STABLE i386
>Organization:
Infracaninophile
>Environment:
System: FreeBSD happy-idiot-talk.infracaninophile.co.uk 4.10-STABLE FreeBSD 4.10-STABLE #85: Fri Oct 8 11:06:56 BST 2004 root at happy-idiot-talk.infracaninophile.co.uk:/usr/obj/usr/src/sys/HAPPY-IDIOT-TALK i386

% pkg_info -I 'perl-*'
perl-5.8.5          Practical Extraction and Report Language

>Description:

I seem to have inadvertently  managed to write a perl script from hell.

The attached script, when run by an unprivileged user will take my
system down within a few minutes.  It seems to be some sort of VM
corruption.

Symptoms are that after processing a few hundred ports, the spawned
make(1) (or sh(1) or uname(1) or possibly others) start to die by
SEGV.  The perl process bombs out, and then after a short hiatus the
system panics and reboots -- the message 'vm_page_remove()' is
typical, but I've also seen some other ones.

If you leap in between the perl script dying and the system crashing,
attempting to run one of the programs that crashed, you get a nasty
message from /usr/libexec/ld-elf.so.1

>How-To-Repeat:

On a system with perl-5.8.5 installed and with a full ports tree:

   Unpack the attached portindex.uu, untar etc.
   % cd portindex
   % ./portindex >/tmp/INDEX

and wait...

I haven't tried this on any other system version or with 

>Fix:

	

--- kernel.debug begins here ---
Script started on Sat Oct  9 09:39:30 2004
Password:
GNU gdb 4.18 (FreeBSD)
Copyright 1998 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "i386-unknown-freebsd"...Deprecated bfd_read called at /usr/src/gnu/usr.bin/binutils/gdb/../../../../contrib/gdb/gdb/dbxread.c line 2627 in elfstab_build_psymtabs
Deprecated bfd_read called at /usr/src/gnu/usr.bin/binutils/gdb/../../../../contrib/gdb/gdb/dbxread.c line 933 in fill_symbuf

IdlePTD at physical address 0x00970000
initial pcb at physical address 0x0039f540
panicstr: vm_page_remove(): page not found in hash
panic messages:
---
panic: vm_page_remove(): page not found in hash

syncing disks... 26 15 2 2 2 2 2 2 2 6 
done
Uptime: 5h18m3s

dumping to dev #da/0x20001, offset 1048736
dump 511 510 509 508 507 506 505 504 503 502 501 500 499 498 497 496 495 494 493 492 491 490 489 488 487 486 485 484 483 482 481 480 479 478 477 476 475 474 473 472 471 470 469 468 467 466 465 464 463 462 461 460 459 458 457 456 455 454 453 452 451 450 449 448 447 446 445 444 443 442 441 440 439 438 437 436 435 434 433 432 431 430 429 428 427 426 425 424 423 422 421 420 419 418 417 416 415 414 413 412 411 410 409 408 407 406 405 404 403 402 401 400 399 398 397 396 395 394 393 392 391 390 389 388 387 386 385 384 383 382 381 380 379 378 377 376 375 374 373 372 371 370 369 368 367 366 365 364 363 362 361 360 359 358 357 356 355 354 353 352 351 350 349 348 347 346 345 344 343 342 341 340 339 338 337 336 335 334 333 332 331 330 329 328 327 326 325 324 323 322 321 320 319 318 317 316 315 314 313 312 311 310 309 308 307 306 305 304 303 302 301 300 299 298 297 296 295 294 293 292 291 290 289 288 287 286 285 284 283 282 281 280 279 278 277 276 275 274 273 272 271 270 269 268 267 266 !
 265 264 263 262 261 260 259 258 257 256 255 254 253 252 251 250 249 248 247 246 245 244 243 242 241 240 239 238 237 236 235 234 233 232 231 230 229 228 227 226 225 224 223 222 221 220 219 218 217 216 215 214 213 212 211 210 209 208 207 206 205 204 203 202 201 200 199 198 197 196 195 194 193 192 191 190 189 188 187 186 185 184 183 182 181 180 179 178 177 176 175 174 173 172 171 170 169 168 167 166 165 164 163 162 161 160 159 158 157 156 155 154 153 152 151 150 149 148 147 146 145 144 143 142 141 140 139 138 137 136 135 134 133 132 131 130 129 128 127 126 125 124 123 122 121 120 119 118 117 116 115 114 113 112 111 110 109 108 107 106 105 104 103 102 101 100 99 98 97 96 95 94 93 92 91 90 89 88 87 86 85 84 83 82 81 80 79 78 77 76 75 74 73 72 71 70 69 68 67 66 65 64 63 62 61 60 59 58 57 56 55 54 53 52 51 50 49 48 47 46 45 44 43 42 41 40 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0 de0
---
#0  dumpsys () at /usr/src/sys/kern/kern_shutdown.c:487
487		if (dumping++) {
(kgdb) bt\full
#0  dumpsys () at /usr/src/sys/kern/kern_shutdown.c:487
	error = 0
#1  0xc017fc3b in boot (howto=256) at /usr/src/sys/kern/kern_shutdown.c:316
	howto = 256
#2  0xc0180079 in panic (
    fmt=0xc032da80 "vm_page_remove(): page not found in hash")
    at /usr/src/sys/kern/kern_shutdown.c:595
	fmt = 0xc032da80 "vm_page_remove(): page not found in hash"
	bootopt = 256
	buf = "vm_page_remove(): page not found in hash", '\000' <repeats 215 times>
#3  0xc027110b in vm_page_remove (m=0xc0fe0248)
    at /usr/src/sys/vm/vm_page.c:461
	bucket = (struct vm_page **) 0x0
	m = 0xc0fe0248
	object = 0x0
#4  0xc02711dc in vm_page_rename (m=0xc0fe0248, new_object=0xd8943c38, 
    new_pindex=2764) at /usr/src/sys/vm/vm_page.c:557
	m = 0xc0fe0248
	new_object = 0xd8943c38
	new_pindex = 2764
	s = 7260160
#5  0xc02701a7 in vm_object_collapse (object=0xd8943c38)
    at /usr/src/sys/vm/vm_object.c:1290
	pp = 0x0
	new_pindex = 2764
	next = 0xc0f93c04
	backing_offset_index = 0
	backing_object = 0xd8979e60
	p = 0xc0fe0248
	s = 0
	object = 0xd8943c38
	backing_object = 0xd8979e60
	object = 0xd8943c38
#6  0xc026f3ec in vm_object_deallocate (object=0xd8973284)
    at /usr/src/sys/vm/vm_object.c:368
	robject = 0xd8943c38
	object = 0xd8943c38
	temp = 0xd8943c38
#7  0xc026c70c in vm_map_entry_delete (map=0xd755ff00, entry=0xd88c0060)
    at /usr/src/sys/vm/vm_map.c:2064
	map = 0xd755ff00
	entry = 0xd88c0060
#8  0xc026c8c9 in vm_map_delete (map=0xd755ff00, start=0, end=3217031168)
    at /usr/src/sys/vm/vm_map.c:2184
	next = 0xd88c0540
	s = 145367040
	e = 157437952
	offidxstart = 0
	offidxend = 2947
	count = 2947
	start = 3633787524
	object = 0xd8973284
	entry = 0xd88c0060
	first_entry = 0xd755ff00
#9  0xc026c956 in vm_map_remove (map=0xd755ff00, start=0, end=3217031168)
    at /usr/src/sys/vm/vm_map.c:2209
	map = 0xd755ff00
	start = 0
	end = 3217031168
	result = -1077936128
	s = 0
#10 0xc0178024 in exit1 (p=0xd74d21a0, rv=11)
    at /usr/src/sys/kern/kern_exit.c:226
	rv = 11
	q = (struct proc *) 0xd755ff00
	nq = (struct proc *) 0xd74d21a0
	vm = (struct vmspace *) 0xd755ff00
	vtmp = (struct vnode *) 0x0
	ep = (struct exitlist *) 0xd755ff00
#11 0xc0181b72 in sigexit (p=0xd74d21a0, sig=11)
    at /usr/src/sys/kern/kern_sig.c:1504
	p = (struct proc *) 0xd74d21a0
	sig = 11
#12 0xc01818ec in postsig (sig=11) at /usr/src/sys/kern/kern_sig.c:1407
	p = (struct proc *) 0xd74d21a0
	ps = (struct sigacts *) 0xd8773260
	action = 0
	returnmask = {__bits = {1024, 0, 0, 0}}
---Type <return> to continue, or q <return> to quit---
	code = 0
#13 0xc02edb6f in trap (frame={tf_fs = 47, tf_es = 47, tf_ds = 47, 
      tf_edi = 672567808, tf_esi = 156690956, tf_ebp = -1077937184, 
      tf_isp = -663265324, tf_ebx = 672558668, tf_edx = 672567624, 
      tf_ecx = 156643624, tf_eax = 0, tf_trapno = 12, tf_err = 44, 
      tf_eip = 672053274, tf_cs = 31, tf_eflags = 66050, tf_esp = -1077937256, 
      tf_ss = 47}) at /usr/src/sys/i386/i386/trap.c:174
	s = -663265392
	sig = 0
	p = (struct proc *) 0xd74d21a0
	frame = (struct trapframe *) 0xd8775fa8
	oticks = 10
	p = (struct proc *) 0xd74d21a0
	sticks = 10
	i = -682810684
	ucode = 12
	type = -663265392
	code = 0
	eva = 44
#14 0x280eb81a in ?? ()
No symbol table info available.
Cannot access memory at address 0xbfbffbe0.
(kgdb) quit

Script done on Sat Oct  9 09:41:02 2004
--- kernel.debug ends here ---

--- dmesg.boot begins here ---
pid 26764 (sh), uid 1001: exited on signal 11
pid 26765 (sh), uid 1001: exited on signal 11
pid 26766 (sh), uid 1001: exited on signal 11
pid 26767 (sh), uid 1001: exited on signal 11
pid 26768 (sh), uid 1001: exited on signal 11
pid 26769 (sh), uid 1001: exited on signal 11
pid 26770 (sh), uid 1001: exited on signal 11
pid 26771 (sh), uid 1001: exited on signal 11
pid 26772 (sh), uid 1001: exited on signal 11
pid 28619 (sh), uid 1001: exited on signal 11
pid 28789 (sh), uid 1001: exited on signal 11
pid 28790 (sh), uid 1001: exited on signal 11
pid 28791 (sh), uid 1001: exited on signal 11
pid 28792 (sh), uid 1001: exited on signal 11
pid 28793 (sh), uid 1001: exited on signal 11
pid 28794 (sh), uid 1001: exited on signal 11
pid 28795 (sh), uid 1001: exited on signal 11
pid 28796 (sh), uid 1001: exited on signal 11
pid 28797 (sh), uid 1001: exited on signal 11
pid 28800 (perl), uid 26: exited on signal 11
panic: vm_page_remove(): page not found in hash

syncing disks... 26 15 2 2 2 2 2 2 2 6 
Copyright (c) 1992-2004 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD 4.10-STABLE #85: Fri Oct  8 11:06:56 BST 2004
    root at happy-idiot-talk.infracaninophile.co.uk:/usr/obj/usr/src/sys/HAPPY-IDIOT-TALK
Timecounter "i8254"  frequency 1193182 Hz
Timecounter "TSC"  frequency 1400058528 Hz
CPU: AMD Athlon(TM) XP1600+ (1400.06-MHz 686-class CPU)
  Origin = "AuthenticAMD"  Id = 0x662  Stepping = 2
  Features=0x383f9ff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
  AMD Features=0xc0480000<MP,AMIE,DSP,3DNow!>
real memory  = 536788992 (524208K bytes)
avail memory = 512655360 (500640K bytes)
Preloaded elf kernel "kernel" at 0xc0951000.
Preloaded elf module "linux.ko" at 0xc095109c.
Preloaded elf module "nvidia.ko" at 0xc095113c.
Pentium Pro MTRR support enabled
md0: Malloc disk
Using $PIR table, 9 entries at 0xc00f1e60
acpi0: <ASUS   A7V266  > on motherboard
acpi0: power button is handled as a fixed feature programming model.
Timecounter "ACPI-fast"  frequency 3579545 Hz
acpi_timer0: <24-bit timer at 3.579545MHz> port 0xe408-0xe40b on acpi0
acpi_cpu0: <CPU> on acpi0
acpi_button0: <Power Button> on acpi0
npx0: <math processor> on motherboard
npx0: INT 16 interface
pcib0: <Host to PCI bridge> on motherboard
pci0: <PCI bus> on pcib0
pcib1: <PCI to PCI bridge (vendor=1106 device=b099)> at device 1.0 on pci0
pci1: <PCI bus> on pcib1
nvidia0: <GeForce FX 5200> mem 0xf0000000-0xf7ffffff,0xee000000-0xeeffffff irq 11 at device 0.0 on pci1
pcm0: <CMedia CMI8738> port 0xd800-0xd8ff irq 10 at device 5.0 on pci0
de0: <Digital 21140A Fast Ethernet> port 0xd400-0xd47f mem 0xed800000-0xed80007f irq 11 at device 13.0 on pci0
de0: 21140A [10-100Mb/s] pass 2.2
de0: address 00:40:05:a5:8d:b7
sym0: <1010-33> port 0xd000-0xd0ff mem 0xec800000-0xec801fff,0xed000000-0xed0003ff irq 15 at device 15.0 on pci0
sym0: Symbios NVRAM, ID 7, Fast-80, LVD, parity checking
sym0: open drain IRQ line driver, using on-chip SRAM
sym0: using LOAD/STORE-based firmware.
sym0: handling phase mismatch from SCRIPTS.
sym1: <1010-33> port 0xb800-0xb8ff mem 0xeb800000-0xeb801fff,0xec000000-0xec0003ff irq 15 at device 15.1 on pci0
sym1: Symbios NVRAM, ID 7, Fast-80, SE, parity checking
sym1: open drain IRQ line driver, using on-chip SRAM
sym1: using LOAD/STORE-based firmware.
sym1: handling phase mismatch from SCRIPTS.
viapropm0: SMBus I/O base at 0xe800
viapropm0: <VIA VT8233 Power Management Unit> port 0xe800-0xe80f at device 17.0 on pci0
viapropm0: could not allocate bus space
device_probe_and_attach: viapropm0 attach returned 6
pci0: <VIA 85C586 ATA controller> at 17.1
uhci0: <VIA 83C572 USB controller> port 0xb000-0xb01f irq 14 at device 17.2 on pci0
usb0: <VIA 83C572 USB controller> on uhci0
usb0: USB revision 1.0
uhub0: VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhci1: <VIA 83C572 USB controller> port 0xa800-0xa81f irq 14 at device 17.3 on pci0
usb1: <VIA 83C572 USB controller> on uhci1
usb1: USB revision 1.0
uhub1: VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
uhci2: <VIA 83C572 USB controller> port 0xa400-0xa41f irq 14 at device 17.4 on pci0
usb2: <VIA 83C572 USB controller> on uhci2
usb2: USB revision 1.0
uhub2: VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub2: 2 ports with 2 removable, self powered
isa0: <ISA bus> on motherboard
orm0: <Option ROMs> at iomem 0xc0000-0xcf7ff,0xd0000-0xd3fff on isa0
pmtimer0 on isa0
fdc0: cannot reserve I/O port range
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> flags 0x1 irq 1 on atkbdc0
kbd0 at atkbd0
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: model Generic PS/2 mouse, device ID 0
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
sio0: type 16550A
sio1 at port 0x2f8-0x2ff irq 3 on isa0
sio1: type 16550A
ppc0: <Parallel port> at port 0x378-0x37f irq 7 on isa0
ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode
ppbus0: IEEE1284 device found /NIBBLE/ECP
Probing for PnP devices on ppbus0:
ppbus0: <Hewlett-Packard hp LaserJet 1300> PRINTER PJL,MLC,BIDI-ECP,PCL,POSTSCRIPT,PCLXL
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
pca0 at port 0x40 on isa0
acpi_cpu: throttling enabled, 16 steps (100% to 6.2%), currently 100.0%
ipfw2 initialized, divert disabled, rule-based forwarding enabled, default to deny, logging limited to 1024 packets/entry by default
IPv6 packet filtering initialized, logging limited to 1024 packets/entry
DUMMYNET initialized (011031)
Waiting 15 seconds for SCSI devices to settle
(noperiph:sym0:0:-1:-1): SCSI BUS reset delivered.
(noperiph:sym1:0:-1:-1): SCSI BUS reset delivered.
de0: enabling Full Duplex 100baseTX port
Mounting root from ufs:/dev/da0s1a
da0 at sym0 bus 0 target 0 lun 0
da0: <IBM DDYS-T36950N S96H> Fixed Direct Access SCSI-3 device 
da0: 160.000MB/s transfers (80.000MHz, offset 62, 16bit), Tagged Queueing Enabled
da0: 35003MB (71687340 512 byte sectors: 255H 63S/T 4462C)
cd0 at sym1 bus 0 target 6 lun 0
cd0: <PIONEER DVD-ROM DVD-305 1.00> Removable CD-ROM SCSI-2 device 
cd0: 20.000MB/s transfers (20.000MHz, offset 16)
cd0: Attempt to query device size failed: NOT READY, Medium not present
WARNING: / was not properly dismounted
--- dmesg.boot ends here ---

--- portindex.uu begins here ---
begin-base64 644 portindex.tar.bz2
QlpoOTFBWSZTWVuVIUoAIhZ/xP/1YgJ////f/+//7////+8BAAABAAhgG98+33R73u8ZvaT69960
5w9PtgYAb63pHe2fdc3154oJCpKqX2x99zkRelXwsF20U0qWvru2sWimpaO5na++71S8rWvvhiRG
mkyGmmqn4JNkm01T9BTaNqn6BTajRpkaGajZT0hkAAyAZBAJpMiZGmgFD1PUHqAaNNGhoAAAAAAa
AGmmppNCZFPU9Qepk9IAAPUNNAaAAAAAAAABJqQgmgjUaFPaJPKYyjEA0xqZGj1AA0eoMg2oBoaD
QRKCEaAjUxNoU2lNN6o9IZk1NNpGTQ0DE00GQBpo00yaARJCJo0mU9Tahqp+ZEemhU/NJioBo9TI
D1NDyg00Aeo00HqAz/gfzfadv3Q7n2vg/zGGYDooSAqXx39/f39Yr80Dkd4wMjQffIYcaHkbOsZI
EiwFGRBYgEQ1EVixFWMRdh0yQCNDtn1+vyeJDyo/Bxn2LqRH8ohyJA5EyAMSgUPUzB5vLYbV7br8
yjDIYaS6UWRXp1dyf8fPf+WM8ZwT9o+9XLWgy1pGjikFJEqDCDSMAUBaVktSM8jUWzRTVVFZmhZW
CM0tu5eMsew7fz+vYvy3zebHASqOMKb8aKawQwJ20L3xQ9KaW56GRY1pVEdNd3PTcfG7bj4mMhqD
BAteGwOm8AEQiIjMLOu7Pi7R6h3DE0AbYwasOweUeceL80sYYtKPwspH4h955X3GzSXSDHylnGQs
x8bB5U5Obrz4XTsKuTO2h5ZfqnZHlv7QoHpbDXEH5Z6AFp169ktZtUod7m379GNIiMQ3qF5SJoCe
8YKCvQMFVUyLkISQB3DwaQBP+u4oDibPPZDKCPMgpsGQYhGIFHcV2i+8D1ln0nWUg+wiLhTXUTaw
o/uLtQNYwICCMViVkGMUUgYAEUbFmHfGMbFsNSmAC3CbyFHS9rpjtgIHSqnUneOfpGcnpF7wFjnE
ySYrj/e/Y9GuQg7FGpRQYgXq7pqeKlg4mnfuoN6hRHELNKwCBR0oZSC9dIhr91m36hRZ5qXRUArS
DqJhWHki4ERkg7MlMiX0WrSyKyFOOgCbEFcQhuglxz33fKQRhs18yquTjMYbq4+LyitJpHKVVbdp
joKIgppHLAAq1KvZAFDio/FXB8kP3fy1sMMkH6jpM5fjZOGvu358VA1gULCjyhFASxfQJbGXK0dX
baiuDLQHwx5a7BSBL4YfG7jOUHMj7D5wWMLp+seJGY4dCrCNkRi40YcE1lH5lVPkZRpEQJU0SJQ5
wU3aSDu4gOLJ4gxkDNMcwLDGEBaFj+KjbNZFrHsnMt8uTt887+26NnvY2eofY8WDl5H6GnmyTbwt
tegdzlzhcdTRs93QYFkk/k/1dD9HI72r7TGrid4revjYbo6h8T5vXrgYHLrOdtwc9CqInhOOwsd8
/cUNzmDPah8/0zrzweRzY7yyeN7G7Rq/fZn3dNMWvbUdv53leDmPW8GMaet3vBj4ni8nNw004Tfe
dvs/Wmjq89iaHTpqezw8xru3MHS5Me62mBYi0WMs72w2damzJ5MzTPl19DoeuPa8r3ObgNW7R52j
vYnJAqWrKAtSgzGJfeW12mYPC2d3wcI5wVvicy4Nge2HBYW2JGW4z3tckBzp2hLQtOd8RGdX4mRM
GBpPOi+3SqTkcTQ48dRcXloh5HHN7aFqUKJe9wwEJic2AwOgFaJ3i2OzMisRdKZaU9DcBXcteCNW
1Z4DahhBFHMqk9Yiw0bzVfGReimz9Ly5CBEUr0Qqkq2QZbeqw17kIXbZQRVRpwL0fHw+uHNzFYhT
mrUVFadHgsLbcA06yqohsl+lgNsU0wLJ0Fk9cRENeUILJVtW4QyDKqVYkxs7IEgghubgQC3OskSk
wvLYZJEaRwxkN5Dq53bgkuKJQGYm68UBB7Yttlr3z7pSZS29dTwCXByGZmJBCp/07F9e6cBOh7Zl
svTROlOetXpK3Wve5Ld6gsAYQdKHWSSfGXkcZtKtnr8bYbbk4qwg42vdiZ0wbCtrQWE7BCM9GNHd
C+ec6iB1aPC4cZabTIvNRqZFSR0z5c65ySfQLLlvNU2MAp1ajgyY74u+c8UxABFueAWOzjaTHMr+
8dbErW2mHRFsLb9MzPWmqOOuwy2ub0VHpKsBMwL2VhCky5rSSRBUCl6BavMtNwrDY02DhKzZHsKW
SEbSdLwuoNdycAit07GTzEIjC0RxSeF6y1UoyPWjFAyLmzvr3ljKK2cTAYa48ySieeeDGh1VO7xO
z1Vkuxl02xLVymW0z5umaoIw2TrQlkDwsUX0tpy+/DfeHO+en2/ZyyE+8w/Wgci9OBXyqWnwJDOA
T333Rk/aJuMVJ8gljB71UfA30GUwLjEP3/DaWGTJAwqQpktnctAEYRTNKQF09aVO1tO4MKLgKpRu
9aiquHuoYWYPF5svPu9jIrMlDNGpYqgU3DJQwLn+qlasqyUMnvCaJ+cYkTo1NZYRlDCGvT57EM0z
SGaecS4GVTRkmGREChnJzbsLipIWKKkUI4S1poMpsIoQzB5UWLEc6tigVQPNtwJwLgcqO5FZ1QR4
+FpstxvDnLdAAK+PBDgXGwAdVnTAgD2D60pTpPvmyz9sQyMVWsxVioZGffYD8j9FZ4qDoEimtdgE
ZV80dMUiKHURh6Bt9ub9TA9RHSPY5gXv8DYZpc6eV+J2hIZcuSqKqPxn9MSYHuKCE2AcBxLSkgHI
ISW+Y5Lh6jJeNho2vTNuwASwIIKKZDId42J0HplKCWoCtuBppllpzuV9x8HO+Bv6r4Wf7TVx5uHX
0yIiM8R0b+6e4SeOt5i4/KoO3Z2UHuQ2hwtvOTBBCsIDEEPalHSbf1GUwHNMAgFliAJxceOAINV5
Js2WG4HgWT0dQMgN01DKUUaz6S7sLyi82xfqvWHvWS52gPla+0L3z6aIzKILAcY+kVBhveYfYr3q
/FpfMWGax6Yhu1lHMtMFuwu0PTBFBQPxGk9T+BSyhDqOw716iZhNjV0i+yUcJdk+OeFhwjgFsu6z
Gqg6mAp1XMfgk3RdNsOVN8Km32sWSDTnsOD3YzBPVptbcfo6zydbNLPV/LOM0p4owYPglPN67I1J
JVA0/qCFDYf7PX/bk9/0fdpcYn2u0ew/C0D1vqO7d8Y6fXzbODByaj+/OuUA9mFn42mxo1aoYnWa
juBwvsvo6cTaII0wF1FDBwUZcFDkCi3hEQ0Zmlx2Bg4jjAtpuXrdf7XzKuEQzg1CO4MdJ4cdQ5A+
4zoNt7Ke4Oi98slRtF+gETHoyIAIgYgT1hEgRkW5KbkXnoWqG778HVOlzTjgg/hWoOrScyM1C+kv
cm5iO1nF2R7epYRFkJVMsipp4ygWDhQAgLLiCikKQgLM4AurM73MUTSLYockiyaFHBxIsXUVC1Wo
ZV1KWsloIxdLoAiAWz427LeUD2PO0D4Tl89ov6pA+BP7hihaA2PjQQ99Db8spB/iIfzlz8R9p14D
cIcAO3slAe/zeayCZnu8JTSdnT6FkLyMU9t5o/Mh86H5Ebv3R+dD3GmJAMWjH2nyj6qBkDV0DQHJ
j74xg5tX6XJqJ9CYDgwT6QI+26mIcRbNn4T6lO6KYjF/IR8DZzeLyBPO4dUPc0hoaA2NHIckaPwP
o4A5OAxjBiuItUMB8qKdWamZfJSprQ/2lWzRjaorqYAa3oE6e02dVWgdQ8rQwdLZs6m733GlxhRI
5ZUcX8zeti/FwHS3epjR7w5OLgbW5R999x1OYqZNWGbwdjQVNbdq5mDdTNuJg4Os0sHa4mgdbT4R
M3mPnbqUB2EPm7KNUJxIEDqHadDKEJd2Ec5yDracmikKGfuwOsIJ4Ad/mdWAxHJ76Bg0ODh3mjzg
PBgODUEnShVq3ecehjZo2bjYsODVqjvE4PEHa3HAedIhOiBJar9QYvCIVNg4IUKvnLfEwNbiLg8R
jR3u93PEdw5O0HTU9B0j2zghvHsQI7GDZ5t3qE8THNCw+FobA5tOaE56j7vhLHxQllMXi8pdsNh8
4u0G3TFKJZIN2IUw2zVAu0DmDBaFTJo5sVpDNuBhuUxjQ2QsBQPESi3Y5j42zkA0ecd5iWY0B59T
CzHixohRgNSHaQPaI5obXmDoY7RuPXtc2bi3YhE1EfDDk6ipRc9FcAj9YdSG5sPpYh42PpfLVBKF
Gj4NTuclIDRgxiHFg8UqcTvo4DVyQwPkNWOSGxXDZC13JS4xwOVCU1dJyEk4TqzcRxcXLA1xWnQY
RZFIxMWJ4hzY3Y2HDCDMNNJX46cMI9Dho+YXI3MODHDTUafK6jubt3BlhDYNMY0D6xoaNt5TvwOS
YQXF0uh4NWo6xlUKG9gG1IojGKLxJMTiSxiakDKaSiZEvNZB6XR0chyGOHxiQcBhgR84wHUTJDn6
KUJgL2IfS8wcwmTtRjtch5G7vYMxajUbH1uPBDkA+qanS9L3DqHShZjdsNHicevNDnYIZaHUMdLu
dzYbNmOehgeA9IgnQIBwHE3BcMPH4PRrpcABtjXHw8bvQAR57qXNocARl7hA5IbOMu20CnISQIQD
goFgWQSJSCSTorMZIedDUTqTkeA+sYfUfUQhYsSoUWKtcA/Efxg4KEuP5fwQNDb24T8DZ9wwN8Bk
Yb/eKqbB90TsGn94lon+QNs935VzDk4co0B6IB7CEGXLf9z+jWn6gZyNbPMqcLswaT1iamDZDnBc
Njmm3fhPTsLDyLiaSf9vpCxwDpDV6C/+ONhxHPAcZOo0oHULx5W4SRL0UHYG0eWedQ8NsEsQzbZK
YiYrk1tczNDxONrlnzBNXXwqBssQGM5ig84H87TrtXQJSwEyGNgYnWnkY7CXB9luVA83yfJbQ6XM
eO5hZZyfbKb3oyxxpEgTcD3Dy6r0NAmdUMdw4cgYnq1AOQ7zaZIH1YTYL0w0sOo7pHUaB4PFw22k
EBSMx19+0q4XVG0pUQWIFWtYItVQR+lqrDcyDsfpto6bh2Dmn9UTf4aPdHZkA5+FPFEmFhCmJBoV
+TBlDTzg92WgYJeHOqNCEtY1DlnzdPB6LRS5goIcBrRjB2qUOxqRQ2xSO3Hbjb5J3Dvr1SZZ5+gX
0FrBcZ6uTlbK+GgzRxL2KAWa6FA05DF4PSBjRCIxWdKksAGR0BE5LSvbVnGKwfN6GotefVAKYjFT
ap3GkRjyrlORyUAKhFkVCmOTOUwM2joOKoqTg8KxpQ5BIIUihXFSIQBxEqMllDoGtHkmTEhoCYNy
GCO7NgnKgu4ta7QFBarJJYtCYh1G6KeQRc4+GXqTyvR/4KFgRz08HgOUHdTU8+Kk8cCNo3LHNhw4
7ULaqh0j0laMIwMwClLWxqeEba5Ab0BJyQ18eRyNhwalgzRLKjs57L4hVG6UFtvKJvxdQCMEuRG5
xwESGaX5bHDaXMWpu3ovjUT4Di7rvDbkhaQkYkCF+PQTbyrW1Cb6lOWWmfHLe5sUUa1qa8YGjJOU
zDQzSxp+OWauw3DitpwuoQI6x1EZGAmYBkECdg0PAOfXtE8FcyUg2UlHXAIS5PLeojIUyVY6AyhA
u2SwykWQ2oLGw+QcygYmAxIRsUlQCEUgJ2nnh9lWC9/bLL1QA+cHGgCc5vDpA8JGEZAkSRWMz5AS
qK7uIZgpYMZKFraaOGBZME73ej2BGAnEt1tmWKoEFLCDa1peFrA9ljafDaYGDdfk91m5dFSWGgdh
AaWgEhQ4ZIDixgq2CIbQYeQN411UFvEdbwuPWu24do54uq0jFkn7enMk4ynH3l6tCnQK/ppOKcN3
ABLagpux2nlA4ZkQ/D2UAXysMzN1p4p81DSEINmDUIPaRYN6mRoyqHaeWq0DpHpXETOh4NvUOp0c
sq+C066nPHP1dmVzdNpbdV3o3vRz8Paw6BWAcn3BR+nkBsA2QBxDVrQrEdeSbCRZBINV3m0AoD46
Nik3QO8LnghnbJ46jYHSBd25jr6kKVC4eNQN/m3mIZufcOVn1ZUEgYWxA0+45bwdUyA2C3C06b0C
2etpl9ZU37wlEmOMmiCnDM6QgDWur8ncEYjSGDi8Ay3oJYIzgimR09cgVNuuQV3CEUQwv6nAGNTv
oB1px1/ODwbG4I+oY2E2x5RDXXl4IGFxmlGlEca+vYdsNIea+LouOpWBFYwfFApB8UFWSkWQTTLN
EZI5pOJwowSipi5VXq9VbHjuXyIplAyCqLlFNqv9g+jF8o4os7IUaxs1DEuNRqnOhph2wKQJUcpE
YRTFRMiWtQto1Q2AaPlFTRDBdVpLCMFA1ZZMw8Z6bStUVQeOXJM2EFNEO2azayxPb4ZG3NJzSeps
E0Q1nQIaQehIYGloKkKiDLNS1JiparQL3pLkRgF44owlgPQnRA7oLR20NonFdQI1fPetOazcQOqb
PLsw5mH2XxIaBTZY8hvXMhDhQHBDyXX2aYAM8gv1ZT14cDq4nySVKgab6X2MxGDkcyweIvyGMA7K
POSwHoyDnF0OfH+SK9EQoIxlEEKIJJJHVfadLlQG3qsQK602NaQbHIGJrdYh5dg8+ODpzhIkHQdc
IbvMd7HokyaMiNrFefTeQc8yjNSRh7fvHxPS/Dl87vVHr0fBOo1SjWmqKSEF2FvKCWigyRhnXh+H
4vkS8PB4qpphm1ax2zn7W1CZ0vxtJb0yQ8LH4tKeiQ/Q8d8+0shkLlMGe5LbyYKN9USZxYRRIgF6
aplqEUQWdUENSeRD1Nb+BIbiaw3UMDdYoW1OTw8te3ukCtpohqjvgwkPYL9/I88ffDLimiSVU5Th
AZEpfkUuzWLjYA3wvKdqGLQAW3KntJI6aP15aRCMeeIoxwuRnH3CnXv9wXHMdDQm2xzCqvQFrtQE
vCliMYJGIu92dD2jMN8ZDLES1R9HU29rlWB8SDa8u0n4BI6rNeezq1JAcpTUXyJnyPa2D0SVKiKj
FLmi+uus6auXcAbJHJveWiueMM7WQYyTsNrVpncM7oUUXjSHFGCcq1O57IdEkshkZ6V0tjji/ONz
xxrw06ZWiHMKyhkh3tu6qNRuAcjq3yDCbqpqVH+i17B4kwBcuMS7xD2IgSCLpOhdLetaGI1ETdpD
bVuUNVK24ahsGZhIe45w23ixEXQWWtUhZ1vJSxoqOGzz8AagRzGl/UUKVIeQJnp4BsderXmyO3dI
sBMtBlR9FiiSb6nRBm7OzCtSkKs1qCySxEpUhxNUPOg41kqjAFAIkiCSs4kAjotmJdNb67ahq60O
WSN71i0L+1WWEeCU9qpvzKMOnQWkIyIBqUZM2EKHQM2/EyWmWG4KIMFHKhKp65UMEGKbkOFQphE2
CgywlYB+egC+dZMCwZ5jDdfQDLLO1JvlByGVMQEjpY31oDEkVYvXDjAzPXJ2gwIiIIMazgGcQTYN
z03qXlGlHSxagSLk6g4G70KNui+vEpF8rNDq/5wHAPw/cAtp8Ny+WjpNoVQu+LYvo+a9xCyRdip6
UXJld0v4FgRYG0j6ievvGe2NsQ4QzqkqgaPxvVgbD5C0JxYH0r2Q6wM4sMV6h+Dx0B62EaDQG/fg
/+GLxIZIQWTEcpNg6kv5h74igoCIH0YyKT6fLsPX2ekQeeKhOvKoVva63r4bdkbwwyJUwJ20oXhU
5evYdaG427DXxbB9CJFS0Q7n3JH4q/EIV6PfOQKIeQA/QbfTAqfACaja7USCeED2COgX5cAXFgZB
PD3B2F7oxQiWTsp9TAzbM8R3hCiXuxcnN2bohdnwgQwAH/F3JFOFCQW5UhSg
====
--- portindex.uu ends here ---


>Release-Note:
>Audit-Trail:
>Unformatted:


More information about the freebsd-bugs mailing list