vnode_pager_putpages hanged my machine

[Rob]

Hi,

This is one of my first crashes of FreeBSD on my PC. Having lots of faith in
this OS, I still think it's one too many :).

While using ImageMagick's convert (as a user, NOT as root!), to generate an
mpeg file from a bunch of tiff files, my machine went bezerk (gradually slowed
down until no response at all anymore) and I had to hit PC's reset button to
reboot.

Did the machine end up in an eternal loop and ate up all resources?
A bug in vnode? Or in the pager?

My kernel and world update is from last week, Wed. March 3rd.
All other software is up-to-date with today's ports.

After reboot, I found this in /var/log/messages, before the reboot messages:

[...]
Mar  9 15:25:51 cisr /kernel: pid 57668 (convert), uid 1001, was killed: out of swap space
Mar  9 15:27:21 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:21 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 49152 at 400
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 404
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 405
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 406
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 407
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 408
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 409
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 410
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 411
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 412
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 413
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 414
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: pid 3 (pagedaemon), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 415
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 416
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 417
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 418
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 419
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 420
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 421
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 422
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 423
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 424
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 425
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 426
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 427
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 428
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 429
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 430
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 431
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 432
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 433
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 434
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 435
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 436
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 437
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 438
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 439
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 440
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 441
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 442
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 443
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 444
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 445
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 446
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 447
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 448
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 449
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 450
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 451
Mar  9 15:27:22 cisr /kernel: pid 7 (syncer), uid 0 on /var: file system full
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: I/O error 28
Mar  9 15:27:22 cisr /kernel: vnode_pager_putpages: residual I/O 65536 at 452
[...reboot messages...]


Any idea what caused this system breakdown?

Regards,
Rob.