FreeBSD 8.1-Prerelease Panic amd64 w/ZFS..

Fri May 28 09:31:02 UTC 2010

on 28/05/2010 10:30 Howard Leadmon said the following:
>  I know there used to be some issues with this a while back, but thought
> with the 8.x FBSD servers most of this tuned itself, or then again maybe
> this is something different.
> 
>  
> 
>  For the first time I ever recall, I found my FreeBSD 8 server was crashed
> this past morning, with the following error:
> 
>  
> 
> panic:kmem_malloc(131072):kmem_map to small: 1296826368 total allocated
> 
> cupid=4

O wow, this is an amd64 system (with 4G RAM) and you've got "kmem_map too
small".  That's very very strange.
Are you sure you don't have any backwards-tuning in your configuration or
environment?
What value vm.kmem_size_max has?

> Not sure what other info might be useful, but I will include the dmesg boot
> info, as I know it shows memory and some tidbits on ZFS, if anything else
> would be useful to look at please let me know.   Knock on wood it's been a
> long time since I have had any panics, so this one surprised me..
> 
>  
> 
>  
> 
> Copyright (c) 1992-2010 The FreeBSD Project.
> 
> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
> 
>         The Regents of the University of California. All rights reserved.
> 
> FreeBSD is a registered trademark of The FreeBSD Foundation.
> 
> FreeBSD 8.1-PRERELEASE #9: Wed May 19 09:24:24 EDT 2010
> 
>     howardl at vorlon.leadmon.net:/usr/obj/usr/src/sys/VORLON amd64
> 
> Timecounter "i8254" frequency 1193182 Hz quality 0
> 
> CPU: Intel(R) Xeon(TM) CPU 2.80GHz (2793.20-MHz K8-class CPU)
> 
>   Origin = "GenuineIntel"  Id = 0xf48  Family = f  Model = 4  Stepping = 8
> 
>  
> Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA
> ,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
> 
>   Features2=0x649d<SSE3,DTES64,MON,DS_CPL,EST,CNXT-ID,CX16,xTPR>
> 
>   AMD Features=0x20100800<SYSCALL,NX,LM>
> 
>   AMD Features2=0x1<LAHF>
> 
>   TSC: P-state invariant
> 
> real memory  = 4294967296 (4096 MB)
> 
> avail memory = 4117700608 (3926 MB)
> 
> ACPI APIC Table: <DELL   PE BKC  >
> 
> FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
> 
> FreeBSD/SMP: 2 package(s) x 2 core(s) x 2 HTT threads
> 
>  cpu0 (BSP): APIC ID:  0
> 
>  cpu1 (AP/HT): APIC ID:  1
> 
>  cpu2 (AP): APIC ID:  2
> 
>  cpu3 (AP/HT): APIC ID:  3
> 
>  cpu4 (AP): APIC ID:  4
> 
>  cpu5 (AP/HT): APIC ID:  5
> 
>  cpu6 (AP): APIC ID:  6
> 
>  cpu7 (AP/HT): APIC ID:  7
> 
> ioapic0: Changing APIC ID to 8
> 
> ioapic1: Changing APIC ID to 9
> 
> ioapic2: Changing APIC ID to 10
> 
> ioapic0 <Version 2.0> irqs 0-23 on motherboard
> 
> ioapic1 <Version 2.0> irqs 32-55 on motherboard
> 
> ioapic2 <Version 2.0> irqs 64-87 on motherboard
> 
> kbd1 at kbdmux0
> 
> acpi0: <DELL PE BKC> on motherboard
> 
> acpi0: [ITHREAD]
> 
> acpi0: Power Button (fixed)
> 
> Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
> 
> acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
> 
> cpu0: <ACPI CPU> on acpi0
> 
> cpu1: <ACPI CPU> on acpi0
> 
> cpu2: <ACPI CPU> on acpi0
> 
> cpu3: <ACPI CPU> on acpi0
> 
> cpu4: <ACPI CPU> on acpi0
> 
> cpu5: <ACPI CPU> on acpi0
> 
> cpu6: <ACPI CPU> on acpi0
> 
> cpu7: <ACPI CPU> on acpi0
> 
> acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on
> acpi0
> 
> Timecounter "HPET" frequency 14318180 Hz quality 900
> 
> pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
> 
> pci0: <ACPI PCI bus> on pcib0
> 
> pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
> 
> pci1: <ACPI PCI bus> on pcib1
> 
> pcib2: <ACPI PCI-PCI bridge> at device 0.0 on pci1
> 
> pci2: <ACPI PCI bus> on pcib2
> 
> amr0: <LSILogic MegaRAID 1.53> mem
> 0xf80f0000-0xf80fffff,0xfe9e0000-0xfe9fffff irq 46 at device 14.0 on pci2
> 
> amr0: Using 64-bit DMA
> 
> amr0: [ITHREAD]
> 
> amr0: delete logical drives supported by controller
> 
> amr0: <LSILogic PERC 4e/Si> Firmware 521X, BIOS H430, 256MB RAM
> 
> pcib3: <ACPI PCI-PCI bridge> at device 0.2 on pci1
> 
> pci3: <ACPI PCI bus> on pcib3
> 
> pcib4: <ACPI PCI-PCI bridge> at device 4.0 on pci0
> 
> pci4: <ACPI PCI bus> on pcib4
> 
> pcib5: <ACPI PCI-PCI bridge> at device 5.0 on pci0
> 
> pci5: <ACPI PCI bus> on pcib5
> 
> pcib6: <ACPI PCI-PCI bridge> at device 0.0 on pci5
> 
> pci6: <ACPI PCI bus> on pcib6
> 
> em0: <Intel(R) PRO/1000 Legacy Network Connection 1.0.1> port 0xecc0-0xecff
> mem 0xfe6e0000-0xfe6fffff irq 64 at device 7.0 on pci6
> 
> em0: [FILTER]
> 
> em0: Ethernet address: 00:13:72:51:7e:43
> 
> pcib7: <ACPI PCI-PCI bridge> at device 0.2 on pci5
> 
> pci7: <ACPI PCI bus> on pcib7
> 
> em1: <Intel(R) PRO/1000 Legacy Network Connection 1.0.1> port 0xdcc0-0xdcff
> mem 0xfe4e0000-0xfe4fffff irq 65 at device 8.0 on pci7
> 
> em1: [FILTER]
> 
> em1: Ethernet address: 00:13:72:51:7e:44
> 
> pcib8: <ACPI PCI-PCI bridge> at device 6.0 on pci0
> 
> pci8: <ACPI PCI bus> on pcib8
> 
> uhci0: <Intel 82801EB (ICH5) USB controller USB-A> port 0xbce0-0xbcff irq 16
> at device 29.0 on pci0
> 
> uhci0: [ITHREAD]
> 
> usbus0: <Intel 82801EB (ICH5) USB controller USB-A> on uhci0
> 
> uhci1: <Intel 82801EB (ICH5) USB controller USB-B> port 0xbcc0-0xbcdf irq 19
> at device 29.1 on pci0
> 
> uhci1: [ITHREAD]
> 
> usbus1: <Intel 82801EB (ICH5) USB controller USB-B> on uhci1
> 
> uhci2: <Intel 82801EB (ICH5) USB controller USB-C> port 0xbca0-0xbcbf irq 18
> at device 29.2 on pci0
> 
> uhci2: [ITHREAD]
> 
> usbus2: <Intel 82801EB (ICH5) USB controller USB-C> on uhci2
> 
> ehci0: <Intel 82801EB/R (ICH5) USB 2.0 controller> mem 0xfeb00000-0xfeb003ff
> irq 23 at device 29.7 on pci0
> 
> ehci0: [ITHREAD]
> 
> usbus3: EHCI version 1.0
> 
> usbus3: <Intel 82801EB/R (ICH5) USB 2.0 controller> on ehci0
> 
> pcib9: <ACPI PCI-PCI bridge> at device 30.0 on pci0
> 
> pci9: <ACPI PCI bus> on pcib9
> 
> vgapci0: <VGA-compatible display> port 0xcc00-0xccff mem
> 0xf0000000-0xf7ffffff,0xfe1f0000-0xfe1fffff irq 18 at device 13.0 on pci9
> 
> isab0: <PCI-ISA bridge> at device 31.0 on pci0
> 
> isa0: <ISA bus> on isab0
> 
> atapci0: <Intel ICH5 UDMA100 controller> port
> 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xfc00-0xfc0f at device 31.1 on pci0
> 
> ata0: <ATA channel 0> on atapci0
> 
> ata0: [ITHREAD]
> 
> ata1: <ATA channel 1> on atapci0
> 
> ata1: [ITHREAD]
> 
> atrtc0: <AT realtime clock> port 0x70-0x7f irq 8 on acpi0
> 
> fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
> 
> fdc0: [FILTER]
> 
> atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
> 
> atkbd0: <AT Keyboard> irq 1 on atkbdc0
> 
> kbd0 at atkbd0
> 
> atkbd0: [GIANT-LOCKED]
> 
> atkbd0: [ITHREAD]
> 
> psm0: <PS/2 Mouse> irq 12 on atkbdc0
> 
> psm0: [GIANT-LOCKED]
> 
> psm0: [ITHREAD]
> 
> psm0: model IntelliMouse, device ID 3
> 
> uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
> 
> uart0: [FILTER]
> 
> orm0: <ISA Option ROMs> at iomem
> 0xc0000-0xcafff,0xcb000-0xcbfff,0xcc000-0xccfff,0xec000-0xeffff on isa0
> 
> sc0: <System console> at flags 0x100 on isa0
> 
> sc0: VGA <16 virtual consoles, flags=0x300>
> 
> vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
> 
> ppc0: cannot reserve I/O port range
> 
> est0: <Enhanced SpeedStep Frequency Control> on cpu0
> 
> est: CPU supports Enhanced Speedstep, but is not recognized.
> 
> est: cpu_vendor GenuineIntel, msr e2800000e28
> 
> device_attach: est0 attach returned 6
> 
> p4tcc0: <CPU Frequency Thermal Control> on cpu0
> 
> est1: <Enhanced SpeedStep Frequency Control> on cpu1
> 
> est: CPU supports Enhanced Speedstep, but is not recognized.
> 
> est: cpu_vendor GenuineIntel, msr e2800000e28
> 
> device_attach: est1 attach returned 6
> 
> p4tcc1: <CPU Frequency Thermal Control> on cpu1
> 
> est2: <Enhanced SpeedStep Frequency Control> on cpu2
> 
> est: CPU supports Enhanced Speedstep, but is not recognized.
> 
> est: cpu_vendor GenuineIntel, msr e2800000e28
> 
> device_attach: est2 attach returned 6
> 
> p4tcc2: <CPU Frequency Thermal Control> on cpu2
> 
> est3: <Enhanced SpeedStep Frequency Control> on cpu3
> 
> est: CPU supports Enhanced Speedstep, but is not recognized.
> 
> est: cpu_vendor GenuineIntel, msr e2800000e28
> 
> device_attach: est3 attach returned 6
> 
> p4tcc3: <CPU Frequency Thermal Control> on cpu3
> 
> est4: <Enhanced SpeedStep Frequency Control> on cpu4
> 
> est: CPU supports Enhanced Speedstep, but is not recognized.
> 
> est: cpu_vendor GenuineIntel, msr e2800000e28
> 
> device_attach: est4 attach returned 6
> 
> p4tcc4: <CPU Frequency Thermal Control> on cpu4
> 
> est5: <Enhanced SpeedStep Frequency Control> on cpu5
> 
> est: CPU supports Enhanced Speedstep, but is not recognized.
> 
> est: cpu_vendor GenuineIntel, msr e2800000e28
> 
> device_attach: est5 attach returned 6
> 
> p4tcc5: <CPU Frequency Thermal Control> on cpu5
> 
> est6: <Enhanced SpeedStep Frequency Control> on cpu6
> 
> est: CPU supports Enhanced Speedstep, but is not recognized.
> 
> est: cpu_vendor GenuineIntel, msr e2800000e28
> 
> device_attach: est6 attach returned 6
> 
> p4tcc6: <CPU Frequency Thermal Control> on cpu6
> 
> est7: <Enhanced SpeedStep Frequency Control> on cpu7
> 
> est: CPU supports Enhanced Speedstep, but is not recognized.
> 
> est: cpu_vendor GenuineIntel, msr e2800000e28
> 
> device_attach: est7 attach returned 6
> 
> p4tcc7: <CPU Frequency Thermal Control> on cpu7
> 
> ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is
> present;
> 
>             to enable, add "vfs.zfs.prefetch_disable=0" to
> /boot/loader.conf.
> 
> ZFS filesystem version 3
> 
> ZFS storage pool version 14
> 
> Timecounters tick every 1.000 msec
> 
> usbus0: 12Mbps Full Speed USB v1.0
> 
> usbus1: 12Mbps Full Speed USB v1.0
> 
> usbus2: 12Mbps Full Speed USB v1.0
> 
> usbus3: 480Mbps High Speed USB v2.0
> 
> ugen0.1: <Intel> at usbus0
> 
> uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
> 
> ugen1.1: <Intel> at usbus1
> 
> uhub1: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
> 
> ugen2.1: <Intel> at usbus2
> 
> uhub2: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
> 
> ugen3.1: <Intel> at usbus3
> 
> uhub3: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus3
> 
> uhub0: 2 ports with 2 removable, self powered
> 
> uhub1: 2 ports with 2 removable, self powered
> 
> uhub2: 2 ports with 2 removable, self powered
> 
> acd0: CDROM <TEAC CD-ROM CD-224E-N/3.AB> at ata0-master UDMA33 
> 
> amr0: delete logical drives supported by controller
> 
> amrd0: <LSILogic MegaRAID logical drive> on amr0
> 
> amrd0: 140160MB (287047680 sectors) RAID 1 (optimal)
> 
> SMP: AP CPU #1 Launched!
> 
> SMP: AP CPU #6 Launched!
> 
> SMP: AP CPU #3 Launched!
> 
> SMP: AP CPU #4 Launched!
> 
> SMP: AP CPU #7 Launched!
> 
> SMP: AP CPU #2 Launched!
> 
> SMP: AP CPU #5 Launched!
> 
> Root mount waiting for: usbus3
> 
> Root mount waiting for: usbus3
> 
> uhub3: 6 ports with 6 removable, self powered
> 
> Root mount waiting for: usbus3
> 
> ugen3.2: <vendor 0x413c> at usbus3
> 
> uhub4: <vendor 0x413c product 0xa001, class 9/0, rev 2.00/0.00, addr 2> on
> usbus3
> 
> uhub4: 2 ports with 2 removable, self powered
> 
> Trying to mount root from zfs:tank/root
> 
> em0: link state changed to UP
> 
>  
> 
>  
> 
> ---
> 
> Howard Leadmon 
> 
>  
> 

-- 
Andriy Gapon