failed to boot: head on V240

[Kurt Lidl]

Greetings all -

I attempted to get my Sunfire 240 up and running head so
that I could play along with the llvm/clang work that is
ongoing.

I was able to install 10-release on that machine, and
even compiled and booted a stable/10 snapshot two days
ago.

Then, using that snapshot, I checked out head and
compiled that (via buildworld/buildkernel).
After installing the kernel, the machine panics in
attempting to boot.

Attached is the boot messages for the machine, including
the backtrace from the panic.  The sources are a completely
stock r262669 checkout of the tree.

The machine in question is a V240, with 8GB of memory, and
2 x 1.5Ghz UltraSparc IIIi processors.

-Kurt

Sun Fire V240, No Keyboard
Copyright 2010 Sun Microsystems, Inc.  All rights reserved.
OpenBoot 4.30.4.a, 8192 MB memory installed, Serial #65064455.
Ethernet address 0:3:ba:e0:ce:7, Host ID: 83e0ce07.

Rebooting with command: boot /pci at 1c,600000/scsi at 2/disk at 0,0:a
Boot device: /pci at 1c,600000/scsi at 2/disk at 0,0:a  File and args: 
 
>> FreeBSD/sparc64 ZFS boot block
   Boot path:   /pci at 1c,600000/scsi at 2/disk at 0,0:a
Consoles: Open Firmware console  
FreeBSD/sparc64 ZFS enabled bootstrap loader, Revision 1.0
(root at snap.freebsd.org, Fri Jan 17 11:27:29 UTC 2014)
bootpath="zfs:sys/ROOT/fbsd11:"
Loading /boot/defaults/loader.conf 
/boot/kernel/kernel data=0xc86b40+0x3cbc10 syms=[0x8+0xd1190+0x8+0xc1fa4]

/boot/kernel/zfs.ko text=0x338050 data=0xabd0+0x18948 syms=[0x8+0x1b0f0+0x8+0x15df5]
loading required module 'opensolaris'
/boot/kernel/opensolaris.ko text=0x3a98 data=0x2c8+0x2030 syms=[0x8+0xdb0+0x8+0x937]
/boot/kernel/geom_mirror.ko text=0x3f458 data=0x5b0+0x20 syms=[0x8+0x1818+0x8+0x1267]

Hit [Enter] to boot immediately, or any other key for command prompt.
Booting [/boot/kernel/kernel]...
jumping to kernel entry at 0xc00a0000.
GDB: no debug ports present
KDB: debugger backends: ddb
KDB: current backend: ddb
Copyright (c) 1992-2014 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 11.0-CURRENT #0 r262669: Sun Mar  2 10:56:53 UTC 2014
    lidl at spork.pix.net:/usr/obj/usr/src.head/sys/GENERIC sparc64
gcc version 4.2.1 20070831 patched [FreeBSD]
WARNING: WITNESS option enabled, expect reduced performance.
real memory  = 8589934592 (8192 MB)
avail memory = 8382529536 (7994 MB)
cpu0: Sun Microsystems UltraSparc-IIIi Processor (1503.00 MHz CPU)
cpu1: Sun Microsystems UltraSparc-IIIi Processor (1503.00 MHz CPU)
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
random device not loaded; using insecure entropy
random: <Software, Yarrow> initialized
kbd0 at kbdmux0
nexus0: <Open Firmware Nexus device>
pcib0: <Sun Host-PCI bridge> mem 0x4000ff00000-0x4000ff0afff,0x4000fc10000-0x4000fc1701f,0x7f600000000-0x7f6000000ff,0x4000ff80000-0x4000ff8ffff irq 2035,2032,2033,2036,2019 on nexus0
pcib0: Tomatillo, version 4, IGN 0x1f, bus B, PCI mode, 66MHz
pcib0: DVMA map: 0xc0000000 to 0xdfffffff 65536 entries
pci0: <OFW PCI bus> on pcib0
pcib1: <Sun Host-PCI bridge> mem 0x4000f600000-0x4000f60afff,0x4000f410000-0x4000f41701f,0x7fe00000000-0x7fe000000ff,0x4000f780000-0x4000f78ffff irq 1970,1968,1969,1972,1953 on nexus0
pcib1: Tomatillo, version 4, IGN 0x1e, bus A, PCI mode, 33MHz
pcib1: DVMA map: 0xc0000000 to 0xdfffffff 65536 entries
pci1: <OFW PCI bus> on pcib1
pcib2: <Sun Host-PCI bridge> mem 0x4000e600000-0x4000e60afff,0x4000e410000-0x4000e41701f,0x7ce00000000-0x7ce000000ff,0x4000e780000-0x4000e78ffff irq 1842,1840,1841,1844,1827 on nexus0
pcib2: Tomatillo, version 4, IGN 0x1c, bus A, PCI mode, 66MHz
pcib2: DVMA map: 0xc0000000 to 0xdfffffff 65536 entries
pci2: <OFW PCI bus> on pcib2
pcib3: <Sun Host-PCI bridge> mem 0x4000ef00000-0x4000ef0afff,0x4000ec10000-0x4000ec1701f,0x7c600000000-0x7c6000000ff,0x4000ef80000-0x4000ef8ffff irq 1907,1904,1905,1908,1893 on nexus0
pcib3: Tomatillo, version 4, IGN 0x1d, bus B, PCI mode, 66MHz
pcib3: DVMA map: 0xc0000000 to 0xdfffffff 65536 entries
pci3: <OFW PCI bus> on pcib3
nexus0: <memory-controller> mem 0x40000000000-0x40000000007 type memory-controller (no driver attached)
nexus0: <memory-controller> mem 0x40000800000-0x40000800007 type memory-controller (no driver attached)
bge0: <Broadcom BCM5704 A3, ASIC rev. 0x002003> mem 0x200000-0x20ffff,0x110000-0x11ffff at device 2.0 on pci0
bge0: CHIP ID 0x00002003; ASIC REV 0x02; CHIP REV 0x20; PCI on PCI-X 66 MHz; 64bit
miibus0: <MII bus> on bge0
brgphy0: <BCM5704 1000BASE-T media interface> PHY 1 on miibus0
brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bge0: Ethernet address: 00:03:ba:e0:ce:07
bge1: <Broadcom BCM5704 A3, ASIC rev. 0x002003> mem 0x400000-0x40ffff,0x120000-0x12ffff at device 2.1 on pci0
bge1: CHIP ID 0x00002003; ASIC REV 0x02; CHIP REV 0x20; PCI on PCI-X 66 MHz; 64bit
miibus1: <MII bus> on bge1
brgphy1: <BCM5704 1000BASE-T media interface> PHY 1 on miibus1
brgphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bge1: Ethernet address: 00:03:ba:e0:ce:08
isab0: <PCI-ISA bridge> at device 7.0 on pci1
isa0: <ISA bus> on isab0
pci1: <old, non-VGA display device> at device 6.0 (no driver attached)
ohci0: <AcerLabs M5237 (Aladdin-V) USB controller> mem 0x1000000-0x1000fff at device 10.0 on pci1
usbus0 on ohci0
atapci0: <AcerLabs M5229 UDMA100 controller> port 0x900-0x907,0x918-0x91b,0x910-0x917,0x908-0x90b,0x920-0x92f at device 13.0 on pci1
atapci0: using PIO transfers above 137GB as workaround for 48bit DMA access bug, expect reduced performance
ata2: <ATA channel> at channel 0 on atapci0
ata3: <ATA channel> at channel 1 on atapci0
sym0: <1010-66> port 0x900-0x9ff mem 0x100000-0x1003ff,0x102000-0x103fff at device 2.0 on pci2
sym0: No NVRAM, ID 7, Fast-80, LVD, parity checking
sym1: <1010-66> port 0xa00-0xaff mem 0x104000-0x1043ff,0x106000-0x107fff at device 2.1 on pci2
sym1: No NVRAM, ID 7, Fast-80, LVD, parity checking
bge2: <Broadcom BCM5704 A3, ASIC rev. 0x002003> mem 0x200000-0x20ffff,0x110000-0x11ffff at device 2.0 on pci3
bge2: CHIP ID 0x00002003; ASIC REV 0x02; CHIP REV 0x20; PCI on PCI-X 66 MHz; 64bit
miibus2: <MII bus> on bge2
brgphy2: <BCM5704 1000BASE-T media interface> PHY 1 on miibus2
brgphy2:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bge2: Ethernet address: 00:03:ba:e0:ce:09
bge3: <Broadcom BCM5704 A3, ASIC rev. 0x002003> mem 0x400000-0x40ffff,0x120000-0x12ffff at device 2.1 on pci3
bge3: CHIP ID 0x00002003; ASIC REV 0x02; CHIP REV 0x20; PCI on PCI-X 66 MHz; 64bit
miibus3: <MII bus> on bge3
brgphy3: <BCM5704 1000BASE-T media interface> PHY 1 on miibus3
brgphy3:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bge3: Ethernet address: 00:03:ba:e0:ce:0a
nexus0: <syscons> type unknown (no driver attached)
rtc0: <Real-Time Clock> at port 0x70-0x71 on isa0
uart0: <16550 or compatible> at port 0x3f8-0x3ff irq 44 on isa0
uart0: console (9600,n,8,1)
uart1: <16550 or compatible> at port 0x2e8-0x2ef irq 44 on isa0
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounter "tick" frequency 1503000000 Hz quality 10
Timecounter "stick" frequency 12000000 Hz quality 10
Event timer "tick" frequency 1503000000 Hz quality 1000
Timecounters tick every 1.000 msec
usbus0: 12Mbps Full Speed USB v1.0
ugen0.1: <AcerLabs> at usbus0
uhub0: <AcerLabs OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
uhub0: 2 ports with 2 removable, self powered
random: unblocking device.
da0 at sym0 bus 0 scbus2 target 0 lun 0
da0: <HITACHI HUS10733ASUN72G PA05> Fixed Direct Access SCSI-3 device 
SMP: AP CPU #1 Launched!
da0: Serial Number 10RW6DG9          50V3W6DG9A
WARNING: WITNESS option enabled, expect reduced performance.
da0: 160.000MB/s transfers (80.000MHz DT, offset 62, 16bit)
da0: Command Queueing enabled
da0: 70007MB (143374738 512 byte sectors: 255H 63S/T 8924C)
da3 at sym0 bus 0 scbus2 target 3 lun 0
da3: <HITACHI HUS10733ASUN72G PA05> Fixed Direct Access SCSI-3 device 
da3: Serial Number 10RW6NXT          50V3W6NXTA
da3: 160.000MB/s transfers (80.000MHz DT, offset 62, 16bit)
da3: Command Queueing enabled
da3: 70007MB (143374738 512 byte sectors: 255H 63S/T 8924C)
da2 at sym0 bus 0 scbus2 target 2 lun 0
da2: <SEAGATE ST373405LC 2203> Fixed Direct Access SCSI-3 device 
da2: Serial Number 3EK1AXHL00007237WL46
da2: 160.000MB/s transfers (80.000MHz DT, offset 62, 16bit)
da2: Command Queueing enabled
da2: 70007MB (143374650 512 byte sectors: 255H 63S/T 8924C)
da1 at sym0 bus 0 scbus2 target 1 lun 0
da1: <IBM-ESXS ST373307LC    FN B25H> Fixed Direct Access SCSI-3 device 
da1: Serial Number 3HZ9AC0B00007512MDRA
da1: 160.000MB/s transfers (80.000MHz DT, offset 62, 16bit)
da1: Command Queueing enabled
da1: 70006MB (143374000 512 byte sectors: 255H 63S/T 8924C)
cd0 at ata2 bus 0 scbus0 target 0 lun 0
cd0: <TEAC DV-28E-C 1.4B> Removable CD-ROM SCSI-0 device 
cd0: 33.300MB/s transfers (UDMA2, ATAPI 12bytes, PIO 65534bytes)
cd0: cd present [263840 x 2048 byte records]
GEOM_MIRROR: Device mirror/gswap launched (2/2).
Trying to mount root from zfs:sys/ROOT/fbsd11 []...
Setting hostuuid: feb21b52-82b0-11e3-b476-0003bae0ce07.
Setting hostid: 0xbd1d8bc9.
Entropy harvesting: interrupts ethernet point_to_point swi.
Starting file system checks:
Mounting local file systems:.
Writing entropy file:.
Setting hostname: spork.pix.net.
bge0: link state changed to DOWN
spin lock 0xc0d1a6b0 (smp rendezvous) held by 0xfffff80005617b60 (tid 100352) too long
timeout stopping cpus
panic: spin lock held too long
cpuid = 1
KDB: stack backtrace:
vpanic() at vpanic+0x1b4
panic() at panic+0x20
_mtx_lock_spin_failed() at _mtx_lock_spin_failed+0x74
_mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0xb8
__mtx_lock_spin_flags() at __mtx_lock_spin_flags+0x190
tick_get_timecount_mp() at tick_get_timecount_mp+0x94
binuptime() at binuptime+0x3c
timercb() at timercb+0x6c
tick_intr() at tick_intr+0x220
-- interrupt level=0xe pil=0 %o7=0xc08f7208 --
spinlock_exit() at spinlock_exit+0x2c
__mtx_unlock_spin_flags() at __mtx_unlock_spin_flags+0x138
cnputs() at cnputs+0xd0
putchar() at putchar+0x3f8
kvprintf() at kvprintf+0x88
log() at log+0xac
do_link_state_change() at do_link_state_change+0x224
taskqueue_run_locked() at taskqueue_run_locked+0x100
taskqueue_run() at taskqueue_run+0x64
taskqueue_swi_run() at taskqueue_swi_run+0x18
intr_event_execute_handlers() at intr_event_execute_handlers+0x154
ithread_loop() at ithread_loop+0x120
fork_exit() at fork_exit+0xa4
fork_trampoline() at fork_trampoline+0x8
KDB: enter: panic
[ thread pid 12 tid 100020 ]
Stopped at      kdb_enter+0x80: ta              %xcc, 1
db>