Boot failure, 7.1R-amd64

[Phil Stracchino]

I wish to report, and seek advice on, a 7.1R-amd64 boot failure on a
machine that should be perfectly capable of running it.


I have a 3U storage box here with two Intel Xeon 3.2GHz CPUs (0xf41; I
believe they're Irwindales, NetBurst microarchitecture with amd64
support) on a Tyan Tiger i7320R-S5350 board with 4GB of RAM.  Boot is a
mirrored (with gmirror) pair of Seagate ST980811AS 2.5" SATA disks.
Main storage is twelve Maxtor 300GB SATA disks on a 3Ware 9500S-12
SATA-RAID controller, exported in JBOD mode.  I've just updated the
system BIOS to the latest S5350-108 image.

This machine happily runs Solaris 10 x86.  It happily runs OpenBSD 4.4
amd64.  It runs FreeBSD 7.1R-i386, as long as it is booted without acpi.

FreeBSD babylon4.babcom.com 7.1-RELEASE FreeBSD 7.1-RELEASE #0: Thu Jan
 1 14:37:25 UTC 2009
root at logan.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC  i386

(still running generic kernel at this time, as you can see)


However, it will not boot FreeBSD 7.1R-amd64, although all reason says
it should.  Booted from 7.1R-amd64 cd1 with ACPI enabled, it gets as far as:

...
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
uhub3: <vendor 0x0451 product 0x1446, class 9/0, rev 1.10/1.10, addr 2>
on uhub0
uhub3: 4 ports with 4 removable, self powered
Timecounters tick every 1.000 msec
md0: Preloaded image </boot/mfsroot> 4194034 bytes at 0xffffffff80c4be40
ad0: 76319MB <Seagate ST980811AS 3.BHE> at ata0-master SATA150
ad1: 76319MB <Seagate ST980811AS 3.BHE> at ata0-slave SATA150

...at which point it hangs.

With acpi disabled:

...
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
uhub3: <vendor 0x0451 product 0x1446, class 9/0, rev 1.10/1.10, addr 2>
on uhub0
uhub3: 4 ports with 4 removable, self powered
Timecounter "TSC" frequency 3192019456 Hz quality 800
Timecounters tick every 1.000 msec
md0: Preloaded image </boot/mfsroot> 4194034 bytes at 0xffffffff80c4be40
Trying to mount root from ufs:/dev/md0

...and hang.

Verbose logging adds the following additional information at the hang point:

...
uhub3: 4 ports with 4 removable, self powered
Device configuration finished.
Reducing kern.maxvnodes 235635 -> 100000
procfs registered
lapic: Divisor 2, frequency 99750485 Hz
Timecounter "TSC" frequency 3192019456 Hz quality 800
Timecounters tick every 1.000 msec
lo0: bpf attached
hptrr: no controller detected
md0: Preloaded image </boot/mfsroot> 4194034 bytes at 0xffffffff80c4be40
(probe12:twa0:0:12:7): error 22
(probe12:twa0:0:12:7): Unretryable error
(probe13:twa0:0:13:7): error 22
(probe13:twa0:0:13:7): Unretryable error
(probe14:twa0:0:14:7): error 22
(probe14:twa0:0:14:7): Unretryable error
(probe15:twa0:0:15:7): error 22
(probe15:twa0:0:15:7): Unretryable error

[repeat until probe31]

(probe0:twa0:0:0:7): error 22
(probe0:twa0:0:0:7): Unretryable error
(probe1:twa0:0:1:7): error 22
(probe1:twa0:0:1:7): Unretryable error
...
(probe11:twa0:0:11:7): error 22
(probe11:twa0:0:11:7): Unretryable error

[repeat probe0-probe11 sequence 8 times in total

[hang]



dmesg, booted from onboard 7.1R-i386:

Copyright (c) 1992-2009 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 7.1-RELEASE #0: Thu Jan  1 14:37:25 UTC 2009
    root at logan.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(TM) CPU 3.20GHz (3192.02-MHz 686-class CPU)
  Origin = "GenuineIntel"  Id = 0xf41  Stepping = 1

Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,C
MOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x641d<SSE3,DTES64,MON,DS_CPL,CNXT-ID,CX16,xTPR>
  AMD Features=0x20100000<NX,LM>
  Logical CPUs per core: 2
real memory  = 3623288832 (3455 MB)
avail memory = 3541639168 (3377 MB)
MPTable: <INTEL    Lindenhurst >
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  6
ioapic0: Assuming intbase of 0
ioapic1: Assuming intbase of 24
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
kbd1 at kbdmux0
ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413)
pcib0: <MPTable Host-PCI bridge> pcibus 0 on motherboard
pci0: <PCI bus> on pcib0
pcib0: unable to route slot 2 INTA
pcib0: unable to route slot 3 INTA
pcib1: <MPTable PCI-PCI bridge> irq 5 at device 2.0 on pci0
pci1: <PCI bus> on pcib1
bge0: <Broadcom NetXtreme Gigabit Ethernet Controller, ASIC rev. 0x4101>
mem 0xd
d100000-0xdd10ffff irq 16 at device 0.0 on pci1
miibus0: <MII bus> on bge0
brgphy0: <BCM5750 10/100/1000baseTX PHY> PHY 1 on miibus0
brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
1000baseT-F
DX, auto
bge0: Ethernet address: 00:e0:81:30:de:88
bge0: [ITHREAD]
pcib2: <MPTable PCI-PCI bridge> irq 5 at device 3.0 on pci0
pci2: <PCI bus> on pcib2
bge1: <Broadcom NetXtreme Gigabit Ethernet Controller, ASIC rev. 0x4101>
mem 0xd
d200000-0xdd20ffff irq 16 at device 0.0 on pci2
miibus1: <MII bus> on bge1
brgphy1: <BCM5750 10/100/1000baseTX PHY> PHY 1 on miibus1
brgphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
1000baseT-F
DX, auto
bge1: Ethernet address: 00:e0:81:30:de:89
bge1: [ITHREAD]
pcib3: <MPTable PCI-PCI bridge> at device 28.0 on pci0
pci3: <PCI bus> on pcib3
3ware device driver for 9000 series storage controllers, version:
3.70.05.001
twa0: <3ware 9000 series Storage Controller> port 0x2000-0x20ff mem
0xdd300000-0
xdd3000ff,0xdf800000-0xdfffffff irq 24 at device 3.0 on pci3
twa0: [ITHREAD]
twa0: INFO: (0x15: 0x1300): Controller details:: Model 9500S-12, 12
ports, Firmw
are FE9X 2.08.00.005, BIOS string not found
uhci0: <UHCI (generic) USB controller> port 0x1400-0x141f irq 16 at
device 29.0
on pci0
uhci0: [GIANT-LOCKED]
uhci0: [ITHREAD]
usb0: <UHCI (generic) USB controller> on uhci0
usb0: USB revision 1.0
uhub0: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb0
uhub0: 2 ports with 2 removable, self powered
uhci1: <UHCI (generic) USB controller> port 0x1420-0x143f irq 19 at
device 29.1
on pci0
uhci1: [GIANT-LOCKED]
uhci1: [ITHREAD]
usb1: <UHCI (generic) USB controller> on uhci1
usb1: USB revision 1.0
uhub1: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb1
uhub1: 2 ports with 2 removable, self powered
pci0: <base peripheral> at device 29.4 (no driver attached)
ehci0: <Intel 6300ESB USB 2.0 controller> mem 0xdd000400-0xdd0007ff irq
23 at de
vice 29.7 on pci0
ehci0: [GIANT-LOCKED]
ehci0: [ITHREAD]
usb2: EHCI version 1.0
usb2: companion controllers, 2 ports each: usb0 usb1
usb2: <Intel 6300ESB USB 2.0 controller> on ehci0
usb2: USB revision 2.0
uhub2: <Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb2
uhub2: 4 ports with 4 removable, self powered
pcib4: <MPTable PCI-PCI bridge> at device 30.0 on pci0
pci4: <PCI bus> on pcib4
vgapci0: <VGA-compatible display> port 0x3000-0x30ff mem
0xde000000-0xdeffffff,0
xdd400000-0xdd400fff irq 17 at device 3.0 on pci4
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel 6300ESB SATA150 controller> port
0x1f0-0x1f7,0x3f6,0x170-0x177,0
x376,0x1470-0x147f at device 31.2 on pci0
ata0: <ATA channel 0> on atapci0
ata0: [ITHREAD]
ata1: <ATA channel 1> on atapci0
ata1: [ITHREAD]
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
cpu0 on motherboard
p4tcc0: <CPU Frequency Thermal Control> on cpu0
cpu1 on motherboard
p4tcc1: <CPU Frequency Thermal Control> on cpu1
pmtimer0 on isa0
orm0: <ISA Option ROM> at iomem 0xc0000-0xc7fff pnpid ORM0000 on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: [ITHREAD]
psm0: model Generic PS/2 mouse, device ID 0
fdc0: <Enhanced floppy controller> at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2
on isa0
fdc0: [FILTER]
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
ppc0: <Parallel port> at port 0x378-0x37f irq 7 on isa0
ppc0: Generic chipset (EPP/NIBBLE) in COMPATIBLE mode
ppbus0: <Parallel port bus> on ppc0
ppbus0: [ITHREAD]
plip0: <PLIP network interface> on ppbus0
plip0: WARNING: using obsoleted IFF_NEEDSGIANT flag
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
ppc0: [GIANT-LOCKED]
ppc0: [ITHREAD]
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
sio0: type 16550A
sio0: [FILTER]
sio1 at port 0x2f8-0x2ff irq 3 on isa0
sio1: type 16550A
sio1: [FILTER]
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
unknown: <PNP0c02> can't assign resources (memory)
unknown: <PNP0c02> can't assign resources (memory)
unknown: <PNP0c01> can't assign resources (memory)
unknown: <PNP0303> can't assign resources (port)
unknown: <PNP0c02> can't assign resources (memory)
unknown: <PNP0f13> can't assign resources (irq)
unknown: <PNP0501> can't assign resources (port)
unknown: <PNP0700> can't assign resources (port)
unknown: <PNP0501> can't assign resources (port)
unknown: <PNP0400> can't assign resources (port)
uhub3: <vendor 0x0451 product 0x1446, class 9/0, rev 1.10/1.10, addr 2>
on uhub0
uhub3: 4 ports with 4 removable, self powered
Timecounters tick every 1.000 msec
ad0: 76319MB <Seagate ST980811AS 3.BHE> at ata0-master SATA150
ad1: 76319MB <Seagate ST980811AS 3.BHE> at ata0-slave SATA150
acd0: CDROM <SONY CD-ROM CDU5215/7YS1> at ata1-master UDMA33
GEOM_MIRROR: Device mirror/gm0 launched (2/2).
da0 at twa0 bus 0 target 0 lun 0
da0: <AMCC 9500S-12   DISK 2.08> Fixed Direct Access SCSI-3 device
da0: 100.000MB/s transfers
da0: 286092MB (585916416 512 byte sectors: 255H 63S/T 36471C)
da1 at twa0 bus 0 target 1 lun 0
da1: <AMCC 9500S-12   DISK 2.08> Fixed Direct Access SCSI-3 device
da1: 100.000MB/s transfers
da1: 286092MB (585916416 512 byte sectors: 255H 63S/T 36471C)
da2 at twa0 bus 0 target 2 lun 0
da2: <AMCC 9500S-12   DISK 2.08> Fixed Direct Access SCSI-3 device
da2: 100.000MB/s transfers
da2: 286092MB (585916416 512 byte sectors: 255H 63S/T 36471C)
da3 at twa0 bus 0 target 3 lun 0
da3: <AMCC 9500S-12   DISK 2.08> Fixed Direct Access SCSI-3 device
da3: 100.000MB/s transfers
da3: 286092MB (585916416 512 byte sectors: 255H 63S/T 36471C)
da4 at twa0 bus 0 target 4 lun 0
da4: <AMCC 9500S-12   DISK 2.08> Fixed Direct Access SCSI-3 device
da4: 100.000MB/s transfers
da4: 286092MB (585916416 512 byte sectors: 255H 63S/T 36471C)
da5 at twa0 bus 0 target 5 lun 0
da5: <AMCC 9500S-12   DISK 2.08> Fixed Direct Access SCSI-3 device
da5: 100.000MB/s transfers
da5: 286092MB (585916416 512 byte sectors: 255H 63S/T 36471C)
da6 at twa0 bus 0 target 6 lun 0
da6: <AMCC 9500S-12   DISK 2.08> Fixed Direct Access SCSI-3 device
da6: 100.000MB/s transfers
da6: 286092MB (585916416 512 byte sectors: 255H 63S/T 36471C)
da7 at twa0 bus 0 target 7 lun 0
da7: <AMCC 9500S-12   DISK 2.08> Fixed Direct Access SCSI-3 device
da7: 100.000MB/s transfers
da7: 286092MB (585916416 512 byte sectors: 255H 63S/T 36471C)
da8 at twa0 bus 0 target 8 lun 0
da8: <AMCC 9500S-12   DISK 2.08> Fixed Direct Access SCSI-3 device
da8: 100.000MB/s transfers
da8: 286092MB (585916416 512 byte sectors: 255H 63S/T 36471C)
da9 at twa0 bus 0 target 9 lun 0
da9: <AMCC 9500S-12   DISK 2.08> Fixed Direct Access SCSI-3 device
da9: 100.000MB/s transfers
da9: 286092MB (585916416 512 byte sectors: 255H 63S/T 36471C)
da10 at twa0 bus 0 target 10 lun 0
da10: <AMCC 9500S-12   DISK 2.08> Fixed Direct Access SCSI-3 device
da10: 100.000MB/s transfers
da10: 286092MB (585916416 512 byte sectors: 255H 63S/T 36471C)
da11 at twa0 bus 0 target 11 lun 0
da11: <AMCC 9500S-12   DISK 2.08> Fixed Direct Access SCSI-3 device
da11: 100.000MB/s transfers
da11: 286092MB (585916416 512 byte sectors: 255H 63S/T 36471C)
SMP: AP CPU #1 Launched!
Trying to mount root from ufs:/dev/mirror/gm0s1a
This module (opensolaris) contains code covered by the
Common Development and Distribution License (CDDL)
see http://opensolaris.org/os/licensing/opensolaris_license/
WARNING: ZFS is considered to be an experimental feature in FreeBSD.
ZFS filesystem version 6
ZFS storage pool version 6



-- 
  Phil Stracchino, CDK#2     DoD#299792458     ICBM: 43.5607, -71.355
  alaric at caerllewys.net   alaric at metrocast.net   phil at co.ordinate.org
         Renaissance Man, Unix ronin, Perl hacker, Free Stater
                 It's not the years, it's the mileage.