Progress installing on IBM LS21 "Blade" machine

Fri Mar 9 18:03:58 UTC 2007

As you may know, I've been sending all sorts of messages trying to get
help running FreeBSD 6.x on this AMD Opteron-based blade (LS21). Now
I've managed to get it to work mostly as I want it, so here's some maps
for future explorers.

First, things that don't work:

* 64-bit kernels. With or without ACPI, on 6-stable or on 7-current,
kernels in AMD64 mode don't finish booting, or in the best case boot but
can't run SMP (they don't find additional CPUs, but mptable information
is correct - see previous posts). There's even a sort-of regression in
7-current: while 6-stable without ACPI boots but finds only one CPU,
7-current kernel hangs with or without ACPI, either during USB bus'
detection or just after "parallel port" detection (which is obviously
not present on blades but still detected...).

* One irritating umass device. It seems that there's an embedded umass
(USB mass storage) device in the blade or blade center which is listed
in device tree but doesn't respond to any probes, thus hanging the boot
process for upto 15 minutes until all timeouts expire. First time this
happened I almost gave up and pronounced it a lost cause, but it appears
to be a harmless (if irritating) timeout issue. I've built a kernel
without umass support, but that means I also lost the built-in CD/DVD
drive in the chasis.

Second, what works:

* 32-bit i386 kernels in any mode: UP, SMP, UP/PAE, SMP/PAE, I've tried
them all, and except the problem with umass, they all work as
advertised. I'm running SMP/PAE since I need the additional memory.

* Network interfaces are of the bce variety and need SerDes support to
work. This has been MFC'ed somewhere early february.

* FibreChannel interface is QLogic 24xx, support for which has been
MFCed very recently (almost 2 days ago).

So, plain 6.2-release can't run on the blade, but 6-stable can, without
additional patches.

Here's dmesg for the machine:

Copyright (c) 1992-2007 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 6.2-STABLE #4: Fri Mar  9 17:10:32 CET 2007
    ivoras at quad.cc.fer.hr:/usr/obj/usr/src/sys/PAESMP
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Dual-Core AMD Opteron(tm) Processor 2216 HE (2400.10-MHz 686-class CPU)
  Origin = "AuthenticAMD"  Id = 0x40f12  Stepping = 2

Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
  Features2=0x2001<SSE3,CX16>
  AMD Features=0xea500800<SYSCALL,NX,MMX+,FFXSR,RDTSCP,LM,3DNow+,3DNow>
  AMD Features2=0x1f<LAHF,CMP,<b2>,<b3>,CR8>
  Cores per package: 2
real memory  = 4815060992 (4592 MB)
avail memory = 4191055872 (3996 MB)
ACPI APIC Table: <IBM    SERLEWIS>
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
 cpu2 (AP): APIC ID:  2
 cpu3 (AP): APIC ID:  3
ioapic1 <Version 1.1> irqs 16-31 on motherboard
ioapic0 <Version 1.1> irqs 0-15 on motherboard
kbd1 at kbdmux0
acpi0: <IBM SERLEWIS> on motherboard
acpi_bus_number: can't get _ADR
acpi_bus_number: can't get _ADR
acpi_bus_number: can't get _ADR
acpi_bus_number: can't get _ADR
acpi_bus_number: can't get _ADR
acpi_bus_number: can't get _ADR
acpi0: Power Button (fixed)
acpi_bus_number: can't get _ADR
acpi_bus_number: can't get _ADR
unknown: I/O range not supported
unknown: I/O range not supported
unknown: I/O range not supported
unknown: I/O range not supported
Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x488-0x48b on acpi0
cpu0: <ACPI CPU> on acpi0
acpi_throttle0: <ACPI CPU Throttling> on cpu0
cpu1: <ACPI CPU> on acpi0
acpi_throttle1: <ACPI CPU Throttling> on cpu1
acpi_throttle1: failed to attach P_CNT
device_attach: acpi_throttle1 attach returned 6
cpu2: <ACPI CPU> on acpi0
acpi_throttle2: <ACPI CPU Throttling> on cpu2
acpi_throttle2: failed to attach P_CNT
device_attach: acpi_throttle2 attach returned 6
cpu3: <ACPI CPU> on acpi0
acpi_throttle3: <ACPI CPU Throttling> on cpu3
acpi_throttle3: failed to attach P_CNT
device_attach: acpi_throttle3 attach returned 6
pcib0: <ACPI Host-PCI bridge> on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> at device 13.0 on pci1
pci2: <ACPI PCI bus> on pcib2
bce0: <Broadcom NetXtreme II BCM5706 1000Base-SX (A2), v0.9.6> mem
0xea000000-0xebffffff irq 17 at device 4.0 on pci2
bce0: ASIC ID 0x57060021; Revision (A2); PCI-X 64-bit 133MHz
miibus0: <MII bus> on bce0
gentbi0: <Generic ten-bit interface> on miibus0
gentbi0:  1000baseSX, 1000baseSX-FDX, auto
bce0: Ethernet address: 00:14:5e:6d:2d:74
bce1: <Broadcom NetXtreme II BCM5706 1000Base-SX (A2), v0.9.6> mem
0xec000000-0xedffffff irq 18 at device 5.0 on pci2
bce1: ASIC ID 0x57060021; Revision (A2); PCI-X 64-bit 133MHz
miibus1: <MII bus> on bce1
gentbi1: <Generic ten-bit interface> on miibus1
gentbi1:  1000baseSX, 1000baseSX-FDX, auto
bce1: Ethernet address: 00:14:5e:b3:2a:38
isab0: <PCI-ISA bridge> at device 2.2 on pci0
isa0: <ISA bus> on isab0
ohci0: <OHCI (generic) USB controller> port 0x3000-0x30ff mem
0xf9fff000-0xf9ffffff irq 3 at device 3.0 on pci0
ohci0: [GIANT-LOCKED]
usb0: OHCI version 1.0, legacy support
usb0: SMM does not respond, resetting
usb0: <OHCI (generic) USB controller> on ohci0
usb0: USB revision 1.0
uhub0: (0x1166) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
ohci1: <OHCI (generic) USB controller> port 0x3100-0x31ff mem
0xf9ffe000-0xf9ffefff irq 3 at device 3.1 on pci0
ohci1: [GIANT-LOCKED]
usb1: OHCI version 1.0, legacy support
usb1: <OHCI (generic) USB controller> on ohci1
usb1: USB revision 1.0
uhub1: (0x1166) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
ehci0: <EHCI (generic) USB 2.0 controller> port 0x3200-0x32ff mem
0xf9ffd000-0xf9ffdfff irq 3 at device 3.2 on pci0
ehci0: [GIANT-LOCKED]
usb2: EHCI version 1.0
usb2: companion controllers, 2 ports each: usb0 usb1
usb2: <EHCI (generic) USB 2.0 controller> on ehci0
usb2: USB revision 2.0
uhub2: (0x1166) EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub2: 4 ports with 4 removable, self powered
uhub3: vendor 0x04b4 product 0x6560, class 9/0, rev 2.00/0.07, addr 2
uhub3: multiple transaction translators
uhub3: 2 ports with 2 removable, self powered
pci0: <display, VGA> at device 5.0 (no driver attached)
pcib3: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci3: <ACPI PCI bus> on pcib3
mpt0: <LSILogic SAS/SATA Adapter> port 0x4000-0x40ff mem
0xe8010000-0xe8013fff,0xe8000000-0xe800ffff irq 19 at device 4.0 on pci3
mpt0: [GIANT-LOCKED]
mpt0: MPI Version=1.5.12.0
mpt0: mpt_cam_event: 0x16
mpt0: Unhandled Event Notify Frame. Event 0x16 (ACK not required).
mpt0: mpt_cam_event: 0x12
mpt0: Unhandled Event Notify Frame. Event 0x12 (ACK not required).
mpt0: mpt_cam_event: 0x16
mpt0: Unhandled Event Notify Frame. Event 0x16 (ACK not required).
isp0: <Qlogic ISP 2422 PCI FC-AL Adapter> port 0x4100-0x41ff mem
0xe8014000-0xe8014fff irq 20 at device 5.0 on pci3
isp0: [GIANT-LOCKED]
isp0: Board Type 2422, Chip Revision 0x2, loaded F/W Revision 4.0.20
isp1: <Qlogic ISP 2422 PCI FC-AL Adapter> port 0x4200-0x42ff mem
0xe8015000-0xe8015fff irq 21 at device 5.1 on pci3
isp1: [GIANT-LOCKED]
isp1: Board Type 2422, Chip Revision 0x2, loaded F/W Revision 4.0.20
pcib4: <ACPI PCI-PCI bridge> at device 7.0 on pci0
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> at device 8.0 on pci0
pci5: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> at device 9.0 on pci0
pci6: <ACPI PCI bus> on pcib6
pcib7: <ACPI PCI-PCI bridge> at device 10.0 on pci0
pci7: <ACPI PCI bus> on pcib7
pcib8: <ACPI PCI-PCI bridge> at device 11.0 on pci0
pci8: <ACPI PCI bus> on pcib8
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on
acpi0
sio0: type 16550A
pmtimer0 on isa0
orm0: <ISA Option ROM> at iomem 0xc0000-0xcafff on isa0
ata0 at port 0x1f0-0x1f7,0x3f6 irq 14 on isa0
ata1 at port 0x170-0x177,0x376 irq 15 on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
ppc0: parallel port not found.
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
ukbd0: IBM IBM MM2, rev 1.10/0.01, addr 2, iclass 3/1
kbd2 at ukbd0
ums0: IBM IBM MM2, rev 1.10/0.01, addr 2, iclass 3/1
ums0: 3 buttons and Z dir.
Timecounters tick every 2.000 msec
da1 at isp0 bus 0 target 0 lun 0
da1: <IBM 1724-100  FAStT 0542> Fixed Direct Access SCSI-3 device
da1: 100.000MB/s transfers, Tagged Queueing Enabled
da1: 20480MB (41943040 512 byte sectors: 255H 63S/T 2610C)
da2 at isp0 bus 0 target 1 lun 0
da2: <IBM 1724-100  FAStT 0542> Fixed Direct Access SCSI-3 device
da2: 100.000MB/s transfers, Tagged Queueing Enabled
da2: 20480MB (41943040 512 byte sectors: 255H 63S/T 2610C)
da0 at mpt0 bus 0 target 0 lun 0
da0: <IBM-ESXS MAY2073RC T107> Fixed Direct Access SCSI-5 device
da0: 300.000MB/s transfers, Tagged Queueing Enabled
da0: 70006MB (143374000 512 byte sectors: 255H 63S/T 8924C)
SMP: AP CPU #1 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #2 Launched!
GEOM_LABEL: Label for provider da1 is ufs/qservices.
GEOM_LABEL: Label for provider da0s1a is ufs/root.
GEOM_LABEL: Label for provider da0s1b is label/swap.
GEOM_LABEL: Label for provider da0s1d is ufs/usr.
GEOM_LABEL: Label for provider da0s1e is ufs/var.
GEOM_LABEL: Label for provider da0s1f is ufs/home.
GEOM_LABEL: Label for provider da0s1g is ufs/storage.

I'm very grateful for GEOM_LABEL because it saved me a lot of problems
when drive numbers were shifting :)

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 250 bytes
Desc: OpenPGP digital signature
Url : http://lists.freebsd.org/pipermail/freebsd-stable/attachments/20070309/a3286ac2/signature.pgp