FreeBSD 5.3R SMP Kernel not detecting 2nd CPU in a HP DL360(?)

Mon Mar 28 14:15:34 PST 2005

On Mon, Mar 28, 2005 at 09:51:23PM +0100, Greg Eden wrote:
> 
> Hello All,
> 
> I have a co-located HP DL360 G3 server to which I do not have physical  
> access. It has 2 x 2.8GHz Xeon CPUs with HTT. One of the ISP's  
> engineers has confirmed that both CPUs are detected when the BIOS  
> POSTs.
> 
> I have cvsup'd to the latest 5.3R security release and successfully  
> built 'world', something I have done successfully many times with 4.x  
> releases, using the instructions from the handbook. I used a custom  
> kernel configuration which included 'options SMP' and 'device apic'. On  
> reboot dmesg confirmed that the custom kernel was used, however SMP was  
> not active and the additional CPUs were not launched.
> 
> Thinking that perhaps my custom kernel conf was at fault, I compiled a  
> GENERIC smp kernel with:
> 
> # cd /usr/obj
> # chflags -R noschg *
> # rm -rf *
> /usr/src/# make buildkernel KERNCONF=SMP
> /usr/src/# make installkernel KERNCONF=SMP
> 
> After reboot the dmesg output is as follows:
> 
> FreeBSD 5.3-RELEASE-p5 #0: Thu Mar 24 14:37:29 GMT 2005
>     greg@[snip].warprecords.com:/usr/obj/usr/src/sys/SMP
> Timecounter "i8254" frequency 1193182 Hz quality 0
> CPU: Intel(R) Xeon(TM) CPU 2.80GHz (2799.22-MHz 686-class CPU)
>   Origin = "GenuineIntel"  Id = 0xf29  Stepping = 9
>    
> Features=0xbfebf9ff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,SEP,MTRR,PGE,MCA, 
> CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
>   Hyperthreading: 2 logical CPUs
> real memory  = 2147459072 (2047 MB)
> avail memory = 2095996928 (1998 MB)
> npx0: [FAST]
> npx0: <math processor> on motherboard
> npx0: INT 16 interface
> acpi0: <COMPAQ P31> on motherboard
> acpi0: Power Button (fixed)
> Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000
> acpi_timer0: <32-bit timer at 3.579545MHz> port 0x920-0x923 on acpi0
> cpu0: <ACPI CPU> on acpi0
> acpi_tz0: <Thermal Zone> on acpi0
> pcib0: <ACPI Host-PCI bridge> on acpi0
> ACPI link \\_SB_.IN31 has invalid initial irq 3, ignoring
> pci0: <ACPI PCI bus> on pcib0
> pci0: <display, VGA> at device 3.0 (no driver attached)
> ciss0: <Compaq Smart Array 5i> port 0x2800-0x28ff mem  
> 0xf5df0000-0xf5df3fff,0xf5f80000-0xf5fbffff irq 11 at device 4.0 on  
> pci0
> ciss0: [GIANT-LOCKED]
> pci0: <base peripheral> at device 5.0 (no driver attached)
> pci0: <base peripheral> at device 5.2 (no driver attached)
> isab0: <PCI-ISA bridge> at device 15.0 on pci0
> isa0: <ISA bus> on isab0
> atapci0: <ServerWorks CSB5 UDMA100 controller> port  
> 0x2000-0x200f,0x376,0x170-0x177,0x3f6,0x1f0-0x1f7 at device 15.1 on  
> pci0
> ata0: channel #0 on atapci0
> ata1: channel #1 on atapci0
> ohci0: <OHCI (generic) USB controller> mem 0xf5e70000-0xf5e70fff irq 10  
> at device 15.2 on pci0
> ohci0: [GIANT-LOCKED]
> usb0: OHCI version 1.0, legacy support
> usb0: SMM does not respond, resetting
> usb0: <OHCI (generic) USB controller> on ohci0
> usb0: USB revision 1.0
> uhub0: (0x1166) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
> uhub0: 4 ports with 4 removable, self powered
> pcib1: <ACPI Host-PCI bridge> on acpi0
> pci1: <ACPI PCI bus> on pcib1
> bge0: <Broadcom BCM5703 Gigabit Ethernet, ASIC rev. 0x1002> mem  
> 0xf7ef0000-0xf7efffff irq 11 at device 2.0 on pci1
> miibus0: <MII bus> on bge0
> brgphy0: <BCM5703 10/100/1000baseTX PHY> on miibus0
> brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX,  
> 1000baseTX-FDX, auto
> bge0: Ethernet address: 00:11:85:6b:07:d8
> pcib2: <ACPI Host-PCI bridge> on acpi0
> pci4: <ACPI PCI bus> on pcib2
> bge1: <Broadcom BCM5703 Gigabit Ethernet, ASIC rev. 0x1002> mem  
> 0xf7ff0000-0xf7ffffff irq 15 at device 2.0 on pci4
> miibus1: <MII bus> on bge1
> brgphy1: <BCM5703 10/100/1000baseTX PHY> on miibus1
> brgphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX,  
> 1000baseTX-FDX, auto
> bge1: Ethernet address: 00:11:85:6b:07:db
> atkbdc0: <Keyboard controller (i8042)> port 0x64,0x60 irq 1 on acpi0
> atkbd0: <AT Keyboard> irq 1 on atkbdc0
> kbd0 at atkbd0
> atkbd0: [GIANT-LOCKED]
> sio0: <Standard PC COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
> sio0: type 16550A
> fdc0: <floppy drive controller (FDE)> port 0x3f2-0x3f5 irq 6 drq 2 on  
> acpi0
> fdc0: [FAST]
> fd0: <1440-KB 3.5" drive> on fdc0 drive 0
> orm0: <ISA Option ROMs> at iomem  
> 0xee000-0xeffff,0xcc000-0xcd7ff,0xc8000-0xcbfff,0xc0000-0xc7fff on isa0
> pmtimer0 on isa0
> ppc0: parallel port not found.
> sc0: <System console> at flags 0x100 on isa0
> sc0: VGA <16 virtual consoles, flags=0x300>
> sio1: configured irq 3 not in bitmap of probed irqs 0
> sio1: port may not be enabled
> vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on  
> isa0
> Timecounter "TSC" frequency 2799224924 Hz quality 800
> Timecounters tick every 10.000 msec
> acd0: CDROM <CRN-8245B/2.19> at ata0-master PIO4
> da0 at ciss0 bus 0 target 0 lun 0
> da0: <COMPAQ RAID 1  VOLUME OK> Fixed Direct Access SCSI-0 device
> da0: 135.168MB/s transfers
> da0: 69459MB (142253280 512 byte sectors: 255H 32S/T 17433C)
> Mounting root from ufs:/dev/da0s1a
> 
> and
> 
> ~> sysctl kern.smp.active
> kern.smp.active: 0
> 
> I just don't understand why the kernel isn't running SMP. To my mind  
> it's either something in my method (most likely), a hardware problem,  
> or something odd in the way 5.3R detects the CPUs on the hardware.
> 
> I have successfully compiled SMP kernels on identical hardware with  
> FreeBSD 4.8R. With the HTT 4 CPUs are launched as they should be here.
> 
> Now I think about it I have another machine, a HP DL380 with a single  
> HTT Xeon processor, which is displaying the same problem.
> 
> Thanks in advance.
> 
> greg.

DL380 g3 have build in iLO. Can your colo hookup that ethernet? That will
allow you console access including power on/off, reset and you will
be able to see faults (fan, power supply, etc.).

I have a DL380 g3 with dual P4-3.2GHz 1MB L3 cache, the kern conf has
just "options SMP" to make it work. Here is the top part and bottom part
of dmesg from boot:

Copyright (c) 1992-2005 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD 5.3-STABLE #0: Sun Feb 20 17:42:41 PST 2005
    root at evil.alameda.net:/usr/obj/usr/src/sys/EVIL
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(TM) CPU 3.20GHz (3183.19-MHz 686-class CPU)
  Origin = "GenuineIntel"  Id = 0xf25  Stepping = 5
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,>
  Hyperthreading: 2 logical CPUs
real memory  = 4026507264 (3839 MB)
avail memory = 3941990400 (3759 MB)
ACPI APIC Table: <COMPAQ 00000083>
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  6
MADT: Forcing active-low polarity and level trigger for SCI
ioapic0 <Version 1.1> irqs 0-15 on motherboard
ioapic1 <Version 1.1> irqs 16-31 on motherboard
ioapic2 <Version 1.1> irqs 32-47 on motherboard
ioapic3 <Version 1.1> irqs 48-63 on motherboard
npx0: <math processor> on motherboard
npx0: INT 16 interface
acpi0: <COMPAQ P29> on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x920-0x923 on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0

...

SMP: AP CPU #1 Launched!

...

kern.smp.active: 1
kern.smp.disabled: 0
kern.smp.cpus: 2

This box was running 5.2.1 before so I am very sure SMP will work on it.

-- 
Regards, Ulf.

---------------------------------------------------------------------
Ulf Zimmermann, 1525 Pacific Ave., Alameda, CA-94501, #: 510-865-0204
You can find my resume at: http://seven.Alameda.net/~ulf/resume.html