kern/122551: [bge] Broadcom 5715S no carrier on HP BL460c blade
using 6.3-RELEASE
Greg Himes
greg at laaco.net
Tue Apr 8 02:30:05 UTC 2008
>Number: 122551
>Category: kern
>Synopsis: [bge] Broadcom 5715S no carrier on HP BL460c blade using 6.3-RELEASE
>Confidential: no
>Severity: serious
>Priority: medium
>Responsible: freebsd-bugs
>State: open
>Quarter:
>Keywords:
>Date-Required:
>Class: sw-bug
>Submitter-Id: current-users
>Arrival-Date: Tue Apr 08 02:30:04 UTC 2008
>Closed-Date:
>Last-Modified:
>Originator: Greg Himes
>Release: 6.3-RELEASE
>Organization:
CHL Design Group
>Environment:
FreeBSD mail2.laaco.net 6.3-RELEASE FreeBSD 6.3-RELEASE #10: Mon Apr 7 18:19:40 PDT 2008 greg at mail2.laaco.net:/usr/obj/usr/src/sys/LAACO i386
>Description:
This problem appears to be similar to earlier bge problems on IBM blades.
System is an HP c-Class blade chassis using BL460c blades. Each blade has a
dual bce (Broadcom NetXtreme II BCM5708S) interface on-board, along with an
add-on HP NC326m mezzanine board which appears as dual bge (Broadcom NetXtreme
5715S) interfaces.
Both pairs of interfaces connect to HP Virtual Connect Modules to bring the
connections out of the back of the chassis. The bce interfaces work fine,
but the bge interfaces show "no carrier", as shown here in the ifconfig output:
# ifconfig
bce0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
options=3b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU>
ether 00:17:a4:77:00:06
media: Ethernet autoselect (1000baseSX <full-duplex>)
status: active
bce1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
options=3b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU>
ether 00:17:a4:77:00:06
media: Ethernet autoselect (1000baseSX <full-duplex>)
status: active
bge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
options=1b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING>
ether 00:17:a4:77:00:24
media: Ethernet autoselect (none)
status: no carrier
bge1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
options=1b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING>
ether 00:17:a4:77:00:26
media: Ethernet autoselect (none)
status: no carrier
Here is the dmesg info:
FreeBSD 6.3-RELEASE #10: Mon Apr 7 18:19:40 PDT 2008
greg at mail2.laaco.net:/usr/obj/usr/src/sys/LAACO
module_register: module pci/bce already exists!
Module pci/bce failed to register: 17
module_register: module bce/miibus already exists!
Module bce/miibus failed to register: 17
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(R) CPU 5160 @ 3.00GHz (3000.12-MHz 686-class CPU)
Origin = "GenuineIntel" Id = 0x6f6 Stepping = 6
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x4e3bd<SSE3,RSVD2,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA>
AMD Features=0x20000000<LM>
AMD Features2=0x1<LAHF>
Cores per package: 2
real memory = 3487916032 (3326 MB)
avail memory = 3408941056 (3251 MB)
ACPI APIC Table: <HP ProLiant>
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
cpu0 (BSP): APIC ID: 0
cpu1 (AP): APIC ID: 1
cpu2 (AP): APIC ID: 6
cpu3 (AP): APIC ID: 7
ioapic0 <Version 2.0> irqs 0-23 on motherboard
kbd1 at kbdmux0
ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413)
hptrr: HPT RocketRAID controller driver v1.1 (Apr 7 2008 18:19:28)
acpi0: <HP ProLiant> on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x908-0x90b on acpi0
acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 900
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pci4: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> at device 0.0 on pci4
pci5: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> at device 0.0 on pci5
pci6: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> at device 0.0 on pci6
pci7: <ACPI PCI bus> on pcib4
bce0: <Broadcom NetXtreme II BCM5708 1000Base-SX (B2)> mem 0xfa000000-0xfbffffff irq 16 at device 0.0 on pci7
miibus0: <MII bus> on bce0
brgphy0: <BCM5708S 1000/2500BaseSX PHY> on miibus0
brgphy0: 1000baseSX-FDX, auto
bce0: Ethernet address: 00:17:a4:77:00:0a
bce0: ASIC (0x57081021); Rev (B2); Bus (PCI-X, 64-bit, 133MHz); F/W (0x01090605); Flags( )
pcib5: <ACPI PCI-PCI bridge> at device 1.0 on pci5
pci8: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> at device 0.3 on pci4
pci9: <ACPI PCI bus> on pcib6
pcib7: <ACPI PCI-PCI bridge> at device 3.0 on pci0
pci10: <ACPI PCI bus> on pcib7
pcib8: <PCI-PCI bridge> at device 0.0 on pci10
pci11: <PCI bus> on pcib8
pcib9: <PCI-PCI bridge> at device 4.0 on pci11
pci12: <PCI bus> on pcib9
ciss0: <HP Smart Array E200i> port 0x4000-0x40ff mem 0xfdb80000-0xfdbfffff,0xfdb70000-0xfdb77fff irq 18 at device 8.0 on pci11
ciss0: [GIANT-LOCKED]
pcib10: <ACPI PCI-PCI bridge> at device 4.0 on pci0
pci13: <ACPI PCI bus> on pcib10
ciss1: <HP Smart Array P400> port 0x5000-0x50ff mem 0xfdd00000-0xfddfffff,0xfdcf0000-0xfdcf0fff irq 19 at device 0.0 on pci13
ciss1: [GIANT-LOCKED]
pcib11: <ACPI PCI-PCI bridge> at device 5.0 on pci0
pci16: <ACPI PCI bus> on pcib11
pcib12: <ACPI PCI-PCI bridge> at device 0.0 on pci16
pci17: <ACPI PCI bus> on pcib12
bge0: <Broadcom BCM5715 A3, ASIC rev. 0x9003> mem 0xfdef0000-0xfdefffff,0xfdee0000-0xfdeeffff irq 18 at device 4.0 on pci17
bge0: Ethernet address: 00:17:a4:77:00:24
bge1: <Broadcom BCM5715 A3, ASIC rev. 0x9003> mem 0xfded0000-0xfdedffff,0xfdec0000-0xfdecffff irq 19 at device 4.1 on pci17
bge1: Ethernet address: 00:17:a4:77:00:26
pcib13: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci19: <ACPI PCI bus> on pcib13
isp0: <Qlogic ISP 2432 PCI FC-AL Adapter> port 0x6000-0x60ff mem 0xfdff0000-0xfdff3fff irq 19 at device 0.0 on pci19
isp0: [GIANT-LOCKED]
isp0: Board Type 2422, Chip Revision 0x2, resident F/W Revision 4.0.70
isp1: <Qlogic ISP 2432 PCI FC-AL Adapter> port 0x6400-0x64ff mem 0xfdfe0000-0xfdfe3fff irq 16 at device 0.1 on pci19
isp1: [GIANT-LOCKED]
isp1: Board Type 2422, Chip Revision 0x2, resident F/W Revision 4.0.70
pcib14: <ACPI PCI-PCI bridge> at device 7.0 on pci0
pci22: <ACPI PCI bus> on pcib14
pcib15: <ACPI PCI-PCI bridge> at device 28.0 on pci0
pci2: <ACPI PCI bus> on pcib15
pcib16: <ACPI PCI-PCI bridge> at device 0.0 on pci2
pci3: <ACPI PCI bus> on pcib16
bce1: <Broadcom NetXtreme II BCM5708 1000Base-SX (B2)> mem 0xf6000000-0xf7ffffff irq 16 at device 0.0 on pci3
miibus1: <MII bus> on bce1
brgphy1: <BCM5708S 1000/2500BaseSX PHY> on miibus1
brgphy1: 1000baseSX-FDX, auto
bce1: Ethernet address: 00:17:a4:77:00:08
bce1: ASIC (0x57081021); Rev (B2); Bus (PCI-X, 64-bit, 133MHz); F/W (0x01090605); Flags( )
Timecounters tick every 1.000 msec
SMP: AP CPU #1 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #3 Launched!
Here is selected pciconf -lv output:
# pciconf -lv
pcib4 at pci6:0:0: class=0x060400 card=0x00000000 chip=0x01031166 rev=0xc3 hdr=0x01
vendor = 'ServerWorks (Was: Reliance Computer Corp)'
device = 'BCM5715 Broadcom dual gigabit, pci bridge'
class = bridge
subclass = PCI-PCI
bce0 at pci7:0:0: class=0x020000 card=0x703b103c chip=0x16ac14e4 rev=0x12 hdr=0x00
vendor = 'Broadcom Corporation'
device = 'NetXtreme II BCM5708S Gigabit Ethernet'
class = network
subclass = ethernet
pcib8 at pci10:0:0: class=0x060400 card=0x00000000 chip=0x01031166 rev=0xb4 hdr=0x01
vendor = 'ServerWorks (Was: Reliance Computer Corp)'
device = 'BCM5715 Broadcom dual gigabit, pci bridge'
class = bridge
subclass = PCI-PCI
pcib12 at pci16:0:0: class=0x060400 card=0x00000000 chip=0x01031166 rev=0xb5 hdr=0x01
vendor = 'ServerWorks (Was: Reliance Computer Corp)'
device = 'BCM5715 Broadcom dual gigabit, pci bridge'
class = bridge
subclass = PCI-PCI
bge0 at pci17:4:0: class=0x020000 card=0x1707103c chip=0x167914e4 rev=0xa3 hdr=0x00
vendor = 'Broadcom Corporation'
device = 'NetXtreme 5715S Gigabit Ethernet'
class = network
subclass = ethernet
bge1 at pci17:4:1: class=0x020000 card=0x1707103c chip=0x167914e4 rev=0xa3 hdr=0x00
vendor = 'Broadcom Corporation'
device = 'NetXtreme 5715S Gigabit Ethernet'
class = network
subclass = ethernet
pcib16 at pci2:0:0: class=0x060400 card=0x00000000 chip=0x01031166 rev=0xc3 hdr=0x01
vendor = 'ServerWorks (Was: Reliance Computer Corp)'
device = 'BCM5715 Broadcom dual gigabit, pci bridge'
class = bridge
subclass = PCI-PCI
bce1 at pci3:0:0: class=0x020000 card=0x703b103c chip=0x16ac14e4 rev=0x12 hdr=0x00
vendor = 'Broadcom Corporation'
device = 'NetXtreme II BCM5708S Gigabit Ethernet'
class = network
subclass = ethernet
Had same results with HP's 1Gb ethernet pass-thru modules.
Have tried manually setting the interfaces with ifconfig to
1000baseSX full-duplex, but still no carrier.
bge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
options=1b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING>
ether 00:17:a4:77:00:24
media: Ethernet 1000baseSX <full-duplex> (none)
status: no carrier
>How-To-Repeat:
Install HP NC326m mezzanine board on BL460c blade.
Boot 6.3-RELEASE.
Verify status:no carrier with ifconfig
>Fix:
>Release-Note:
>Audit-Trail:
>Unformatted:
More information about the freebsd-bugs
mailing list