ARP problem with 6.2-STABLE Intel PRO/1000 NIC, latest em driver

Mon Mar 5 17:29:41 UTC 2007

On 3/5/07, Mark Costlow <cheeks at swcp.com> wrote:
> On Mon, Mar 05, 2007 at 08:41:01AM -0800, Jack Vogel wrote:
> > >
> > >Maybe more of your dmesg might help as it could show interrrupt issues
> > >that perhaps others could help diagnose
> >
> > Yes, agreed, this might be revealing.
>
> Here's the full dmesg.  Thanks for looking at this.
>
> ----------------------------
> Copyright (c) 1992-2007 The FreeBSD Project.
> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
>         The Regents of the University of California. All rights reserved.
> FreeBSD is a registered trademark of The FreeBSD Foundation.
> FreeBSD 6.2-STABLE #0: Sun Mar  4 22:40:38 MST 2007
>     root at ame4.swcp.com:/usr/obj/usr/src/sys/GENERIC
> ACPI APIC Table: <PTLTD          APIC  >
> Timecounter "i8254" frequency 1193182 Hz quality 0
> CPU: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz (2000.08-MHz 686-class CPU)
>   Origin = "GenuineIntel"  Id = 0x6f6  Stepping = 6
>   Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,C
> MOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
>   Features2=0x4e33d<SSE3,RSVD2,MON,DS_CPL,VMX,TM2,<b9>,CX16,<b14>,<b15>,<b18>>
>   AMD Features=0x20000000<LM>
>   AMD Features2=0x1<LAHF>
>   Cores per package: 2
> real memory  = 3489005568 (3327 MB)
> avail memory = 3414384640 (3256 MB)
> ioapic0 <Version 2.0> irqs 0-23 on motherboard
> ioapic1 <Version 2.0> irqs 24-47 on motherboard
> kbd1 at kbdmux0
> ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413)
> acpi0: <PTLTD   RSDT> on motherboard
> acpi0: Power Button (fixed)
> Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
> acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0
> cpu0: <ACPI CPU> on acpi0
> acpi_throttle0: <ACPI CPU Throttling> on cpu0
> pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
> pci0: <ACPI PCI bus> on pcib0
> pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
> pci1: <ACPI PCI bus> on pcib1
> pcib2: <ACPI PCI-PCI bridge> irq 16 at device 0.0 on pci1
> pci2: <ACPI PCI bus> on pcib2
> pcib3: <ACPI PCI-PCI bridge> irq 16 at device 0.0 on pci2
> pci3: <ACPI PCI bus> on pcib3
> pcib4: <ACPI PCI-PCI bridge> irq 18 at device 2.0 on pci2
> pci4: <ACPI PCI bus> on pcib4
> em0: <Intel(R) PRO/1000 Network Connection Version - 6.2.9> port 0x2000-0x201f m
> em 0xda000000-0xda01ffff irq 18 at device 0.0 on pci4
> em0: Ethernet address: 00:30:48:8c:71:54
> em1: <Intel(R) PRO/1000 Network Connection Version - 6.2.9> port 0x2020-0x203f m
> em 0xda020000-0xda03ffff irq 19 at device 0.1 on pci4
> em1: Ethernet address: 00:30:48:8c:71:55
> pcib5: <ACPI PCI-PCI bridge> at device 0.3 on pci1
> pci5: <ACPI PCI bus> on pcib5
> 3ware device driver for 9000 series storage controllers, version: 3.60.02.012
> twa0: <3ware 9000 series Storage Controller> port 0x3000-0x303f mem 0xd8000000-0
> xd9ffffff,0xda100000-0xda100fff irq 24 at device 1.0 on pci5
> twa0: [GIANT-LOCKED]
> twa0: INFO: (0x15: 0x1300): Controller details:: Model 9550SX-4LP, 4 ports, Firm
> ware FE9X 3.04.01.011, BIOS BE9X 3.04.00.002
> pci0: <base peripheral> at device 8.0 (no driver attached)
> pcib6: <ACPI PCI-PCI bridge> irq 17 at device 28.0 on pci0
> pci6: <ACPI PCI bus> on pcib6
> uhci0: <UHCI (generic) USB controller> port 0x1800-0x181f irq 17 at device 29.0
> on pci0
> uhci0: [GIANT-LOCKED]
> usb0: <UHCI (generic) USB controller> on uhci0
> usb0: USB revision 1.0
> uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
> uhub0: 2 ports with 2 removable, self powered
> uhci1: <UHCI (generic) USB controller> port 0x1820-0x183f irq 19 at device 29.1
> on pci0
> uhci1: [GIANT-LOCKED]
> usb1: <UHCI (generic) USB controller> on uhci1
> usb1: USB revision 1.0
> uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
> uhub1: 2 ports with 2 removable, self powered
> uhci2: <UHCI (generic) USB controller> port 0x1840-0x185f irq 18 at device 29.2
> on pci0
> uhci2: [GIANT-LOCKED]
> usb2: <UHCI (generic) USB controller> on uhci2
> usb2: USB revision 1.0
> uhub2: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
> uhub2: 2 ports with 2 removable, self powered
> uhci3: <UHCI (generic) USB controller> port 0x1860-0x187f irq 16 at device 29.3
> on pci0
> uhci3: [GIANT-LOCKED]
> usb3: <UHCI (generic) USB controller> on uhci3
> usb3: USB revision 1.0
> uhub3: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
> uhub3: 2 ports with 2 removable, self powered
> ehci0: <EHCI (generic) USB 2.0 controller> mem 0xda600000-0xda6003ff irq 17 at d
> evice 29.7 on pci0
> ehci0: [GIANT-LOCKED]
> usb4: EHCI version 1.0
> usb4: companion controllers, 2 ports each: usb0 usb1 usb2 usb3
> usb4: <EHCI (generic) USB 2.0 controller> on ehci0
> usb4: USB revision 2.0
> uhub4: Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
> uhub4: 8 ports with 8 removable, self powered
> pcib7: <ACPI PCI-PCI bridge> at device 30.0 on pci0
> pci7: <ACPI PCI bus> on pcib7
> pci7: <display, VGA> at device 1.0 (no driver attached)
> isab0: <PCI-ISA bridge> at device 31.0 on pci0
> isa0: <ISA bus> on isab0
> atapci0: <Intel 63XXESB2 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,
> 0x376,0x1880-0x188f at device 31.1 on pci0
> ata0: <ATA channel 0> on atapci0
> ata1: <ATA channel 1> on atapci0
> pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
> acpi_button0: <Power Button> on acpi0
> atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
> atkbd0: <AT Keyboard> irq 1 on atkbdc0
> kbd0 at atkbd0
> atkbd0: [GIANT-LOCKED]
> psm0: <PS/2 Mouse> irq 12 on atkbdc0
> psm0: [GIANT-LOCKED]
> psm0: model Generic PS/2 mouse, device ID 0
> sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
> sio0: type 16550A
> sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0
> sio1: type 16550A
> fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
> fdc0: [FAST]
> ppc0: <ECP parallel printer port> port 0x378-0x37f,0x778-0x77f irq 7 drq 3 on ac
> pi0
> ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode
> ppc0: FIFO with 16/16/9 bytes threshold
> ppbus0: <Parallel port bus> on ppc0
> plip0: <PLIP network interface> on ppbus0
> lpt0: <Printer> on ppbus0
> lpt0: Interrupt-driven port
> ppi0: <Parallel I/O> on ppbus0
> pmtimer0 on isa0
> orm0: <ISA Option ROMs> at iomem 0xc0000-0xcafff,0xcb000-0xcc7ff on isa0
> sc0: <System console> at flags 0x100 on isa0
> sc0: VGA <16 virtual consoles, flags=0x300>
> vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
> rue0: USBKR100 USB 10/100 LAN, rev 1.10/1.00, addr 2
> miibus0: <MII bus> on rue0
> ruephy0: <RealTek RTL8150 internal media interface> on miibus0
> ruephy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
> rue0: Ethernet address: 00:10:60:dd:ed:e9
> rue0: if_start running deferred for Giant
> Timecounter "TSC" frequency 2000078406 Hz quality 800
> Timecounters tick every 1.000 msec
> acd0: CDRW <HL-DT-STCD-RW/DVD-ROM GCC-4244N/B103> at ata0-master UDMA33
> da0 at twa0 bus 0 target 0 lun 0
> da0: <AMCC 9550SX-4LP DISK 3.04> Fixed Direct Access SCSI-3 device
> da0: 100.000MB/s transfers
> da0: 238408MB (488259584 512 byte sectors: 255H 63S/T 30392C)
> da1 at twa0 bus 0 target 1 lun 0
> da1: <AMCC 9550SX-4LP DISK 3.04> Fixed Direct Access SCSI-3 device
> da1: 100.000MB/s transfers
> da1: 238408MB (488259584 512 byte sectors: 255H 63S/T 30392C)
> Trying to mount root from ufs:/dev/da0s1a
> em0: link state changed to UP
> em0: promiscuous mode enabled
> em0: promiscuous mode disabled
> twa0: INFO: (0x04: 0x0029): Verify started: unit=0
> twa0: INFO: (0x04: 0x002B): Verify completed: unit=0
> ----------------------------
>
> This is while booting GENERIC.  I can boot SMP and send that too if you
> suggest.
>
> Here's vmstat -i:
>
> interrupt                          total       rate
> irq1: atkbd0                           2          0
> irq6: fdc0                             3          0
> irq14: ata0                           47          0
> irq16: uhci3                       14836          0
> irq17: uhci0 ehci0                    25          0
> irq18: em0 uhci2                   91850          2
> irq24: twa0                        14828          0
> cpu0: timer                     79015190       1999
> Total                           79136781       2003
>
> Is the fact that em0 and uhci2 are sharing an interrupt significant?

Possibly, but it should work. Could you try a kernel with that defined out?
Secondly, would it be possible to load the latest snapshot of CURRENT
to see how it behaves, it uses MSI and would indicate if this is an
interrupt thing, I still doubt this however.

Look over your docs and see if there's some means to disable system
management, I still think its interfering. I have a group meeting in 10 mins,
I'll check on any known issues with this.

Jack