fxp0: device timed out problem

[Ganbold]

At 10:29 PM 1/23/2005, you wrote:
>On Mon, 10 Jan 2005, Ganbold wrote:
>
> > I'm having trouble on FreeBSD 5.3 with squid-2.5.7. Squid installed from
> > ports collection.
> >
> > cache4# uname -an
> > FreeBSD cache4.micom.mng.net 5.3-STABLE FreeBSD 5.3-STABLE #2: Wed Dec 15
> > 18:26:14 ULAT
> > 2004     tsgan at cache4.micom.mng.net:/usr/obj/usr/src/sys/CACHEK  i386
> >
> > After few hours machine hangs and stops responding saying following
> > error:
> >
> > fxp0: device timed out.
> >
> > I turned off debug.mpsafenet to 0 and it seems like problem goes away.
><snip>
> > Is this problem related to network stack? Or is it related to fxp driver?
>
>It's most likely a problem with the device driver or interrupt
>configuration on your system.  There are a couple of other variables you
>might try frobbing:
>
>- Use of ACPI to configure the hardware
>- Use of "device apic" if the system is non-SMP

I see. One of the server is SMP system and device apic option is used in 
kernel
config file. I didn't try device apic on non-SMP machine.

>Usually a device timed out error is related to interrupts from the device
>not being delivered, being delivered improperly, etc.  Does your dmesg
>contain any references to interrupt storms?  Once the above message has
>printed, do you see any further interrupts on the fxp interrupt source
>when checking intermittently with "systat -vmstat 1" or "vmstat -i"?

I couldn't check the system by issuing those commands.
Following is the dmesg output with debug.mpsafenet disabled:

Dec 30 16:53:31 202.179.3.178 kernel: fxp0: device timeout
Dec 30 17:54:58 202.179.3.178 syslogd: kernel boot file is /boot/kernel/kernel
Dec 30 17:54:58 202.179.3.178 kernel: Copyright (c) 1992-2004 The FreeBSD 
Project.
Dec 30 17:54:58 202.179.3.178 kernel: Copyright (c) 1979, 1980, 1983, 1986, 
1988, 1989, 1991, 1992, 1993, 1994
Dec 30 17:54:58 202.179.3.178 kernel: The Regents of the University of 
California. All rights reserved.
Dec 30 17:54:58 202.179.3.178 kernel: FreeBSD 5.3-STABLE #2: Wed Dec 15 
18:26:14 ULAT 2004
Dec 30 17:54:58 202.179.3.178 kernel: 
tsgan at cache4.micom.mng.net:/usr/obj/usr/src/sys/CACHEK
Dec 30 17:54:58 202.179.3.178 kernel: WARNING: MPSAFE network stack 
disabled, expect reduced performance.
Dec 30 17:54:58 202.179.3.178 kernel: Timecounter "i8254" frequency 1193182 
Hz quality 0
Dec 30 17:54:58 202.179.3.178 kernel: CPU: Intel Pentium III (1000.04-MHz 
686-class CPU)
Dec 30 17:54:58 202.179.3.178 kernel: Origin = "GenuineIntel"  Id = 
0x68a  Stepping = 10
Dec 30 17:54:58 202.179.3.178 kernel: 
Features=0x387fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE
36,PN,MMX,FXSR,SSE>
Dec 30 17:54:58 202.179.3.178 kernel: real memory  = 536805376 (511 MB)
Dec 30 17:54:58 202.179.3.178 kernel: avail memory = 519700480 (495 MB)
Dec 30 17:54:58 202.179.3.178 kernel: npx0: [FAST]
Dec 30 17:54:58 202.179.3.178 kernel: npx0: <math processor> on motherboard
Dec 30 17:54:58 202.179.3.178 kernel: npx0: INT 16 interface
Dec 30 17:54:58 202.179.3.178 kernel: acpi0: <HP HWPC20F> on motherboard
Dec 30 17:54:58 202.179.3.178 kernel: acpi0: Power Button (fixed)
Dec 30 17:54:58 202.179.3.178 kernel: unknown: I/O range not supported
Dec 30 17:54:58 202.179.3.178 kernel: can't fetch resources for 
\_SB_.PCI0.ISA_.SIO_.LPT_ - AE_AML_INVALID_RESOURCE_TYPE
Dec 30 17:54:58 202.179.3.178 kernel: Timecounter "ACPI-safe" frequency 
3579545 Hz quality 1000
Dec 30 17:54:58 202.179.3.178 kernel: acpi_timer0: <32-bit timer at 
3.579545MHz> port 0x1208-0x120b on acpi0
Dec 30 17:54:58 202.179.3.178 kernel: cpu0: <ACPI CPU> on acpi0
Dec 30 17:54:58 202.179.3.178 kernel: pcib0: <ACPI Host-PCI bridge> port 
0xcf8-0xcff on acpi0
Dec 30 17:54:58 202.179.3.178 kernel: ACPI link \_SB_.PCI0.ISA_.LNKU has 
invalid initial irq 10, ignoring
Dec 30 17:54:58 202.179.3.178 kernel: pci0: <ACPI PCI bus> on pcib0
Dec 30 17:54:58 202.179.3.178 kernel: fxp0: <Intel 82559 Pro/100 Ethernet> 
port 0x1800-0x183f mem 0xfd000000-0xfd0fffff,0xfd10
0000-0xfd100fff irq 11 at device 2.0 on pci0
Dec 30 17:54:58 202.179.3.178 kernel: miibus0: <MII bus> on fxp0
Dec 30 17:54:58 202.179.3.178 kernel: inphy0: <i82555 10/100 media 
interface> on miibus0
Dec 30 17:54:58 202.179.3.178 kernel: inphy0:  10baseT, 10baseT-FDX, 
100baseTX, 100baseTX-FDX, auto
Dec 30 17:54:58 202.179.3.178 kernel: fxp0: Ethernet address: 00:e0:18:47:22:2f
Dec 30 17:54:58 202.179.3.178 kernel: fxp0: [GIANT-LOCKED]
Dec 30 17:54:58 202.179.3.178 kernel: pci0: <display, VGA> at device 7.0 
(no driver attached)
Dec 30 17:54:58 202.179.3.178 kernel: isab0: <PCI-ISA bridge> port 
0x1040-0x104f at device 15.0 on pci0
Dec 30 17:54:58 202.179.3.178 kernel: isa0: <ISA bus> on isab0
Dec 30 17:54:58 202.179.3.178 kernel: atapci0: <ServerWorks ROSB4 UDMA33 
controller> port 0x1840-0x184f,0x376,0x170-0x177,0x3f
6,0x1f0-0x1f7 at device 15.1 on pci0
Dec 30 17:54:58 202.179.3.178 kernel: ata0: channel #0 on atapci0
Dec 30 17:54:58 202.179.3.178 kernel: ata1: channel #1 on atapci0
Dec 30 17:54:58 202.179.3.178 kernel: ohci0: <OHCI (generic) USB 
controller> mem 0xfd102000-0xfd102fff irq 5 at device 15.2 on
  pci0
Dec 30 17:54:58 202.179.3.178 kernel: ohci0: [GIANT-LOCKED]
Dec 30 17:54:58 202.179.3.178 kernel: usb0: OHCI version 1.0, legacy support
Dec 30 17:54:58 202.179.3.178 kernel: usb0: <OHCI (generic) USB controller> 
on ohci0
Dec 30 17:54:58 202.179.3.178 kernel: usb0: USB revision 1.0
Dec 30 17:54:58 202.179.3.178 kernel: uhub0: (0x1166) OHCI root hub, class 
9/0, rev 1.00/1.00, addr 1
Dec 30 17:54:58 202.179.3.178 kernel: uhub0: 2 ports with 2 removable, self 
powered
Dec 30 17:54:58 202.179.3.178 kernel: pcib1: <ACPI Host-PCI bridge> on acpi0
Dec 30 17:54:58 202.179.3.178 kernel: pci5: <ACPI PCI bus> on pcib1
Dec 30 17:54:58 202.179.3.178 kernel: ncr0: <ncr 53c896 fast40 wide scsi> 
port 0x1c00-0x1cff mem 0xfd110000-0xfd111fff,0xfd112
000-0xfd1123ff irq 5 at device 5.0 on pci5
Dec 30 17:54:58 202.179.3.178 kernel: ncr0: failed: rid 0x18 is ioport, 
requested 3
Dec 30 17:54:58 202.179.3.178 kernel: ncr0: [GIANT-LOCKED]
Dec 30 17:54:58 202.179.3.178 kernel: ncr1: <ncr 53c896 fast40 wide scsi> 
port 0x2000-0x20ff mem 0xfd114000-0xfd115fff,0xfd112
400-0xfd1127ff irq 9 at device 5.1 on pci5
Dec 30 17:54:58 202.179.3.178 kernel: ncr1: failed: rid 0x18 is ioport, 
requested 3
Dec 30 17:54:58 202.179.3.178 kernel: ncr1: [GIANT-LOCKED]
Dec 30 17:54:58 202.179.3.178 kernel: atkbdc0: <Keyboard controller 
(i8042)> port 0x64,0x60 irq 1 on acpi0
Dec 30 17:54:58 202.179.3.178 kernel: atkbd0: <AT Keyboard> irq 1 on atkbdc0
Dec 30 17:54:58 202.179.3.178 kernel: kbd0 at atkbd0
Dec 30 17:54:58 202.179.3.178 kernel: atkbd0: [GIANT-LOCKED]
Dec 30 17:54:58 202.179.3.178 kernel: sio0: <16550A-compatible COM port> 
port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
Dec 30 17:54:58 202.179.3.178 kernel: sio0: type 16550A
Dec 30 17:54:58 202.179.3.178 kernel: sio1: <16550A-compatible COM port> 
port 0x2f8-0x2ff irq 3 on acpi0
Dec 30 17:54:58 202.179.3.178 kernel: sio1: type 16550A
Dec 30 17:54:58 202.179.3.178 kernel: fdc0: <floppy drive controller> port 
0x3f7,0x3f0-0x3f5 irq 6 drq 2 on acpi0
Dec 30 17:54:58 202.179.3.178 kernel: fdc0: [FAST]
Dec 30 17:54:58 202.179.3.178 kernel: fd0: <1440-KB 3.5" drive> on fdc0 drive 0
Dec 30 17:54:58 202.179.3.178 kernel: orm0: <ISA Option ROMs> at iomem 
0xca800-0xce7ff,0xc0000-0xca7ff on isa0
Dec 30 17:54:58 202.179.3.178 kernel: sc0: <System console> at flags 0x100 
on isa0
Dec 30 17:54:58 202.179.3.178 kernel: sc0: VGA <16 virtual consoles, 
flags=0x300>
Dec 30 17:54:58 202.179.3.178 kernel: vga0: <Generic ISA VGA> at port 
0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Dec 30 17:54:58 202.179.3.178 kernel: Timecounter "TSC" frequency 
1000043050 Hz quality 800
Dec 30 17:54:58 202.179.3.178 kernel: Timecounters tick every 10.000 msec
Dec 30 17:54:58 202.179.3.178 kernel: ipfw2 initialized, divert enabled, 
rule-based forwarding enabled, default to accept, log
ging limited to 100 packets/entry by default
Dec 30 17:54:58 202.179.3.178 kernel: acd0: CDROM <LTN486S/YKS4> at 
ata0-master PIO4
Dec 30 17:54:58 202.179.3.178 kernel: Waiting 15 seconds for SCSI devices 
to settle
Dec 30 17:54:58 202.179.3.178 kernel: da1 at ncr0 bus 0 target 1 lun 0
Dec 30 17:54:58 202.179.3.178 kernel: da1: <HP 18.2G ST318406LW HP03> Fixed 
Direct Access SCSI-2 device
Dec 30 17:54:58 202.179.3.178 kernel: da1: 40.000MB/s transfers (20.000MHz, 
offset 31, 16bit), Tagged Queueing Enabled
Dec 30 17:54:58 202.179.3.178 kernel: da1: 17366MB (35566480 512 byte 
sectors: 255H 63S/T 2213C)
Dec 30 17:54:58 202.179.3.178 kernel: da0 at ncr0 bus 0 target 0 lun 0
Dec 30 17:54:58 202.179.3.178 kernel: da0: <HP 18.2G ST318406LW HP03> Fixed 
Direct Access SCSI-2 device
Dec 30 17:54:58 202.179.3.178 kernel: da0: 40.000MB/s transfers (20.000MHz, 
offset 31, 16bit), Tagged Queueing Enabled
Dec 30 17:54:58 202.179.3.178 kernel: da0: 17366MB (35566480 512 byte 
sectors: 255H 63S/T 2213C)
Dec 30 17:54:58 202.179.3.178 kernel: Mounting root from ufs:/dev/da0s1a

I didn't do much investigation on those servers that time. However without 
debug.mpsafenet, servers are working
fine for more than 3 weeks.

Ganbold


>Robert N M Watson
>
>
>_______________________________________________
>freebsd-current at freebsd.org mailing list
>http://lists.freebsd.org/mailman/listinfo/freebsd-current
>To unsubscribe, send any mail to "freebsd-current-unsubscribe at freebsd.org"