kern/72638: 5.3-BETA7 ethernet freezes under load (SMP dual athlon, intel em)

[John Engelhart]

>Number:         72638
>Category:       kern
>Synopsis:       5.3-BETA7 ethernet freezes under load (SMP dual athlon, intel em)
>Confidential:   no
>Severity:       serious
>Priority:       high
>Responsible:    freebsd-bugs
>State:          open
>Quarter:        
>Keywords:       
>Date-Required:
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Wed Oct 13 12:50:26 GMT 2004
>Closed-Date:
>Last-Modified:
>Originator:     John Engelhart
>Release:        5.3-BETA7 on i386 (SMP, intel em)
>Organization:
>Environment:
FreeBSD new.zang.com 5.3-BETA7 FreeBSD 5.3-BETA7 #0: Mon Oct 11 00:12:17 EDT 2004     johne at new.zang.com:/usr/src/sys/i386/compile/new  i386

File system is making use of snapshots.

Tunings of interest:

Scheduler = 4BSD

[kernel options that differ from 5.3-BETA7 GENERIC]

makeoptions     DEBUG=-g
options         MAXDSIZ=(2048UL*1024*1024)
options         MAXSSIZ=(256UL*1024*1024)
options         DFLDSIZ=(1024UL*1024*1024)
options         BLKDEV_IOSIZE=65536
options         PREEMPTION
maxusers        512
options         SHMMAXPGS=32768
options         SHMALL=32768
options         SHMSEG=1024
options         SHMMNI=512
options         SHMMIN=1
options         SEMMNI=256
options         SEMMNS=512
options         SEMMNU=256
options         SEMMAP=25
options         CPU_ATHLON_SSE_HACK
options         CPU_ENABLE_SSE
options         KDB, KDB_UNATTENDED, KDB_TRACE
options         ALT_BREAK_TO_DEBUGGER
options         PANIC_REBOOT_WAIT_TIME=300
options         IPFIREWALL
options         IPFIREWALL_DEFAULT_TO_ACCEPT
options         DUMMYNET
options         IPFILTER
options         IPFILTER_LOG

Kernel is built with -O and CPU is set to athlon-mp via make.conf.

Also, /etc/sysctl.conf has
kern.maxvnodes=262144
net.isr.enable=1

dmesg dump:

Copyright (c) 1992-2004 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD 5.3-BETA7 #0: Mon Oct 11 00:12:17 EDT 2004
    johne at new.zang.com:/usr/src/sys/i386/compile/new
ACPI APIC Table: <PTLTD          APIC  >
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: AMD Athlon(tm) MP 2800+ (2133.42-MHz 686-class CPU)
  Origin = "AuthenticAMD"  Id = 0x6a0  Stepping = 0
  Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
  AMD Features=0xc0480000<MP,AMIE,DSP,3DNow!>
real memory  = 1073217536 (1023 MB)
avail memory = 1040560128 (992 MB)
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
 cpu0 (BSP): APIC ID:  1
 cpu1 (AP): APIC ID:  0
MADT: Forcing active-low polarity and level trigger for SCI
ioapic0 <Version 1.1> irqs 0-23 on motherboard
npx0: [FAST]
npx0: <math processor> on motherboard
npx0: INT 16 interface
acpi0: <PTLTD   RSDT> on motherboard
acpi0: Power Button (fixed)
acpi0: Sleep Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x8008-0x800b on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0x8080-0x80ff,0x8000-0x807f,0xcf8-0xcff iomem 0xd8000-0xdbfff on acpi0
pci0: <ACPI PCI bus> on pcib0
agp0: <AMD 762 host to AGP bridge> port 0x1050-0x1053 mem 0xd0400000-0xd0400fff,0xd4000000-0xd7ffffff at device 0.0 on pci0
pcib1: <ACPI PCI-PCI bridge> at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib1
isab0: <PCI-ISA bridge> at device 7.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <AMD 768 UDMA100 controller> port 0xf000-0xf00f,0x376,0x170-0x177,0x3f6,0x1f0-0x1f7 at device 7.1 on pci0
ata0: channel #0 on atapci0
ata1: channel #1 on atapci0
pci0: <bridge, PCI-unknown> at device 7.3 (no driver attached)
em0: <Intel(R) PRO/1000 Network Connection, Version - 1.7.25> port 0x1000-0x103f mem 0xd0000000-0xd001ffff,0xd0020000-0xd003ffff irq 20 at device 8.0 on pci0
em0: Ethernet address: 00:07:e9:00:f3:c6
em0:  Speed:N/A  Duplex:N/A
pcib2: <ACPI PCI-PCI bridge> at device 16.0 on pci0
pci2: <ACPI PCI bus> on pcib2
pci2: <display, VGA> at device 4.0 (no driver attached)
pcib3: <PCI-PCI bridge> at device 5.0 on pci2
pci3: <PCI bus> on pcib3
asr0: <Adaptec Caching SCSI RAID> mem 0xe0000000-0xefffffff irq 17 at device 5.1 on pci2
asr0: [GIANT-LOCKED]
asr0: ADAPTEC 3210S FW Rev. 370F, 2 channel, 256 CCBs, Protocol I2O
ahc0: <Adaptec 2930CU SCSI adapter> port 0x2400-0x24ff mem 0xd0105000-0xd0105fff irq 18 at device 6.0 on pci2
ahc0: [GIANT-LOCKED]
aic7860: Ultra Single Channel A, SCSI Id=7, 3/253 SCBs
xl0: <3Com 3c905C-TX Fast Etherlink XL> port 0x2800-0x287f mem 0xd0106000-0xd010607f irq 19 at device 8.0 on pci2
miibus0: <MII bus> on xl0
ukphy0: <Generic IEEE 802.3u media interface> on miibus0
ukphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
xl0: Ethernet address: 00:e0:81:21:d9:63
atkbdc0: <Keyboard controller (i8042)> port 0x64,0x60 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
sio0 port 0x3f8-0x3ff irq 4 on acpi0
sio0: type 16550A, console
sio1 port 0x2f8-0x2ff irq 3 on acpi0
sio1: type 16550A
ppc0 port 0x778-0x77f,0x378-0x37f irq 7 drq 3 on acpi0
ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode
ppc0: FIFO with 16/16/9 bytes threshold
ppbus0: <Parallel port bus> on ppc0
plip0: <PLIP network interface> on ppbus0
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
fdc0: <floppy drive controller> port 0x3f7,0x3f0-0x3f5 irq 6 drq 2 on acpi0
fdc0: [FAST]
orm0: <ISA Option ROMs> at iomem 0xe0000-0xe3fff,0xcf800-0xcffff,0xc9800-0xcf7ff,0xc8800-0xc97ff,0xc8000-0xc87ff,0xc0000-0xc7fff on isa0
pmtimer0 on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x100>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 10.000 msec
IP Filter: v3.4.35 initialized.  Default = pass all, Logging = enabled
ipfw2 initialized, divert disabled, rule-based forwarding disabled, default to accept, logging disabled
acd0: CDROM <ATAPI CD-ROM MAX 52X/Ver1.13D> at ata0-master UDMA33
Waiting 15 seconds for SCSI devices to settle
da0 at asr0 bus 0 target 0 lun 0
da0: <ADAPTEC RAID-5 370F> Fixed Direct Access SCSI-2 device 
da0: Tagged Queueing Enabled
da0: 87505MB (179210240 512 byte sectors: 255H 63S/T 11155C)
SMP: AP CPU #1 Launched!
Mounting root from ufs:/dev/da0s1a
Pre-seeding PRNG:
 kickstart
>Description:
>How-To-Repeat:
>Fix:
>Release-Note:
>Audit-Trail:
>Unformatted: