[Fwd: Re: bge Ierr rate increase from 5.3R -> 6.1R]

Robin Gruyters r.gruyters at yirdis.nl
Tue Feb 6 12:44:06 UTC 2007


Ok, I have patched and rebuild the kernel. Looks ok now.

Here some info:

media 100baseTX mediaopt full-duplex
serverA (Broadcom BCM5705K) <192.168.254.1/30> (iperf server)
serverB (Broadcom BCM5704) <192.168.254.2/30> (iperf client)

# iperf -c 192.168.254.1 -t 60 -i 5
------------------------------------------------------------
Client connecting to 192.168.254.1, TCP port 5001
TCP window size: 32.5 KByte (default)
------------------------------------------------------------
[  3] local 192.168.254.2 port 56356 connected with 192.168.254.1 port 5001
[  3]  0.0- 5.0 sec  55.1 MBytes  92.4 Mbits/sec
[  3]  5.0-10.0 sec  55.8 MBytes  93.7 Mbits/sec
[  3] 10.0-15.0 sec  54.0 MBytes  90.6 Mbits/sec
[  3] 15.0-20.0 sec  55.7 MBytes  93.5 Mbits/sec
[  3] 20.0-25.0 sec  55.7 MBytes  93.4 Mbits/sec
[  3] 25.0-30.0 sec  53.9 MBytes  90.4 Mbits/sec
[  3] 30.0-35.0 sec  55.8 MBytes  93.6 Mbits/sec
[  3] 35.0-40.0 sec  56.0 MBytes  93.9 Mbits/sec
[  3] 40.0-45.0 sec  55.8 MBytes  93.5 Mbits/sec
[  3] 45.0-50.0 sec  54.9 MBytes  92.2 Mbits/sec
[  3] 50.0-55.0 sec  56.0 MBytes  93.9 Mbits/sec
[  3] 55.0-60.0 sec  55.5 MBytes  93.2 Mbits/sec
[  3]  0.0-60.0 sec    664 MBytes  92.9 Mbits/sec

[netstat -ni -f link]
bge1   1500 <Link#6>      00:12:79:94:ed:11   756917     0   971564     
  0     0
[/end]


media 1000baseTX mediaopt full-duplex
serverA (Broadcom BCM5705K) <192.168.254.1/30> (iperf server)
serverB (Broadcom BCM5704) <192.168.254.2/30> (iperf client)

iperf -c 192.168.254.1 -t 60 -i 5
------------------------------------------------------------
Client connecting to 192.168.254.1, TCP port 5001
TCP window size: 32.5 KByte (default)
------------------------------------------------------------
[  3] local 192.168.254.2 port 56295 connected with 192.168.254.1 port 5001
[  3]  0.0- 5.0 sec    275 MBytes    461 Mbits/sec
[  3]  5.0-10.0 sec    291 MBytes    488 Mbits/sec
[  3] 10.0-15.0 sec    291 MBytes    488 Mbits/sec
[  3] 15.0-20.0 sec    271 MBytes    454 Mbits/sec
[  3] 20.0-25.0 sec    288 MBytes    484 Mbits/sec
[  3] 25.0-30.0 sec    291 MBytes    489 Mbits/sec
[  3] 30.0-35.0 sec    281 MBytes    471 Mbits/sec
[  3] 35.0-40.0 sec    290 MBytes    487 Mbits/sec
[  3] 40.0-45.0 sec    291 MBytes    489 Mbits/sec
[  3] 45.0-50.0 sec    290 MBytes    486 Mbits/sec
[  3] 50.0-55.0 sec    258 MBytes    434 Mbits/sec
[  3] 55.0-60.0 sec    287 MBytes    482 Mbits/sec
[  3]  0.0-60.0 sec  3.33 GBytes    476 Mbits/sec

[netstat -ni -f link]
bge1   1500 <Link#6>      00:12:79:94:ed:11  2342915     0  3433038     
  0     0
[/end]


Regards,

Robin Gruyters
Network and Security Engineer
Yirdis B.V.
I: http://yirdis.com
P: +31 (0)36 5300394
F: +31 (0)36 5489119


Quoting Oleg Bulyzhin <oleg at freebsd.org>:

> On Thu, Jan 25, 2007 at 05:05:32PM +0100, Robin Gruyters wrote:
>> On 13-Jan-2007 Oleg Bulyzhin wrote:
>> >
>> >> Could you please test attached patch? It should fix ierrs issue
>> >and should not
>> >> break link events (would be fine to test it: unplug/plug cable,
>> >try to change
>> >> media with ifconfig, change media on other end of wire).
>> >>
>> Hi ya,
>>
>> Just wondering will this patch/update be available for RELENG_6? I
>> have the same problems here with 3 of our servers.
>>
>> Here is dmesg from our development server:
>>
>> [...]
>> Copyright (c) 1992-2007 The FreeBSD Project.
>> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
>>         The Regents of the University of California. All rights reserved.
>> FreeBSD is a registered trademark of The FreeBSD Foundation.
>> FreeBSD 6.2-RELEASE #1: Mon Jan 15 15:34:19 CET 2007
>>     root at server.yirdis.net:/data/obj/data/src_6_2/sys/YIRDIS
>> Timecounter "i8254" frequency 1193182 Hz quality 0
>> CPU: Intel(R) Xeon(TM) CPU 3.00GHz (3000.12-MHz 686-class CPU)
>>   Origin = "GenuineIntel"  Id = 0xf41  Stepping = 1
>>
>> Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
>>   Features2=0x641d<SSE3,RSVD2,MON,DS_CPL,CNTX-ID,CX16,<b14>>
>>   AMD Features=0x20000000<LM>
>>   Logical CPUs per core: 2
>> real memory  = 2147430400 (2047 MB)
>> avail memory = 2100547584 (2003 MB)
>> ACPI APIC Table: <HP     00000083>
>> Security auditing service present
>> BSM auditing present
>> ioapic1: Changing APIC ID to 9
>> ioapic0 <Version 2.0> irqs 0-23 on motherboard
>> ioapic1 <Version 2.0> irqs 24-47 on motherboard
>> ioapic2 <Version 2.0> irqs 48-71 on motherboard
>> ioapic3 <Version 2.0> irqs 72-95 on motherboard
>> acpi0: <HP P52> on motherboard
>> acpi0: Power Button (fixed)
>> Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000
>> acpi_timer0: <24-bit timer at 3.579545MHz> port 0x908-0x90b on acpi0
>> cpu0: <ACPI CPU> on acpi0
>> pcib0: <ACPI Host-PCI bridge> on acpi0
>> pci0: <ACPI PCI bus> on pcib0
>> pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
>> pci13: <ACPI PCI bus> on pcib1
>> pcib2: <ACPI PCI-PCI bridge> at device 4.0 on pci0
>> pci6: <ACPI PCI bus> on pcib2
>> pcib3: <ACPI PCI-PCI bridge> at device 0.0 on pci6
>> pci7: <ACPI PCI bus> on pcib3
>> pcib4: <ACPI PCI-PCI bridge> at device 0.2 on pci6
>> pci10: <ACPI PCI bus> on pcib4
>> pcib5: <PCI-PCI bridge> at device 1.0 on pci10
>> pci11: <PCI bus> on pcib5
>> ste0: <D-Link DL10050 10/100BaseTX> port 0x5000-0x507f irq 72 at
>> device 4.0 on pci11
>> miibus0: <MII bus> on ste0
>> ukphy0: <Generic IEEE 802.3u media interface> on miibus0
>> ukphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
>> ste0: Ethernet address: 00:0d:88:fc:c8:cc
>> ste1: <D-Link DL10050 10/100BaseTX> port 0x5080-0x50ff irq 73 at
>> device 5.0 on pci11
>> miibus1: <MII bus> on ste1
>> ukphy1: <Generic IEEE 802.3u media interface> on miibus1
>> ukphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
>> ste1: Ethernet address: 00:0d:88:fc:c8:cd
>> ste2: <D-Link DL10050 10/100BaseTX> port 0x5400-0x547f irq 74 at
>> device 6.0 on pci11
>> miibus2: <MII bus> on ste2
>> ukphy2: <Generic IEEE 802.3u media interface> on miibus2
>> ukphy2:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
>> ste2: Ethernet address: 00:0d:88:fc:c8:ce
>> ste3: <D-Link DL10050 10/100BaseTX> port 0x5480-0x54ff irq 75 at
>> device 7.0 on pci11
>> miibus3: <MII bus> on ste3
>> ukphy3: <Generic IEEE 802.3u media interface> on miibus3
>> ukphy3:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
>> ste3: Ethernet address: 00:0d:88:fc:c8:cf
>> pcib6: <ACPI PCI-PCI bridge> at device 6.0 on pci0
>> pci3: <ACPI PCI bus> on pcib6
>> pcib7: <ACPI PCI-PCI bridge> at device 28.0 on pci0
>> pci2: <ACPI PCI bus> on pcib7
>> ciss0: <HP Smart Array 6i> port 0x4000-0x40ff mem
>> 0xfdff0000-0xfdff1fff,0xfdf80000-0xfdfbffff irq 24 at device 1.0 on pci2
>> ciss0: [GIANT-LOCKED]
>> bge0: <Broadcom BCM5704 B0, ASIC rev. 0x2100> mem
>> 0xfdf70000-0xfdf7ffff irq 25 at device 2.0 on pci2
>> miibus4: <MII bus> on bge0
>> brgphy0: <BCM5704 10/100/1000baseTX PHY> on miibus4
>> brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX,
>> 1000baseTX-FDX, auto
>> bge0: Ethernet address: 00:12:79:94:ed:12
>> bge1: <Broadcom BCM5704 B0, ASIC rev. 0x2100> mem
>> 0xfdf60000-0xfdf6ffff irq 26 at device 2.1 on pci2
>> miibus5: <MII bus> on bge1
>> brgphy1: <BCM5704 10/100/1000baseTX PHY> on miibus5
>> brgphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX,
>> 1000baseTX-FDX, auto
>> bge1: Ethernet address: 00:12:79:94:ed:11
>> pci0: <serial bus, USB> at device 29.0 (no driver attached)
>> pci0: <serial bus, USB> at device 29.1 (no driver attached)
>> pci0: <base peripheral> at device 29.4 (no driver attached)
>> pci0: <base peripheral, interrupt controller> at device 29.5 (no
>> driver attached)
>> pci0: <serial bus, USB> at device 29.7 (no driver attached)
>> pcib8: <ACPI PCI-PCI bridge> at device 30.0 on pci0
>> pci1: <ACPI PCI bus> on pcib8
>> pci1: <display, VGA> at device 3.0 (no driver attached)
>> pci1: <base peripheral> at device 4.0 (no driver attached)
>> pci1: <base peripheral> at device 4.2 (no driver attached)
>> isab0: <PCI-ISA bridge> at device 31.0 on pci0
>> isa0: <ISA bus> on isab0
>> atapci0: <Intel 6300ESB UDMA100 controller> port
>> 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x500-0x50f irq 18 at device 31.1
>> on pci0
>> ata0: <ATA channel 0> on atapci0
>> ata1: <ATA channel 1> on atapci0
>> acpi_tz0: <Thermal Zone> on acpi0
>> atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
>> atkbd0: <AT Keyboard> irq 1 on atkbdc0
>> kbd0 at atkbd0
>> atkbd0: [GIANT-LOCKED]
>> psm0: <PS/2 Mouse> irq 12 on atkbdc0
>> psm0: [GIANT-LOCKED]
>> psm0: model IntelliMouse Explorer, device ID 4
>> sio0: <Standard PC COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
>> sio0: type 16550A
>> fdc0: <floppy drive controller (FDE)> port 0x3f2-0x3f5 irq 6 drq 2 on acpi0
>> fdc0: [FAST]
>> fd0: <1440-KB 3.5" drive> on fdc0 drive 0
>> pmtimer0 on isa0
>> orm0: <ISA Option ROMs> at iomem
>> 0xc0000-0xc7fff,0xc8000-0xcbfff,0xee000-0xeffff on isa0
>> sc0: <System console> at flags 0x100 on isa0
>> sc0: VGA <16 virtual consoles, flags=0x300>
>> sio1 at port 0x2f8-0x2ff irq 3 on isa0
>> sio1: type 16550A
>> vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
>> Timecounter "TSC" frequency 3000124702 Hz quality 800
>> Timecounters tick every 1.000 msec
>> acd0: CDROM <COMPAQ CD-ROM SN-124/N104> at ata0-master PIO4
>> da0 at ciss0 bus 0 target 0 lun 0
>> da0: <COMPAQ RAID 1  VOLUME OK> Fixed Direct Access SCSI-0 device
>> da0: 135.168MB/s transfers
>> da0: 69459MB (142253280 512 byte sectors: 255H 32S/T 17433C)
>> Trying to mount root from ufs:/dev/da0s1a
>> Accounting enabled
>> [...]
>>
>> And here the netstat interface statistics:
>> [...]
>> Name    Mtu Network       Address              Ipkts Ierrs    Opkts
>> Oerrs  Coll
>> ste0*  1500 <Link#1>      00:0d:88:fc:c8:cc        0     0        0
>>  0     0
>> ste1*  1500 <Link#2>      00:0d:88:fc:c8:cd        0     0        0
>>  0     0
>> ste2*  1500 <Link#3>      00:0d:88:fc:c8:ce        0     0        0
>>  0     0
>> ste3*  1500 <Link#4>      00:0d:88:fc:c8:cf        0     0        0
>>  0     0
>> bge0   1500 <Link#5>      00:12:79:94:ed:12 11343768 2114510 20564242
>>    0     0
>> bge1*  1500 <Link#6>      00:12:79:94:ed:11        0     0        0
>>  0     0
>> pflog 33208 <Link#7>                               0     0        0
>>  0     0
>> lo0   16384 <Link#8>                        60221421     0 60221421
>>  0     0
>> [...]
>>
>> If you have a patch for FreeBSD 6.2, i'm quite happily to test it on
>> our development server.
>>
>> Regards,
>>
>> Robin Gruyters
>>
>
> Sorry for the late reply - i was AFK for some time and didnt read mails.
> Patch against 6.2R attached, please let me know does it helps or not.
>
> --
> Oleg.
>
> ================================================================
> === Oleg Bulyzhin -- OBUL-RIPN -- OBUL-RIPE -- oleg at rinet.ru ===
> ================================================================
>
>




More information about the freebsd-net mailing list