bge bad performance

[Fleuriot Damien]

On Jan 25, 2013, at 4:56 PM, Daniel Braniss <danny at cs.huji.ac.il> wrote:

>>> On 25 Jan 2013, at 11:45, Daniel Braniss <danny at cs.huji.ac.il> wrote:
>> 
>>> Hi,
>>> It seems that I have more issues with the bge,
>>>    Broadcom NetXtreme Gigabit Ethernet, ASIC rev. 0x5720000
>>> 
>>> ifconfig says:
>>> bge2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 15=00
>>> options=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLA=N_HWTS
>>> O,LINKSTATE>
>>> ether xx...
>>> inet6 xxx prefixlen 64 scopeid 0x3
>>> inet xxx... netmask 0xfffff000 broadcast yyy
>>> nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
>>> media: Ethernet autoselect (1000baseT <full-duplex>)
>>> status: active
>>> 
>>> iperf reports
>>> [  3]  0.0-10.0 sec   230 MBytes   193 Mbits/sec
>>> 
>> 
>> Post your iperf command line and explain the test environment, as in direct connection vs switched network link ?
>> 
> 
> I run iperf -s on the same host for a long time, so not to
> influence the results.
> the network is switched, and I try out several other host to be able to
> a- compare
> b- detect if the network is too busy.
> c- to somehow 'normalize'
> 
> what promped me to check iperf in this case was that tar via NFS started to 
> give
> read timeouts.
> 
> so I run perf -c:
> with 
> dev.bge.2.forced_collapse: 0 or 1
> dev.bge.2.msi: 1
> pe-04> iperf -c minbari
> ------------------------------------------------------------
> Client connecting to minbari, TCP port 5001
> TCP window size:  257 KByte (default)
> ------------------------------------------------------------
> [  3] local 132.65.16.35 port 12835 connected with 132.65.16.212 port 5001
> [ ID] Interval       Transfer     Bandwidth
> [  3]  0.0-10.0 sec   238 MBytes   200 Mbits/sec
> 
> setting:
> dev.bge.2.forced_collapse:1
> dev.bge.2.msi:1
> pe-04> iperf -c minbari
> ------------------------------------------------------------
> Client connecting to minbari, TCP port 5001
> TCP window size:  257 KByte (default)
> ------------------------------------------------------------
> [  3] local 132.65.16.35 port 23207 connected with 132.65.16.212 port 5001
> [ ID] Interval       Transfer     Bandwidth
> [  3]  0.0-10.0 sec   506 MBytes   425 Mbits/sec
> 
> the same command from a similar host, but with bce:
> Client connecting to minbari, TCP port 5001
> TCP window size:  257 KByte (default)
> ------------------------------------------------------------
> [  3] local 132.65.80.2 port 30664 connected with 132.65.16.212 port 5001
> [ ID] Interval       Transfer     Bandwidth
> [  3]  0.0-10.0 sec   976 MBytes   818 Mbits/sec
> 
> In case it's not obvious, all hosts are server class, the network shows no 
> errors,
> neither the hosts.
> 
> cheers
> 	danny


Just did a quick roundup of our boxes and all I've got is bce, re and em interfaces, I won't be able to help you much :(

Try playing with iperf's args, like the buffers and number of // connections ?