lagg/lacp poor traffic distribution

[Eugene Grosbein]

On 21.12.2010 21:57, Fabien Thomas wrote:

>>>>>> 1. Is it a bug or design problem?
>>>>>
>>>>> How many queues have you with igb? If it's one it will explain why the flowid is bad for load balancing with lagg.
>>>>
>>>> How do I know? I've read igb(4) manual page and found no words
>>> vmstat -i will show the queue (intr for the queue) normally it's the number of CPU available.
>>
>> # vmstat -i
>> interrupt                          total       rate
>> irq5: uart2                            8          0
>> irq18: ehci0 uhci5+                    2          0
>> irq19: uhci2 uhci4+                 2182          0
>> irq23: uhci3 ehci1                   124          0
>> cpu0: timer                     39576224       1993
>> irq256: em0:rx 0               115571349       5822
>> irq257: em0:tx 0               136632905       6883
>> irq259: em1:rx 0               115829181       5835
>> irq260: em1:tx 0               138838991       6994
>> irq262: igb0:que 0             157354922       7927
>> irq263: igb0:que 1                577369         29
>> irq264: igb0:que 2                280207         14
>> irq265: igb0:que 3                241826         12
>> irq266: igb0:link                      2          0
>> irq267: igb1:que 0             164620363       8293
>> irq268: igb1:que 1                238678         12
>> irq269: igb1:que 2                248478         12
>> irq270: igb1:que 3                762453         38
>> irq271: igb1:link                      3          0
>> cpu2: timer                     39576052       1993
>> cpu3: timer                     39576095       1993
>> cpu1: timer                     39575913       1993
>> Total                          989503327      49849
>>
>> It seems I have four queues per igb card but only one of them works?
> 
> Yes.
> 
> Jack will certainly confirm but it seems that RSS hash does not seems to take vlan in account and default to queue0 ?

Perhaps, this is the reason I cannot achieve even 133Kpps
at igb0+igb1 grouped to lagg1 ?..
mrtg shows horizontal line for pps graph after input load
reaches 560Mbps for lagg1, and traffic does not grow more too.

Eugene Grosbein