huge interrupts on echi0

[Коньков Евгений]

Hello

Proc:                                                            Interrupts
  r   p   d   s   w   Csw  Trp  Sys  Int  Sof  Flt        cow    196k total
  7          54      388k  485 4637 192k  22k             zfod        atkbd0 1
                                                          ozfod  171k ehci0 16
21,1%Sys  77,7%Intr  1,3%User  0,0%Nice  0,0%Idle        %ozfod    35 atapci0 17
|    |    |    |    |    |    |    |    |    |    |       daefr     2 ehci1 23
===========++++++++++++++++++++++++++++++++++++++>        prcfr  4121 cpu0:timer
                                        19 dtbuf        4 totfr  8508 igb0:que 0
Namei     Name-cache   Dir-cache    110674 desvn          react       igb0:link
   Calls    hits   %    hits   %      1297 numvn          pdwak  1586 igb1:que 0
    2631    2631 100                   266 frevn          pdpgs       igb1:link
                                                          intrn 10774 re0 260
Disks   ad4                                        191780 wire
KB/t  15,71                                        184596 act
tps      35                                        158944 inact
MB/s   0,53                                           152 cache
%busy     1                                       1434132 free

# pciconf -l
hostb0 at pci0:0:0:0:      class=0x060000 card=0x110b1565 chip=0x00408086 rev=0x12 hdr=0x00
vgapci0 at pci0:0:2:0:     class=0x030000 card=0x110c1565 chip=0x00428086 rev=0x12 hdr=0x00
ehci0 at pci0:0:26:0:      class=0x0c0320 card=0x31071565 chip=0x3b3c8086 rev=0x06 hdr=0x00
none0 at pci0:0:27:0:      class=0x040300 card=0x82201565 chip=0x3b568086 rev=0x06 hdr=0x00
pcib1 at pci0:0:28:0:      class=0x060400 card=0x31071565 chip=0x3b428086 rev=0x06 hdr=0x01
pcib2 at pci0:0:28:4:      class=0x060400 card=0x31071565 chip=0x3b4a8086 rev=0x06 hdr=0x01
pcib3 at pci0:0:28:5:      class=0x060400 card=0x31071565 chip=0x3b4c8086 rev=0x06 hdr=0x01
ehci1 at pci0:0:29:0:      class=0x0c0320 card=0x31071565 chip=0x3b348086 rev=0x06 hdr=0x00
pcib4 at pci0:0:30:0:      class=0x060401 card=0x31071565 chip=0x244e8086 rev=0xa6 hdr=0x01
isab0 at pci0:0:31:0:      class=0x060100 card=0x31071565 chip=0x3b068086 rev=0x06 hdr=0x00
atapci1 at pci0:0:31:2:    class=0x01018a card=0x52061565 chip=0x3b208086 rev=0x06 hdr=0x00
none1 at pci0:0:31:3:      class=0x0c0500 card=0x31071565 chip=0x3b308086 rev=0x06 hdr=0x00
atapci2 at pci0:0:31:5:    class=0x010185 card=0x52061565 chip=0x3b268086 rev=0x06 hdr=0x00
none2 at pci0:0:31:6:      class=0x118000 card=0x3b328086 chip=0x3b328086 rev=0x06 hdr=0x00
igb0 at pci0:1:0:0:        class=0x020000 card=0xa01c8086 chip=0x10c98086 rev=0x01 hdr=0x00
igb1 at pci0:1:0:1:        class=0x020000 card=0xa01c8086 chip=0x10c98086 rev=0x01 hdr=0x00
re0 at pci0:2:0:0: class=0x020000 card=0x816810ec chip=0x816810ec rev=0x03 hdr=0x00
atapci0 at pci0:3:0:0:     class=0x010185 card=0x2363197b chip=0x2368197b rev=0x00 hdr=0x00


when I use mpd5+ng_car and shape about 50Mbit/s per GRE tunnel and
overall trafic rise to 100Mbit/s echi starts to generate 160K
interrupts. In normal state, when I shape 10Mbit/s per GRE tunnel
 I get this picture:

 Act  203752    5328   511360     7212 1617408  count
All  258988    7220  2668412    16720          pages
Proc:                                                            Interrupts
  r   p   d   s   w   Csw  Trp  Sys  Int  Sof  Flt     42 cow   22329 total
             34       58k  769 2196  18k  18k  552    254 zfod      1 ehci0 16
                                                        5 ozfod    22 atapci0 17
10,8%Sys  24,7%Intr  2,4%User  0,0%Nice 62,1%Idle       1%ozfod     2 ehci1 23
|    |    |    |    |    |    |    |    |    |    |       daefr  4119 cpu0:timer
=====+++++++++++++>                                    67 prcfr  7901 igb0:que 0
                                        32 dtbuf      322 totfr       igb0:link
Namei     Name-cache   Dir-cache    110674 desvn          react  1158 igb1:que 0
   Calls    hits   %    hits   %       935 numvn          pdwak       igb1:link
    4266    3902  91                    97 frevn          pdpgs  9126 re0 260
                                                          intrn
Disks   ad4                                        144100 wire
KB/t  16,00                                        154036 act
tps      22                                         54104 inact
MB/s   0,35                                           192 cache
%busy     1                                       1617216 free

as you can see echi0 does only 1 interrupt....


-- 
С уважением,
 Коньков                          mailto:kes-kes at yandex.ru