7.1-STABLE Sun Mar 29 01:06:46 ADT 2009 Locks up ...

[Marc G. Fournier]

On Tue, 28 Apr 2009, Gavin Atkinson wrote:

> On Fri, 2009-04-24 at 20:39 +0200, Martin Schmidt wrote:
>> Hi Marc and List,
>>
>> i had similar issues with FreeBSD 7.2-PRERELEASE. Server (zfs,nfs)
>> seems to hang in intervals of about 8 hours.
>> kernel is still there but no connections can be made to nfs/ssh and
>> login on local console doesn't seem to
>> work due to incredible slowness. breaking to the debugger takes a
>> moment but works.
>> (compiling kernel with WITNESS didnt help)
>>
>> the server had been solid before with 7 stable kernel from around 19
>> October 2008.
>>
>> I now added these lines to /boot/loader.conf
>>
>> hw.pci.enable_msi=0
>> hw.pci.enable_msix=0
>>
>> to disable Message Signaled Interrupts. Which are used by the 3ware
>> twa driver and igb network driver on our server.
>
> If you are willing to test further on your server, it may be helpful if
> you could determine which of those two lines in loader.conf fixes the
> problem for you.  It would also be useful to provide a dmesg from the
> machine when both msi and msix are enabled.
>
> FWIW, looking at the "vmstat -i" output it appears that only the igb
> driver that are using MSI/MSIX, unless you have a reason to suspect
> otherwise?

How do you tell that, about igb?  looking at the server I have the igb 
device on, it doesn't seem to say anything about that ...

# vmstat -i
interrupt                          total       rate
irq1: atkbd0                         162          0
irq30: twa0                    402647215        187
cpu0: timer                   4284778818       1999
irq256: igb0                  1282945461        598
irq257: igb0                   215507100        100
irq258: igb0                   417702261        194
irq259: igb0                   314601966        146
irq260: igb0                   568062067        265
irq261: igb0                           3          0
cpu5: timer                   4284744445       1999
cpu6: timer                   4284731466       1999
cpu7: timer                   4284724508       1999
cpu1: timer                   4284893874       1999
cpu3: timer                   4284899807       1999
cpu2: timer                   4284892325       1999
cpu4: timer                   4284897264       1999
Total                        37480028742      17493


The server(s) that I am experiencing the hangs on, vmstat -i shows:

# vmstat -i
interrupt                          total       rate
irq1: atkbd0                           2          0
irq3: sio1                             8          0
irq25: bge0                      4614816        213
irq72: ciss0                     1835763         85
cpu0: timer                     43113685       1997
cpu1: timer                     43116889       1997
Total                           92681163       4293

Are any of these similiarly using MSI/MSIX?

----
Marc G. Fournier           Hub.Org Networking Services (http://www.hub.org)
Email . scrappy at hub.org                              MSN . scrappy at hub.org
Yahoo . yscrappy               Skype: hub.org        ICQ . 7615664