Varnish proxy goes catatonic under heavy load

[Konstantin Belousov]

On Thu, Nov 06, 2014 at 09:44:48AM +0000, Matthew Seaman wrote:
> Hmmm.... well, our theory about this is that we see the effect when the
> total traffic is sufficiently high that we're hitting the network
> capacity, and dropping some packets.  (The actual traffic load on an
> individual server was big, but nothing like saturating the network. It's
> the total that was maxing out our uplink to the Internet.)
Gathering information according to
https://www.freebsd.org/doc/en_US.ISO8859-1/books/developers-handbook/kerneldebug-deadlocks.html
would eliminate most doubts.

So, do you use UFS ?

> 
> We simulated the effect by sticking a test box on a 10Mb/s connection
> and threw a lot of requests for a largeish (1MB) file at it.  The packet
> loss seems to be important -- presumably it's clogging up the available
> mbufs with old packets that haven't received an ACK yet, so have to be
> held onto in case they need to be resent.