Only one concurrent connection in jail possible (5.4)

[Peter Prucker]

On Tuesday 28 February 2006 10:05, Phil Regnauld wrote:
> service_ist at abwesend.de (service_ist) writes:
> > Hi,
> >
> > I've setup a server with 16 jails using 5.4. Right after bringing it
> > up I wondered about its bad performance.
>
> 	We need to know many things here:
>
> 	- CPU, RAM, disk, disk layout, swap

CPU: AMD Sempron 3000+ 
RAM: real memory  = 1007 MB, avail memory = 977 MB
disk: 3ware 7006-2 with two Maxtor 6L160P0 in a raid 1
disk layout:
/dev/twed0s1a    496M     71M    386M    15%    /
/dev/twed0s3d    119G     16G     94G    14%    /home
/dev/twed0s1g    4.8G     28K    4.5G     0%    /tmp
/dev/twed0s1d    4.8G    1.2G    3.3G    27%    /usr
/dev/twed0s1f    5.3G    328M    4.6G     7%    /usr/ports
/dev/twed0s1e    989M    400M    510M    44%    /usr/src
/dev/twed0s2d    3.9G     48M    3.5G     1%    /var
/dev/twed0s2e    3.9G    662M    2.9G    18%    /var/ccache
/dev/twed0s2f    989M    5.5M    905M     1%    /var/log
/dev/twed0s2g    1.9G     16M    1.8G     1%    /var/tmp

The jails are in /home.

swap: 2 GB at twed0s1b

> 	What does disk I/O look like ? (gstat)

Just zeros, with a little flickering some times.

> 	What does network I/O look like ? (netstat -ain 1)

            input        (Total)           output
   packets  errs      bytes    packets  errs      bytes colls
         2     0        128          2     0        296     0
         1     0         66          1     0        178     0
         1     0         66          1     0        178     0
         1     0         66          1     0        178     0
         3     0        235          2     0        297     0
         2     0        126          2     0        220     0
         2     0        164          3     0        374     0
         3     0        204          2     0        248     0
         5     0        404          3     0        416     0
         1     0         66          1     0        178     0
       172     0      55221        181     0      51887     0
       702     0     189462        696     0     193378     0
       858     0     321384        862     0     324292     0
      1091     0     193559       1099     0     194596     0
       917     0     212652        911     0     213837     0
       734     0     240609        717     0     241236     0
         6     0        444          5     0        450     0
         2     0        126          1     0        178     0
         1     0         66          1     0        178     0
         1     0         66          1     0        178     0

The part in the middle is when I'm doing a proxy request.

> 	Interrupts ? (vmstat -i) 

interrupt                          total       rate
irq8: rtc                       40520502        128
irq13: npx0                            1          0
irq17: twe0                     11152149         35
irq23: vr0                       1217326          3
irq0: clk                       31654941         99
Total                           84544919        267


> 	Have you read tuning(7) ?  There's a lot of info in there about
> 	socket tuning, network buffers, etc...

I've increased net.inet.ip.portrange to 15000 and kern.ipc.somaxconn to 
512, what did not bring any results.

> 	Check out what the logs say, eventual warnings on the console, etc...

No errors, no warnings. 

Peter