ggate + gmirror write performance woes

[Tom Judge]

Dmitriy Kirhlarov wrote:
> On Thu, Apr 05, 2007 at 10:58:56AM -0400, Sven Willenberger wrote:
>> I am trying to set up a HA type system involving two identical boxes and
>> have gone through the following to set up the systems:
>>
>> Slave server: 
>> ggated -R 196608 -S 196608
>> (exporting /dev/amrd1 )
>> net.inet.tcp.sendspace: 65536
>> net.inet.tcp.recvspace: 131072
> 
> Try
> net.local.stream.recvspace=65535
> net.local.stream.sendspace=65535
> 
> Also, try increase this sysctls with
> net.inet.tcp.rfc1323=1
> 
> I use it on FreeBSD 5.x with:
> net.inet.tcp.sendspace=131072
> net.inet.tcp.recvspace=131072
> net.local.stream.recvspace=65535
> net.local.stream.sendspace=65535
> 
> ggated -R 1048576 -S 1048576
> ggatec -R 1048576 -S 1048576
> 
> WBR.
> Dmitriy
> _______________________________________________
> freebsd-stable at freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-stable
> To unsubscribe, send any mail to "freebsd-stable-unsubscribe at freebsd.org"


I have seen sustained writes of 30Mb/s using the following configuration:

cat /boot/loader.conf
kern.ipc.nmbclusters="32768"

cat /etc/sysctl.conf
net.inet.tcp.sendspace=1048576
net.inet.tcp.recvspace=1048576

Server:
/sbin/ggated -S 1310720 -R 1310720 -a 172.31.0.18 /etc/gg.exports

Client:
/sbin/ggatec create -q 2048 -t 5 -S 1310720 -R 1310720 172.31.0.18 
/dev/amrd0s2

The raid array is a RAID 1 volume on a dell PERC4 (Dell PE1850) with 
adaptive read ahead and write back caching.

Tom