NFS over LAGG / lacp poor performance

Marek Salwerowicz marek_sal at wp.pl
Fri Apr 25 11:58:00 UTC 2014


W dniu 2014-04-25 13:48, Rick Macklem pisze:
> Well, you don't mention what command(s) you are using to transfer the
> data, but I would guess you have one serial data transfer for each command.
> (Put another way, if you are only running one command to transfer the data,
>  there will only be one RPC happening at a time and that will only use one
>  network interface.) I don't know anything about lagg, so I can't comment
>  related to it, but if there is only one NFS RPC at a time, you'll only
>  be transferring one message at a time on the wire.)

I need to transfer 15 files, each is about 1TB sized.

>From 9.1-RELEASE[storage1] to 10-RELEASE[storage2]

I have tried to run concurrent 'cp'  and transfer 4 files at the same time:

(executed on storage1)
# cp -a  file1 /net/storage2/ &
# cp -a  file2 /net/storage2/ &
# cp -a  file3 /net/storage2/ &
# cp -a  file4 /net/storage2/ &


But in fact I did not observe bigger throughput

Both servers have filesystem exported using NFS, so I can execute copy
on source, or destination.
Would you recommend running this on source-side, or rather
destination-side ?

>
> Adding the mount option "readahead=8" to the machine receiving the data
> might help, if the data transfer command is being done there. (ie. The machine
> the data is being copied to has the other one NFS mounted and it is where
> you are running the data transfer command(s).)


Regarding what I wrote above - how should I mount the NFS volumes?

Cheers,
Marek


More information about the freebsd-net mailing list