Re: NFS performance with 10GBase-T
- In reply to: Mark Saad : "Re: NFS performance with 10GBase-T"
- Go to: [ bottom of page ] [ top of archives ] [ this month ]
Date: Sun, 25 Feb 2024 23:06:23 UTC
>> Hi everyone, >> >> I am coming here from >> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=2771971160 >> >> TL;DR: >> >> * I have a FreeBSD14 Server and Client with an Intel X540 (ix) adaptor >> each. >> * I am trying to improve the NFS throughput. >> * I get 1160 MiB/s via nc, but only ~200 MiB/s via NFS. >> * Increasing rsize and wsize to 1 MiB increases throughput to 395 MiB/s >> * But a Linux client achieves 560-600 MiB/s with any rsize. >> * The mtu is set to 9000 but this doesn't make a difference for the >> FreeBSD client (it does make a difference for Linux). >> >> I assume < 400 MiB/s is not the expected performance? Do you have any >> advice on debugging this? >> >> Thank you for your help, >> Hannes >> > > Hi Hannes, thank you for the reply! > The link didn’t work . Sorry, no clue how that copy-pasta happened. The link Michael posted is correct: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=277197 > Can you tell us more about the file system , > what type of disks . 4x4TiB NVME (Lexar NM790) raidz1 The server can maintain speeds over 900 MiB/s copying hundreds of Gigabytes from one dataset to another including compression and encryption on both ends, so I don't think the server setup is a problem. nc manages to send data at 1100 MiB/s from the server to the client. > Details about the server , hardware details. If > you want post a copy of your dmesg to > https://dmesgd.nycbug.org/index.cgi > <https://dmesgdnycbug.org/index.cgi> that can help too . https://dmesgd.nycbug.org/index.cgi?do=view&id=7527 If there is anything else that would help, please let me know! > Also what kinds of clients are you using ? The FreeBSD14 client is an amd64 machine with the same network adaptor as the server (Intel X540 T1). I have set up a dual-boot with Devuan GNU/Linux. As reported above, Linux achieves 600 MiB/s out of the box. > Do you have any relevant network stats or a topology/ diagram of the > shape of things ? The client and server are connected via CAT7 cables and a NETGEAR switch. I could look up the model later, but it can probably be ruled out if other tools/OS achieve higher throughput? Best regards, Hannes -- Dr. Hannes Hauswedell C++ Software Engineer https://hannes.hauswedell.net