[Bug 277197] NFS is much to slow at 10GbaseT

From: <bugzilla-noreply_at_freebsd.org>
Date: Tue, 20 Feb 2024 16:34:45 UTC

            Bug ID: 277197
           Summary: NFS is much to slow at 10GbaseT
           Product: Base System
           Version: 14.0-RELEASE
          Hardware: amd64
                OS: Any
            Status: New
          Severity: Affects Only Me
          Priority: ---
         Component: kern
          Assignee: bugs@FreeBSD.org
          Reporter: h2+fbsdports@fsfe.org

I have FreeBSD 14 server and client. Both have Intel X540 10GBase-T adapters
and are connected via CAT7 and a Netgear switch that has the respective
10GBase-T ports.

Via iperf3, I measure 1233 MiB/s (9.87GBit/s) throughput. 
Via nc, I measure 1160 MiB/s throughput.

Via NFS, I get around 190-250MiB/s. I did not expect to get the full 1100MiB/s
with NFS, but I did hope to be between 600-800MB/s at least.

Various guides suggest tinkering with different TCP related sysctls, but I
haven't had any luck improving the performance. And since nc also manages to
push >1GByte over TCP, this doesn't seem like the core of the problem.

I have replaced the base system's ix with the one from ports, but no change.
Again, I don't think the driver or the network stack have an issue per se; it
seems to be NFS related.

I have used default options to do the mounts. This is what nfsstat shows for
the NFS3 mount:

and for the NFS4 mount:

Am I missing something? Is this a bug or a configuration problem?

I will try to set up a linux NFS client to see if the issues are client or
server related.

Thanks for your help!

P.S.: The server has an NVME raidz and can maintain throughput speeds over
900MiB/s reading and writing hundreds of gigabytes from/to different datasets
of the pool. Even with encryption and compression. So I don't think disks are a
limiting factor.

You are receiving this mail because:
You are the assignee for the bug.