Re: Chelsio (cxgbe) VF on FreeBSD guest under KVM requires -rxcsum
Date: Fri, 26 Sep 2025 08:08:56 UTC
Hi, This sounds very similar to the scenario that is fixed in 16-CURRENT and 15 with delayed checksum in a virtual environment. These are some of the commits around this, but there are more commits involved. https://cgit.freebsd.org/src/commit/?id=39d4094173f9a49ff52f5f4408e4dbd5d6ef0409 https://cgit.freebsd.org/src/commit/?id=bcb298fa9e23c1192c5707086a67d3b396186abc I also remember bug reports about this case, but don't have the link availabie. I hope this is a pointer to the solution for you. Regards, Ronald. Van: Michael Tuexen <michael.tuexen@lurchi.franken.de> Datum: vrijdag, 26 september 2025 09:45 Aan: John Nielsen <lists@jnielsen.net> CC: net@freebsd.org, virtualization@freebsd.org, np@freebsd.org Onderwerp: Re: Chelsio (cxgbe) VF on FreeBSD guest under KVM requires -rxcsum > > > On 26. Sep 2025, at 02:58, John Nielsen <lists@jnielsen.net> wrote: > > > > Hi- > > > > Not sure if this is a known issue or even an issue on the FreeBSD side but decided to ask here first. I’m happy to put in a bug report if appropriate. > > > > I have a hypervisor machine running Arch Linux with KVM, Qemu and libvirtd. The machine has a Chelsio T520-CR adapter. I recently began passing through virtual functions of the NIC to several of the guests I run on the hypervisor. One of the guests runs Windows 11, and the change was seamless. Two of the guests are running FreeBSD (14.3 or so). On each of them the VFs were readily identified and configured (using DHCP in one case), and ping and ARP appeared to work fine. However, TCP and UDP traffic to the guests never received a response. After some head-scratching and troubleshooting I discovered that running “ifconfig cxlv0 -rxcsum” immediately allowed traffic to flow as expected. > Hi John, > > I don't have access to such a network card. Just to be clear: you are running the “ifconfig cxlv0 -rxcsum” command inside the guest running FreeBSD, right? > What is the peer, when you mention TCP and UDP do not work? Is it the host running Linux? Is it another VM? Is it some external host? > > > > As workarounds go that isn’t terrible, but I was surprised that the FreeBSD guests required this adjustment while the Windows one did not. > > > > As a point of reference I have another hypervisor machine that runs FreeBSD 14-STABLE. It also has a > So the host runs FreeBSD and you use bhyve to run some VM? > > Chelsio T520-CR adapter. FreeBSD guests on that machine do not require “-rxcsum” in order to use the Chelsio virtual functions. > The guests run FreeBSD-STABLE or Freebsd 14.3? > What is the peer, when you mention TCP and UDP do not work? Is it the host running Linux? Is it another VM? Is it some external host? > > > > Let me know if anyone can shed some light on this. I’m happy to provide additional details or run further tests if needed. Thank you! > Maybe I can, but I need to understand the scenario... > > Best regards > Michael > > > > -John > > > > > > > > >