From nobody Mon Dec 16 15:48:07 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4YBkqX322bz5hbJJ for ; Mon, 16 Dec 2024 15:48:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4YBkqX1mc7z4K1d for ; Mon, 16 Dec 2024 15:48:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1734364088; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=F7vUgEbr37iFYNnbDd3SPpXzUYsYTA61Y6RP2zhs+1Q=; b=XEZfHdGloe9nS2C2shiL9MQisQysuJqO+jc4qclnXQOBnc1J90N4LeVx7k2owcbk9chG++ YgiUELkfCQCVpiUf+SxigYz3aKgE0K27r7BqsEs30a8X3sKV0EPzueyISfVwW72qj2hK71 6mSnR+U6aoZEXQnngz1KCPnnud8KcT1g0L74+vzf+nsViwYQiUgfUJqHuW6i1ifbIhXsyx m/4fRE0s3v9xmMF3wiWGc0eaLlRVvW27bbQwMSLf4pxOUh4i7ZiiLApslnIFSXUogXBRAl rb3JADPeMJL+DtfioGhnuKXfBFRxcWcJO2QCbo1qikJ3/90TN5AcybP730VWxw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1734364088; a=rsa-sha256; cv=none; b=PGxLA1PMraXAaICkTBaGKyt55epoGNx5ewAZZhqYOCDH7BzRC26+BrOAnZvPFWFMkl729R dkR82YXicxMxECoy7fxpupOKkFYC8OauNkQrw5xCBglBlbZzGgzAWzdV1zNX8BtM1Czn9T gdMYq3A+XN6YHB4vxI2I3GyL/2RXLjkxLc4QTPaxTJq3plkJRJC6cE+sqKjI7IB1PXHoJA LqOBkB/QVRdAsg7wieK4SkzF+jFSjCY1d/xbGpIw6C3Xxht99Ze33Zi17uAAJh23//yc48 cvilmiTl5k1NDPxmORm1xxy82yKWnhdMLsLoOzrHfJ8DspB9wBOW2OwmuXQFpg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4YBkqW6Qlrz10Mm for ; Mon, 16 Dec 2024 15:48:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 4BGFm7gx034275 for ; Mon, 16 Dec 2024 15:48:07 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 4BGFm7ue034274 for virtualization@FreeBSD.org; Mon, 16 Dec 2024 15:48:07 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 278058] Simultaneous use of Bhyve AND vnet on network PCI devices causes network failure Date: Mon, 16 Dec 2024 15:48:07 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mark@markmcb.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D278058 --- Comment #4 from Mark McBride --- Some progress (or random luck)! As of 14.2-RELEASE, 1 of my 3 test cases for SR-IOV in a mixed vnet & passthrough setup works. WORKING (was failing pre 14.2) Mellanox ConnectX-4 Lx - I have 3 bhyve vms and 5 vnet jails running for several days now with no issues. I did notice one time when restarting a ja= il that the vf was never released (even ~10 minutes after stopping the jail) a= nd I had to reboot the system to correct. Aside from this, the system comes up a= fter a reboot just fine and all networking is functioning as expected. NOT WORKING Chelsio T520-SO-CR Intel X710-DA2 Failure mode observation: In the past, it would take about 5 minutes after starting both a vnet jail and a bhyve VM with a vf passed through for the network to fail. Now it's instantly on the vnet jail. Example: start vnet j= ail, start a ping to monitor; then start bhyve vm and watch the console. As soon= as the loader menu disappears and the network driver loads, the ping running in the jail will stop and the network is lost. The vm network will continue to work for about 5 minutes, and then fail (as usual). --=20 You are receiving this mail because: You are the assignee for the bug.=