From nobody Fri Feb 03 13:17:20 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4P7bmr4FbBz2p6JF for ; Fri, 3 Feb 2023 13:17:48 +0000 (UTC) (envelope-from darius@dons.net.au) Received: from midget.dons.net.au (2403-5800-5200-4700-225-90ff-fe47-39b4.ip6.aussiebb.net [IPv6:2403:5800:5200:4700:225:90ff:fe47:39b4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-384) client-digest SHA384) (Client CN "dons.net.au", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4P7bmq5ybnz40wS for ; Fri, 3 Feb 2023 13:17:46 +0000 (UTC) (envelope-from darius@dons.net.au) Authentication-Results: mx1.freebsd.org; none Received: from smtpclient.apple (2403-5800-5200-4700-d5f-4320-bb5b-a71.ip6.aussiebb.net [IPv6:2403:5800:5200:4700:d5f:4320:bb5b:a71]) (authenticated bits=0) by midget.dons.net.au (8.17.1/8.15.2) with ESMTPSA id 313DHVex074684 (version=TLSv1.2 cipher=ECDHE-ECDSA-AES256-GCM-SHA384 bits=256 verify=NO); Fri, 3 Feb 2023 23:47:31 +1030 (ACDT) (envelope-from darius@dons.net.au) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=dons.net.au; s=default; t=1675430251; bh=FyLvgyXB446Tpu8fJ/SdQbUKYw8xhwZwrqD964ekPWE=; h=Subject:From:In-Reply-To:Date:Cc:References:To; b=YjKXQEmpNyAmMGNUWqnCNGvuluI4nHMbEx6DQ0sZJYHM3Z9f7WYINwPnqCBAuCXYn uoIvJ0AjeFovxmdZSvj7g99z8I2It6gOfbbr7FeTfYYIAlX/invj7XwzMzO86elGhf Exr7/m3HqTBJoeO4iDiLcwe9oXaho+jVwXJjF+7Q= X-Authentication-Warning: midget.dons.net.au: Host 2403-5800-5200-4700-d5f-4320-bb5b-a71.ip6.aussiebb.net [IPv6:2403:5800:5200:4700:d5f:4320:bb5b:a71] claimed to be smtpclient.apple Content-Type: text/plain; charset=us-ascii List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.400.51.1.1\)) Subject: Re: devctl: Failed to detach pci0:1:0:0: Device busy / devctl: Failed to set pci0:1:0:0 driver to ppt: Device busy From: "Daniel O'Connor" In-Reply-To: Date: Fri, 3 Feb 2023 23:47:20 +1030 Cc: freebsd-hackers Content-Transfer-Encoding: quoted-printable Message-Id: <4E67D54E-CF0E-4A56-9B6B-51C359B7CEE2@dons.net.au> References: <09A3D05B-E269-437F-8ACB-A150EBCACF4E@dons.net.au> <128F6D81-D71B-4BC7-9143-8205E826088F@dons.net.au> To: Mario Marietto X-Mailer: Apple Mail (2.3731.400.51.1.1) X-Spam-Status: No, score=0.40 X-Rspamd-Server: midget.dons.net.au X-Rspamd-Queue-Id: 4P7bmq5ybnz40wS X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:4764, ipnet:2403:5800::/32, country:AU] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N > On 3 Feb 2023, at 23:37, Mario Marietto = wrote: > ---> If you want to pass through the video card (as evidenced by = devctl and pptdevs) then why have the nvidia driver installed? >=20 > Why did you say this ? Are you aware of some bug that prevents a pci = device from being passed if its driver is installed ?=20 No, it just seems pointless to have a driver for a card that it will = never attach to because it is 'stolen' by the passthrough driver. > Maybe there is. Infact I made some progress. I have commented this = line on /etc/rc.conf : >=20 > #kld_list=3D"nvidia nvidia-modeset" >=20 > and I've been able to detach and reattach the 4 slots of the 2080 ti. = I think that if I load the nvidia modules on the rc.conf,they interfere = with a later attaching / detaching of 1 or 2 slots of the gpu (hdac and = vgapci). Do you think that it could be caused by a bug on the nvidia = driver or in the bhyve source code ? What do you suggest I do ? It seems very odd that loading the nvidia driver via rc.conf would = 'beat' the passthrough driver loaded earlier in loader.conf. However I've never tried any pass through stuff so no idea sorry. -- Daniel O'Connor "The nice thing about standards is that there are so many of them to choose from." -- Andrew Tanenbaum