From nobody Fri Jul 30 08:50:07 2021 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D3DD012DB5F1 for ; Fri, 30 Jul 2021 08:50:13 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mx1.sbone.de (cross.sbone.de [195.201.62.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.sbone.de", Issuer "SBone.DE" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gbh1K0HG1z4SN8; Fri, 30 Jul 2021 08:50:13 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mail.sbone.de (mail.sbone.de [IPv6:fde9:577b:c1a9:31::2013:587]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.sbone.de (Postfix) with ESMTPS id CE73A8D4A172; Fri, 30 Jul 2021 08:50:11 +0000 (UTC) Received: from content-filter.sbone.de (content-filter.sbone.de [IPv6:fde9:577b:c1a9:31::2013:2742]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPS id 95BE3E707FC; Fri, 30 Jul 2021 08:50:10 +0000 (UTC) X-Virus-Scanned: amavisd-new at sbone.de Received: from mail.sbone.de ([IPv6:fde9:577b:c1a9:31::2013:587]) by content-filter.sbone.de (content-filter.sbone.de [fde9:577b:c1a9:31::2013:2742]) (amavisd-new, port 10024) with ESMTP id ueTaWQc0ERrx; Fri, 30 Jul 2021 08:50:08 +0000 (UTC) Received: from nv.sbone.de (nv.sbone.de [IPv6:fde9:577b:c1a9:31::2013:138]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPSA id 9063EE707EC; Fri, 30 Jul 2021 08:50:08 +0000 (UTC) Date: Fri, 30 Jul 2021 08:50:07 +0000 (UTC) From: "Bjoern A. Zeeb" To: Peter Grehan cc: freebsd-virtualization@freebsd.org Subject: Re: ivhd0 IO_PAGE_FAULT EVT with external disk In-Reply-To: Message-ID: References: <4c6865aa-f772-b6bd-d16c-ca8958352837@freebsd.org> X-OpenPGP-Key-Id: 0x14003F198FEFA3E77207EE8D2B58B8F83CCF1842 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 Content-Type: MULTIPART/MIXED; BOUNDARY="0-1284825450-1627635008=:68830" X-Rspamd-Queue-Id: 4Gbh1K0HG1z4SN8 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of bzeeb-lists@lists.zabbadoz.net designates 195.201.62.131 as permitted sender) smtp.mailfrom=bzeeb-lists@lists.zabbadoz.net X-Spamd-Result: default: False [-0.45 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.201.62.131]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; DMARC_NA(0.00)[zabbadoz.net]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_SPAM_SHORT(0.85)[0.850]; CTYPE_MIXED_BOGUS(1.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; ASN(0.00)[asn:24940, ipnet:195.201.0.0/16, country:DE]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-virtualization] X-Spam: Yes X-ThisMailContainsUnwantedMimeParts: N This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. --0-1284825450-1627635008=:68830 Content-Type: TEXT/PLAIN; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8BIT On Fri, 30 Jul 2021, Bjoern A. Zeeb wrote: > On Fri, 30 Jul 2021, Peter Grehan wrote: > >>> I grabbed an external USB drive from an Intel machine and put it to an AMD >>> host >>> using it to boot directly from it like: >>>         -s 3,ahci-hd,/dev/da0,sectorsize=512 \ >> ... >> >>> On the AMD machine this doesn't work and I get a lot of: >>> >>> ivhd0: EVT INTR 45 Status:0x1a EVT Head:0xfb0 Tail:0x430]^M >>>   [CMD Total 0xaf] Tail:0xaf0, Head:0xaf0.^M >> ... >>> Is this in theory supposed to work? >> >> Yes. > > Good. > > >>> Does this in any way depend on the USB >>> port used or are we simply working on the device node? >> >> bhyve only uses the device node. > > Also good. > > >> Do you have passthru devices configured ? If so, are they under the same >> controller that the USB device is on ? > > I do. > And they did work fine without the raw disk (netbooting FreeBSD). > If I remove the passthru devices the Linux on the disk boots. Actually, I as too early given it went through grub and was saying: Loading Linux 5.10.40 ... Loading initial ramdisk ... Then bhyve died with: vm_run error -1, errno 14 but no other information in dmesg or console or from bhyve. I assume that is two issues now... > nexus0 > cryptosoft0 > aesni0 > smbios0 > ram0 > apic0 > vtvga0 > acpi0 > cpu0 > hwpstate0 > acpi_perf0 > cpufreq0 > cpu1 > acpi_perf1 > cpu2 > acpi_perf2 > cpu3 > acpi_perf3 > acpi_button0 > pcib0 > pci0 > hostb0 > amdiommu0 > hostb1 > pcib1 > pci1 > ppt0 > pcib2 > pci2 > igb0 > pcib3 > pci3 > ppt1 > pcib4 > pci4 > ppt2 > pcib5 > pci5 > ppt3 > xhci0 > usbus0 > uhub1 > umass0 > ahci0 > ahcich0 > ahcich1 > ehci0 > usbus1 > uhub0 > uhub2 > isab0 > isa0 > orm0 > superio0 > wbwd0 > sdhci_pci0 > hostb2 > hostb3 > hostb4 > hostb5 > hostb6 > hostb7 > acpi_tz0 > ... > > >> (also what version of FreeBSD on the host) > > HEAD as of a few days or weeks ago. > > -- Bjoern A. Zeeb r15:7 --0-1284825450-1627635008=:68830--