From nobody Fri Jul 30 17:51:02 2021 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 59F6712D2989 for ; Fri, 30 Jul 2021 17:51:06 +0000 (UTC) (envelope-from khng300@gmail.com) Received: from mail-pl1-x62d.google.com (mail-pl1-x62d.google.com [IPv6:2607:f8b0:4864:20::62d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gbw1Q1ST8z3LBK; Fri, 30 Jul 2021 17:51:06 +0000 (UTC) (envelope-from khng300@gmail.com) Received: by mail-pl1-x62d.google.com with SMTP id k1so11943760plt.12; Fri, 30 Jul 2021 10:51:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=lbW4aGVt2Eru6zvGeT/4/16/hlQROjbzFVsglrMPsbc=; b=BpSEazusYCoxBhnBt+FXQY+Zz2jQNpJaaJanrqBnt/J/03gPIW6hvlXLCOtFdKaZf1 I/j4pcAOdrxYU3FD3Py844/5fdipAWDhEzrWwM7OvDjeweqyeETVzdhqhIIc8mgLhCqM b5U+NX8KkCf1mnkvdYqfl/396hTSSF4omOWid0pQ4aDv+cKIkl6AwWSzIYT+cB5dSc1P PiU6ZPxIPAZdJC2KQ2ozqkYuC/DXho23njv8qOOUPa/prcm66RWWv/cZLv0MZuY8vsLo GiRpMcpRZGAV4MRfkcj3zhxuEt46gt7oKGCzwAYl6rYyCY42848cHcTH+1Lmw4CvfCJr 14ow== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=lbW4aGVt2Eru6zvGeT/4/16/hlQROjbzFVsglrMPsbc=; b=JAxeE7FUIUWAlTgFSJpGn9eoXRkSO5Tw8UOxFIEq8WgN5sO/bmVmZRHHCzVzPWaOJd do8KO/VAW4u8B5NMx18M44p23UqJ4daUB1vqrMrkoUBQR6kQyYYgQQmI4wOioVUlXUPb DpaLGzgebBEoaNnZgAsrVODF/0vjG6lR//FBHdlg2tjkMV/HlVjF1wUjhCI1NDELVfWE /WKhq0HIE2y+t9yAV38J5rVCS11wzpe9OdRz8U2YtobqIeSSrHwOhvvJGV6eHVC8f5Y6 B+OMWuTpxYaMcSxkqR5tdeZTC22ggTIzrmTahyOAJDINUnt6L37XY/bx6jtyDTxt6pLI 1i7Q== X-Gm-Message-State: AOAM530pSD4o2M7PNIc4iFzeZGUtNc73wMYxlyw7KpdUlGXmZUcNSLno xR2HFHaWpe1FObUYs2lf/i4djzfjI6p2/qme X-Google-Smtp-Source: ABdhPJyNDutQlssguGs5RBKWC6j4PGfwi7QWsfGkmBKlsigSu6T4dbl4uh1sWnaPCoCj2wHPT9IKuw== X-Received: by 2002:a17:902:d2c6:b029:12b:6f6d:87d1 with SMTP id n6-20020a170902d2c6b029012b6f6d87d1mr3352808plc.11.1627667465057; Fri, 30 Jul 2021 10:51:05 -0700 (PDT) Received: from Kas-MacBook-Pro.local ([2001:470:f816:0:7987:1f30:b459:3a36]) by smtp.gmail.com with ESMTPSA id w2sm2819660pjd.35.2021.07.30.10.51.03 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 30 Jul 2021 10:51:04 -0700 (PDT) Subject: Re: ivhd0 IO_PAGE_FAULT EVT with external disk To: "Bjoern A. Zeeb" , Peter Grehan Cc: freebsd-virtualization@freebsd.org References: <4c6865aa-f772-b6bd-d16c-ca8958352837@freebsd.org> From: Ka Ho Ng Message-ID: <6546f9f7-72f7-2f89-42e0-a35618d322f8@gmail.com> Date: Sat, 31 Jul 2021 01:51:02 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0) Gecko/20100101 Thunderbird/78.12.0 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4Gbw1Q1ST8z3LBK X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N On 2021/7/30 4:50 PM, Bjoern A. Zeeb wrote: > On Fri, 30 Jul 2021, Bjoern A. Zeeb wrote: > >> On Fri, 30 Jul 2021, Peter Grehan wrote: >> >>>> I grabbed an external USB drive from an Intel machine and put it to >>>> an AMD host >>>> using it to boot directly from it like: >>>>          -s 3,ahci-hd,/dev/da0,sectorsize=512 \ >>> ... >>> >>>> On the AMD machine this doesn't work and I get a lot of: >>>> >>>> ivhd0: EVT INTR 45 Status:0x1a EVT Head:0xfb0 Tail:0x430]^M >>>>    [CMD Total 0xaf] Tail:0xaf0, Head:0xaf0.^M >>> ... >>>> Is this in theory supposed to work? >>> >>> Yes. >> >> Good. >> >> >>>> Does this in any way depend on the USB >>>> port used or are we simply working on the device node? >>> >>> bhyve only uses the device node. >> >> Also good. >> >> >>> Do you have passthru devices configured ? If so, are they under the >>> same controller that the USB device is on ? >> >> I do. >> And they did work fine without the raw disk (netbooting FreeBSD). >> If I remove the passthru devices the Linux on the disk boots. > > Actually, I as too early given it went through grub and was saying: > Loading Linux 5.10.40 ... > Loading initial ramdisk ... > > Then bhyve died with: >     vm_run error -1, errno 14 > > but no other information in dmesg or console or from bhyve.  I assume > that is two issues now... > > >> nexus0 >>  cryptosoft0 >>  aesni0 >>  smbios0 >>  ram0 >>  apic0 >>  vtvga0 >>  acpi0 >>    cpu0 >>      hwpstate0 >>      acpi_perf0 >>      cpufreq0 >>    cpu1 >>      acpi_perf1 >>    cpu2 >>      acpi_perf2 >>    cpu3 >>      acpi_perf3 >>    acpi_button0 >>    pcib0 >>      pci0 >>        hostb0 >>        amdiommu0 >>        hostb1 >>        pcib1 >>          pci1 >>            ppt0 >>        pcib2 >>          pci2 >>            igb0 >>        pcib3 >>          pci3 >>            ppt1 >>        pcib4 >>          pci4 >>            ppt2 >>        pcib5 >>          pci5 >>            ppt3 >>        xhci0 >>          usbus0 >>            uhub1 >>              umass0 >>        ahci0 >>          ahcich0 >>          ahcich1 >>        ehci0 >>          usbus1 >>            uhub0 >>              uhub2 >>        isab0 >>          isa0 >>            orm0 >>            superio0 >>              wbwd0 >>        sdhci_pci0 >>        hostb2 >>        hostb3 >>        hostb4 >>        hostb5 >>        hostb6 >>        hostb7 >>    acpi_tz0 >> ... >> >> >>> (also what version of FreeBSD on the host) >> >> HEAD as of a few days or weeks ago. >> >> > I am interested in the 'pciconf -lb' output (which is dumped to stdout) and '/usr/local/bin/acpidump -b -n IVRS' output (which generates a ivrs.dat) file. Ka Ho