From nobody Sun Mar 20 22:11:29 2022 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 909871A204A4 for ; Sun, 20 Mar 2022 22:12:12 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-yw1-x112b.google.com (mail-yw1-x112b.google.com [IPv6:2607:f8b0:4864:20::112b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KMBn736Rnz3v2y for ; Sun, 20 Mar 2022 22:12:11 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: by mail-yw1-x112b.google.com with SMTP id 00721157ae682-2e5827a76f4so138244067b3.6 for ; Sun, 20 Mar 2022 15:12:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=5OmrP22QjUGbm3327+w1VowKp4Fey2py8T19qpA1FAo=; b=dpiSL0DfaCYNjfZnjKLWrKerwtBpKe8TJSUekcx6C603+dwH7F06oXj/1KbMTY28mb gUohcTiU7YFbjPEHaNPRq0h3dLmLCgBsZ4h4iLSa0xrDRlZj2GqoWsZgSG1pyw61JaFd XU2sF4MuvRifwgUUZJoPlMLa8IvNP18HME1JTz7U+Dd1J3wEGoGhWD6YUgqwVaA/Q2FB hSzF1Y6EObSqtipC5jg6J0eZO4T7Uc8mAMQNyIN+fDrfpWhdS6Io6dbd938TN9f36C8f HdWsISrCrlZb8H183cLIKtaOP42ngOkJhyAgEDUXL5CAXXXhwgNL4fUrLXgaBUNNW3TE 6QZw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=5OmrP22QjUGbm3327+w1VowKp4Fey2py8T19qpA1FAo=; b=tfNptQUwxERSjTPAwL3kYH9ks3T9TzlLqY0Z9pVqkeOZ8stOculdGLyh8sX/L6nADe 4pwJCAmwfSc9OlIpcnQx65LYFBSdKTDFHnHSdaiXq4W3EwGcKlc4v0fMVsRF/WMTxTle BGU+l1HFH9M9WlQSQ3smKCF8ziLHyxgWBmHLKoAaEQ8zmPc7nUJiqXuNlNYE2Hw/+rnf eAvtwVn4auKWjbdrVc/WVsDAlcQfgkzeJZUEWLN0CFh0EyNH6kheAuWnpQXpW2HomQLY 2P/NUTls+oaK5kfJTSrqy2OgShDzm2z5cZqmeU9dZ1D+RkkL+/LPdbpXetYeNP8uv1Cy gB0w== X-Gm-Message-State: AOAM533JKz84hswAmcc4jyp8UPqaOwc0am1jYzawfm5oOy53uF5puuTI vXNcJFjrflIWHfc+YIEOJqc7sc8VzXnHU3Lf0EXyVUbyZgM= X-Google-Smtp-Source: ABdhPJyfAH03+zM6+BqiXJlXIeTIi1HEn7TdUgXAcXFPlLMKcHkC71pM+1Oyw4Mxp+fG6FbPr12dyLcxdr5vtZrv71A= X-Received: by 2002:a81:578c:0:b0:2e6:2488:7ef8 with SMTP id l134-20020a81578c000000b002e624887ef8mr3741672ywb.519.1647814325458; Sun, 20 Mar 2022 15:12:05 -0700 (PDT) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 References: <00bf01d80104$e6ba5de0$b42f19a0$@tubnor.net> <082b01d80697$64e95030$2ebbf090$@tubnor.net> In-Reply-To: From: Mario Marietto Date: Sun, 20 Mar 2022 23:11:29 +0100 Message-ID: Subject: Re: bhyve NVMe 1.4 support To: Chuck Tuffli Cc: jason@tubnor.net, FreeBSD virtualization Content-Type: multipart/alternative; boundary="000000000000865a0905daadab9d" X-Rspamd-Queue-Id: 4KMBn736Rnz3v2y X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=dpiSL0Df; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of marietto2008@gmail.com designates 2607:f8b0:4864:20::112b as permitted sender) smtp.mailfrom=marietto2008@gmail.com X-Spamd-Result: default: False [1.97 / 15.00]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; URI_COUNT_ODD(1.00)[1]; MID_RHS_MATCH_FROMTLD(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_SPAM_SHORT(0.97)[0.969]; NEURAL_HAM_LONG(-1.00)[-0.997]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; NEURAL_SPAM_MEDIUM(1.00)[1.000]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::112b:from]; HTTP_TO_IP(1.00)[]; MLMMJ_DEST(0.00)[freebsd-virtualization]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --000000000000865a0905daadab9d Content-Type: text/plain; charset="UTF-8" I'm running on FreeBSD 14 : FreeBSD marietto 14.0-CURRENT FreeBSD 14.0-CURRENT #3 main-n253070-a30f71704ef: Thu Feb 10 12:33:57 CET 2022 marietto@marietto:/usr/obj/usr/src/amd64.amd64/sys/GENERIC a md64 and I see the same exact problem : root@marietto-BHYVE:~# fdisk -l Disk /dev/nvme0n1: 931,51 GiB, 1000204886016 bytes, 1953525168 sectors Disk model: bhyve-NVMe Units: sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes after having invoked bhyve like this : bhyve -S -c sockets=2,cores=2,threads=2 -m 8G -w -H -A \ -s 0,hostbridge \ -s 1,virtio-blk,/mnt/$vmdisk'p2'/bhyve/os/Linux/impish-cuda-11-5-nvidia-495.img \ -s 2,nvme,/dev/nvd0 \ -s 3,passthru,5/0/0 \ -s 4,passthru,1/0/0 \ -s 8,virtio-net,tap0 \ -s 9,virtio-9p,sharename=/ \ -s 29,fbuf,tcp=0.0.0.0:5900,w=1440,h=900 \ -s 30,xhci,tablet \ -s 31,lpc \ -l bootrom,/usr/local/share/uefi-firmware/BHYVE_BHF_CODE.fd \ vm0 < /dev/null & sleep 2 && vncviewer 0:0 anyway there is a difference between freebsd 13 and 14. On freebsd 13,adding this parameter on /etc/rc.conf : hw.nvme.use_nvd=0 does not produce errors. But on FreeBSD 14,it says not found or something like this. Il giorno dom 20 mar 2022 alle ore 22:20 Chuck Tuffli ha scritto: > On Sun, Mar 20, 2022 at 1:38 PM Mario Marietto > wrote: > > > > FreeBSD 13.1-RELEASE is out ? Can I upgrade from 13-p8 to 13-1 with > freebsd-update fetch / freebsd-update install ? > > RELEASE isn't out, but BETA2 is available. So, > # freebsd-update upgrade -r 13.1-BETA2 > # freebsd-update install > > boot environments are your friend, etc :) > -- Mario. --000000000000865a0905daadab9d Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
I'm running on FreeBSD 14 :

<= div>FreeBSD marietto 14.0-CURRENT FreeBSD 14.= 0-CURRENT #3 main-n253070-a30f71704ef: Thu Feb
10 12:33:57 CET 2= 022 =C2=A0=C2=A0=C2=A0=C2=A0marietto@marietto:/usr/obj/usr/src/amd64.amd64/= sys/GENERIC =C2=A0a
md64

and I s= ee the same exact problem :

root@marietto-BHYVE:~# fdisk -l

Disk /dev/nvme0n1: 931,51 GiB, 10002048860= 16 bytes, 1953525168 sectors
Disk model: bhyve-NVMe =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0
Units= : sectors of 1 * 512 =3D 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes

after having invoked bhyve like this := 

bhyve -S -c sockets=3D2,cores=3D2,threads=3D2 -m 8G -w -H -A \
-s 0,hostbridge \
-s 1,virtio-blk,/mnt/$vmdisk'p2'/bhyve/os/Linux/impish-cuda-11-5-nvidia-495.img \
-s 2,nvme,/dev/nvd0 \
-s 3,passthru,5/0/0 \
-s 4,passthru,1/0/0 \
-s 8,virtio-net,tap0 \
-s 9,virtio-9p,sharename=3D/ \
-s 29,fbuf,tcp=3D0.0.0.0:=
5900,w=3D1440,h=3D900 \
-s 30,xhci,tablet \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware/BHYVE_BHF_CODE.fd \
vm0 < /dev/null & sleep 2 && vncviewer 0:0
anyway there is = a difference between freebsd 13 and 14. On freebsd 13,adding this parameter= on /etc/rc.conf :

hw.nvme.use_nvd=3D0
<= span style=3D"font-family:monospace">=
does not produce errors. But on FreeBSD 14,it= says not found or something like this.

<= /span>

Il giorno dom 20 mar 2022 alle ore 22:20 Chuck Tuffli &l= t;chuck@tuffli.net> ha scritto:
marietto2008@gmail.com> wrote:=
>
> FreeBSD 13.1-RELEASE is out ? Can I upgrade from 13-p8 to 13-1 with fr= eebsd-update fetch / freebsd-update install ?

RELEASE isn't out, but BETA2 is available. So,
# freebsd-update upgrade -r 13.1-BETA2
# freebsd-update install

boot environments are your friend, etc :)


--
Mario.
=
--000000000000865a0905daadab9d--