From nobody Mon May 01 01:10:49 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Q8lX74Fxtz48YGB for ; Mon, 1 May 2023 01:11:03 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ej1-x62f.google.com (mail-ej1-x62f.google.com [IPv6:2a00:1450:4864:20::62f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Q8lX72gqHz4d5m for ; Mon, 1 May 2023 01:11:03 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ej1-x62f.google.com with SMTP id a640c23a62f3a-94f1a6e66c9so401424666b.2 for ; Sun, 30 Apr 2023 18:11:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20221208.gappssmtp.com; s=20221208; t=1682903461; x=1685495461; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=Q8fXpFKn27V7m9JqCU+c5eN8wHyg+o03ZOHVKHdJOgM=; b=GT1xdVQ56SJ8zPXDD2cbLn5XikHDTucpOUijuiXtaxZBc2SHALUFe6HV6f7DbThH2w lQ9y0KNf55ojKODPOaA+sP8NRa9Zxkq45MTxYc/1N8Y/v7TdkwUxjmletFt4E0NgVkqF YfonuMPOnULV1DCNNuqtrdhljUMbSIi0X7f+BN4N+ZUsMv3anV7jn+l5aK9PurwAXWN8 mU7NB4CVaBxWmhwy81oyIksgvvuVOoQlfP0lITxMXW8Ekezo8ghlSbL0RJrBShFEaK7C 8bFEZpMNtLpQnqBDpNJ/bC+f/71/r1rrLF5Py4YnFpm+ts73JI8CVIyeT2+GAm1H+ejw wQAg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1682903461; x=1685495461; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=Q8fXpFKn27V7m9JqCU+c5eN8wHyg+o03ZOHVKHdJOgM=; b=IfySXcIlUEj/jbjC4jtESLSdDIz0jMly9PSlA6lUNQEalJvnm+4qO2w+/mmHstbnm5 9yakj6DWZ+wb+/MBYcdUPqyrOyIBb19UV1iC/IJYkhW1qxTGnGOu/d8r/kaVeb7ciT+m 3Wu7qNVRmtoIIMjgOxunFrgj8EcPPn08mj4eYzfEnxVGMMDF55yqHxasDMkjusslYErr uuS8T5d0Hx5h0Bq9vPIuX5b/41Sm0epRUpiDoDPr0BTdpR0mJhO3Usrg24A48G99rn/O 3qbMJLMUj+E3QL6D36fKua2/on4Bo386NS6eif7+nsXRb8M+AZcOaY8JHG2QHzl48kAr SlXw== X-Gm-Message-State: AC+VfDwx8ZRu9P0CYID+g7F6toIBoSY6KWABIsTTf2ThQm9ybt+oe7nI exf+dWUicA83Zbb+T14Ii4wfdZqLmU9b5rXOK2TC4Q== X-Google-Smtp-Source: ACHHUZ5tiL1Ty0hNfUHrl0w6K/zx/vpq1GMPm987lLs8nF2bjGIgqsN4DPqqF9We+OVhX40xeNUG4fiVL1ypDgvJCEo= X-Received: by 2002:a17:907:928d:b0:94f:553:6fd6 with SMTP id bw13-20020a170907928d00b0094f05536fd6mr11525832ejc.24.1682903461040; Sun, 30 Apr 2023 18:11:01 -0700 (PDT) List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Warner Losh Date: Sun, 30 Apr 2023 19:10:49 -0600 Message-ID: Subject: Re: BHYVE_SNAPSHOT To: Mario Marietto Cc: Tomek CEDRO , Matthew Grooms , Graham Perrin , Ed Maste , FreeBSD Hackers , Virtualisation on FreeBSD , Elena Mihailescu , Mihai Carabas , gusev.vitaliy@gmail.com Content-Type: multipart/alternative; boundary="000000000000fca5b605fa977e0b" X-Rspamd-Queue-Id: 4Q8lX72gqHz4d5m X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TAGGED_RCPT(0.00)[] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --000000000000fca5b605fa977e0b Content-Type: text/plain; charset="UTF-8" "Wow! That's eye popping" On Sun, Apr 30, 2023, 6:46 PM Mario Marietto wrote: > whats the meaning of o_O ? > > Il lun 1 mag 2023, 02:04 Tomek CEDRO ha scritto: > >> o_O >> >> -- >> CeDeROM, SQ7MHZ, http://www.tomek.cedro.info >> >> On Sun, Apr 30, 2023, 23:42 Matthew Grooms wrote: >> >>> On 4/29/23 06:17, void wrote: >>> > Hi, >>> > >>> > Where can I read up about the recently introduced BHYVE_SNAPSHOT ? >>> > >>> > I can only find terse information about what it does (in man 5 >>> src.conf) >>> > but not about how to use it and/or why. >>> >>> This began as sponsored student work with the Politehnica University of >>> Bucharest back in 2016 with an eye toward developing Live MIgration as a >>> feature. The initial bhyve save/restore patch was committed back in 2020 >>> ... >>> >>> https://reviews.freebsd.org/rS360648 >>> >>> Student projects related to bhyve continued until last year, but we gave >>> up due to there being such a massive accumulation of patches with no >>> path to getting them committed. We tried reaching out to project >>> maintainers and the FreeBSD foundation alike for support and feedback, >>> but there seems to be little to no interest. There have also been >>> attempts by companies that rely on these features to and get them >>> improved and committed. Unfortunately they don't appear to be having >>> much luck either ... >>> >>> https://reviews.freebsd.org/D38858#885651 >>> >>> Would you like to see support for VM snapshots in the generic kernel? >>> How about support for saving/restore checkpoints using QCOW2, VMDK via >>> libvdsk? How about support for warm or live migration? How about USB >>> device pass-through? There are experimental patches for all these >>> features that were developed by students at UPB. In a lot of cases, >>> there are open reviews that have been waiting on feedback for ages. Here >>> is a a presentation given by Elena from UPB just last month at the >>> FreeBSD devsumit in Tokyo ... >>> >>> >>> https://wiki.freebsd.org/DevSummit/202303?action=AttachFile&do=view&target=Presentation+-+bhyvecon.pdf >>> >>> The case is quite plain. I'm not sure what the solution is to this >>> problem. I'd love to hear feedback from the community about how I've got >>> this completely wrong and how the course could be corrected. That would >>> be something. >>> >>> -Matthew >>> >>> >>> >>> --000000000000fca5b605fa977e0b Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
"Wow! That's eye popping"

On Sun, Apr 30, 20= 23, 6:46 PM Mario Marietto <ma= rietto2008@gmail.com> wrote:
whats the meaning of o_O ?

Il lun 1 mag 2023, 02:04 Tomek= CEDRO <tomek@cedro.info> ha scritto:
o_O

--
CeDeROM, SQ7MHZ, http://www.tomek.cedro.info

On Sun, Apr 30, 2023, 23:42 Matthew Grooms <mgrooms@shrew.n= et> wrote:
On 4/29/23 06:17,= void wrote:
> Hi,
>
> Where can I read up about the recently introduced BHYVE_SNAPSHOT ?
>
> I can only find terse information about what it does (in man 5 src.con= f)
> but not about how to use it and/or why.

This began as sponsored student work with the Politehnica University of Bucharest back in 2016 with an eye toward developing Live MIgration as a feature. The initial bhyve save/restore patch was committed back in 2020 ..= .

https://reviews.freebsd.org/rS3= 60648

Student projects related to bhyve continued until last year, but we gave up due to there being such a massive accumulation of patches with no
path to getting them committed. We tried reaching out to project
maintainers and the FreeBSD foundation alike for support and feedback,
but there seems to be little to no interest. There have also been
attempts by companies that rely on these features to and get them
improved and committed. Unfortunately they don't appear to be having much luck either ...

https://reviews.freebsd.or= g/D38858#885651

Would you like to see support for VM snapshots in the generic kernel?
How about support for saving/restore checkpoints using QCOW2, VMDK via
libvdsk? How about support for warm or live migration? How about USB
device pass-through? There are experimental patches for all these
features that were developed by students at UPB. In a lot of cases,
there are open reviews that have been waiting on feedback for ages. Here is a a presentation given by Elena from UPB just last month at the
FreeBSD devsumit in Tokyo ...

https://wiki.freebsd.org/D= evSummit/202303?action=3DAttachFile&do=3Dview&target=3DPresentation= +-+bhyvecon.pdf

The case is quite plain. I'm not sure what the solution is to this
problem. I'd love to hear feedback from the community about how I'v= e got
this completely wrong and how the course could be corrected. That would be something.

-Matthew



--000000000000fca5b605fa977e0b--