From nobody Mon May 01 00:04:22 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Q8k3S5J8zz48V6Y for ; Mon, 1 May 2023 00:04:36 +0000 (UTC) (envelope-from tomek@cedro.info) Received: from mail-yw1-x1136.google.com (mail-yw1-x1136.google.com [IPv6:2607:f8b0:4864:20::1136]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Q8k3S3GzNz4TFR for ; Mon, 1 May 2023 00:04:36 +0000 (UTC) (envelope-from tomek@cedro.info) Authentication-Results: mx1.freebsd.org; none Received: by mail-yw1-x1136.google.com with SMTP id 00721157ae682-55a44a2637bso7225567b3.2 for ; Sun, 30 Apr 2023 17:04:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cedro.info; s=google; t=1682899475; x=1685491475; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=WS/+SmDg9E6kfzNV+E23WyBQMGjpljvUh1xy/4KnyDI=; b=h2eawhLNv5F7oRQ3+NSJTcOyP7n0JVkWgTx83uOv0UZ5mXdZY85Y3DMRHUuQUGdF0a qG7aBWbATHaKGjBO6ZT65kIA/+uwkNbqCUmWR/nwcwEHzbDDL3/qedybKjqRUt8+/cOL AdNuW8dEwVeC0GIlruIWN/VaaA2EAtqR+8M9qBevKuFA2IvWlHpYtrdbbjMoYFa4e9Tx cFi/Bgv+V6HnHNUPBTzrOGdIaCQDIEP50IIM2tcGGwWXD2dIxuYSmr3fa43cj1o4nqr1 icisuaAysV/wXYhzUFdrzvbqE0yJlztIiZqQ8tI9ubhrKhHQD0+TXXLj/us0O3DHuFax y23g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1682899475; x=1685491475; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=WS/+SmDg9E6kfzNV+E23WyBQMGjpljvUh1xy/4KnyDI=; b=AB6rHH6jyxOxZz2D2hXbR2DnB+/7qxlVNTd+7cJFXcpeiseazvs14yUBJNHkRUBi9s y8ji6ddKcWgPxm4O8u0HsYHavVPyK3TSytlB7o3yrAKvvfAXH8xveNvi2MOmi9un7VfF L29vE/jSJ3N+iebFMC635T0w8G7FqCdrVbOtM5HP8V+9/u29hFOR+YfKdHUh98zwonSw BQa9YsnaxIopeM4m972X9VtrIHGk7sifqo40jUSJRI+upoEJzSV/o1K3qMTfAOHIjcmp z5al5NY6225Vibr6OpW/wJmny4/DBUfHyJdEdvFp9g7mo0FsmcY68+3UsuwtPUQ9KbOa Z2Wg== X-Gm-Message-State: AC+VfDwYqSoo+Ia1soTS3rA/qId2d4/piQoVDZOaJrOi7lEUySaHf2ON K4q4WAld7pbWeW1gSTOkg3rFyA== X-Google-Smtp-Source: ACHHUZ7CP5vDtBRIxvautD8B9t4OVqlfgDANkt/FqORg3gwZ8Ld6bgYtk+zgsla4VgNGuWgWMvw0Aw== X-Received: by 2002:a0d:d8c4:0:b0:559:fb89:e2c4 with SMTP id a187-20020a0dd8c4000000b00559fb89e2c4mr4843838ywe.22.1682899474967; Sun, 30 Apr 2023 17:04:34 -0700 (PDT) Received: from mail-yw1-f181.google.com (mail-yw1-f181.google.com. [209.85.128.181]) by smtp.gmail.com with ESMTPSA id d190-20020a0df4c7000000b0054fcbf35b94sm6943683ywf.87.2023.04.30.17.04.34 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 30 Apr 2023 17:04:34 -0700 (PDT) Received: by mail-yw1-f181.google.com with SMTP id 00721157ae682-54fc6949475so27382557b3.3; Sun, 30 Apr 2023 17:04:34 -0700 (PDT) X-Received: by 2002:a0d:d648:0:b0:55a:535c:5c53 with SMTP id y69-20020a0dd648000000b0055a535c5c53mr1756086ywd.8.1682899473993; Sun, 30 Apr 2023 17:04:33 -0700 (PDT) List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Tomek CEDRO Date: Mon, 1 May 2023 02:04:22 +0200 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: BHYVE_SNAPSHOT To: Matthew Grooms , Graham Perrin , Ed Maste Cc: FreeBSD Hackers , Virtualisation on FreeBSD , elenamihailescu22@gmail.com, Mihai Carabas , gusev.vitaliy@gmail.com Content-Type: multipart/alternative; boundary="0000000000005719b605fa96918e" X-Rspamd-Queue-Id: 4Q8k3S3GzNz4TFR X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; TAGGED_RCPT(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --0000000000005719b605fa96918e Content-Type: text/plain; charset="UTF-8" o_O -- CeDeROM, SQ7MHZ, http://www.tomek.cedro.info On Sun, Apr 30, 2023, 23:42 Matthew Grooms wrote: > On 4/29/23 06:17, void wrote: > > Hi, > > > > Where can I read up about the recently introduced BHYVE_SNAPSHOT ? > > > > I can only find terse information about what it does (in man 5 src.conf) > > but not about how to use it and/or why. > > This began as sponsored student work with the Politehnica University of > Bucharest back in 2016 with an eye toward developing Live MIgration as a > feature. The initial bhyve save/restore patch was committed back in 2020 > ... > > https://reviews.freebsd.org/rS360648 > > Student projects related to bhyve continued until last year, but we gave > up due to there being such a massive accumulation of patches with no > path to getting them committed. We tried reaching out to project > maintainers and the FreeBSD foundation alike for support and feedback, > but there seems to be little to no interest. There have also been > attempts by companies that rely on these features to and get them > improved and committed. Unfortunately they don't appear to be having > much luck either ... > > https://reviews.freebsd.org/D38858#885651 > > Would you like to see support for VM snapshots in the generic kernel? > How about support for saving/restore checkpoints using QCOW2, VMDK via > libvdsk? How about support for warm or live migration? How about USB > device pass-through? There are experimental patches for all these > features that were developed by students at UPB. In a lot of cases, > there are open reviews that have been waiting on feedback for ages. Here > is a a presentation given by Elena from UPB just last month at the > FreeBSD devsumit in Tokyo ... > > > https://wiki.freebsd.org/DevSummit/202303?action=AttachFile&do=view&target=Presentation+-+bhyvecon.pdf > > The case is quite plain. I'm not sure what the solution is to this > problem. I'd love to hear feedback from the community about how I've got > this completely wrong and how the course could be corrected. That would > be something. > > -Matthew > > > > --0000000000005719b605fa96918e Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
o_O

--
= CeDeROM, SQ7MHZ, http://www.tomek.c= edro.info

On Sun, Apr 30, 2023, 23:42 Matthew Grooms <mgrooms@shrew.net> wrote:
On 4/29/23 06:17, void wrote:
> Hi,
>
> Where can I read up about the recently introduced BHYVE_SNAPSHOT ?
>
> I can only find terse information about what it does (in man 5 src.con= f)
> but not about how to use it and/or why.

This began as sponsored student work with the Politehnica University of Bucharest back in 2016 with an eye toward developing Live MIgration as a feature. The initial bhyve save/restore patch was committed back in 2020 ..= .

https://reviews.freebsd.org/rS360648

Student projects related to bhyve continued until last year, but we gave up due to there being such a massive accumulation of patches with no
path to getting them committed. We tried reaching out to project
maintainers and the FreeBSD foundation alike for support and feedback,
but there seems to be little to no interest. There have also been
attempts by companies that rely on these features to and get them
improved and committed. Unfortunately they don't appear to be having much luck either ...

https://reviews.freebsd.org/D38858#885651
Would you like to see support for VM snapshots in the generic kernel?
How about support for saving/restore checkpoints using QCOW2, VMDK via
libvdsk? How about support for warm or live migration? How about USB
device pass-through? There are experimental patches for all these
features that were developed by students at UPB. In a lot of cases,
there are open reviews that have been waiting on feedback for ages. Here is a a presentation given by Elena from UPB just last month at the
FreeBSD devsumit in Tokyo ...

https://wiki.freebsd.org/DevSummit/202303?action= =3DAttachFile&do=3Dview&target=3DPresentation+-+bhyvecon.pdf
The case is quite plain. I'm not sure what the solution is to this
problem. I'd love to hear feedback from the community about how I'v= e got
this completely wrong and how the course could be corrected. That would be something.

-Matthew



--0000000000005719b605fa96918e--