From nobody Mon Aug 01 14:39:17 2022 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LxLNs12CTz4Xwys; Mon, 1 Aug 2022 14:39:25 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from relay2-d.mail.gandi.net (relay2-d.mail.gandi.net [IPv6:2001:4b98:dc4:8::222]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4LxLNq5v1Zz3GBZ; Mon, 1 Aug 2022 14:39:23 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: (Authenticated sender: andriy.gapon@uabsd.com) by mail.gandi.net (Postfix) with ESMTPSA id A7F8740005; Mon, 1 Aug 2022 14:39:19 +0000 (UTC) Message-ID: <70b44a39-1df2-0f4e-42ac-9710ab82d028@FreeBSD.org> Date: Mon, 1 Aug 2022 17:39:17 +0300 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0 Thunderbird/91.11.0 Subject: Re: problem with bhyve, ryzen 5800x, freebsd guest Content-Language: en-US To: current@freebsd.org, virtualization@freebsd.org References: From: Andriy Gapon In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4LxLNq5v1Zz3GBZ X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=softfail (mx1.freebsd.org: 2001:4b98:dc4:8::222 is neither permitted nor denied by domain of avg@FreeBSD.org) smtp.mailfrom=avg@FreeBSD.org X-Spamd-Result: default: False [-3.20 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[2001:4b98:dc4:8::222:from]; MID_RHS_MATCH_FROM(0.00)[]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[current@freebsd.org,virtualization@freebsd.org]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:203476, ipnet:2001:4b98:dc4::/48, country:FR]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FREEFALL_USER(0.00)[avg]; TO_DN_NONE(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; DMARC_NA(0.00)[freebsd.org]; RCVD_TLS_ALL(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; RCVD_VIA_SMTP_AUTH(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On 2022-07-10 20:28, Gleb Smirnoff wrote: > On Thu, Jul 07, 2022 at 03:29:04PM +0300, Andriy Gapon wrote: > A> I have a strange issue with running an 'appliance' image based on > A> FreeBSD 12 in bhyve on a machine with Ryzen 5800x processor. > A> > A> The problem is that the guest would run for a while and then the host > A> would suddenly reset itself. It appears like a triple fault or > A> something with similar consequences. > A> > A> The time may be from a few dozens of minutes to many hours. > A> > A> Just to be clear, no such thing occurs if I do not run the guest. > A> Also, I have an older AMD system (pre-Zen), the problem does not happen > A> there. > A> A vanilla FreeBSD 12.3 installation that just sits idle also does not > A> cause the problem. > A> > A> Does anyone have an idea what the problem could be? > A> What workaround or diagnostics to try? > A> Anybody else seen something like this? > A> > A> Since it's the host that resets it would be hard to capture any traces. > > I also run bhyve on Ryzen since late 2021 and never had such an issue. > But not FreeBSD 12, I run the head. Thank you everyone who responded. It seems that the problem was with some BIOS configuration changes, probably related to the power settings. Once I reset everything to factory defaults (plus some minimum "safe" and well-understood changes) the problem went away. It's really surprising that I saw it only with bhyve and only with the particular kind of VMs. Perhaps there was a workload pattern that triggered a hardware bug or overloaded some specific module. Anyways, sorry for the noise and thank you for the help. -- Andriy Gapon https://standforukraine.com https://razomforukraine.org