From nobody Thu Jul 14 09:49:06 2022 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Lk8pK1c5bz4WZmD for ; Thu, 14 Jul 2022 09:49:13 +0000 (UTC) (envelope-from duncan.young@pobox.com) Received: from forward5-smtp.messagingengine.com (forward5-smtp.messagingengine.com [66.111.4.239]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Lk8pJ0zlrz3cNW for ; Thu, 14 Jul 2022 09:49:11 +0000 (UTC) (envelope-from duncan.young@pobox.com) Received: from compute2.internal (compute2.nyi.internal [10.202.2.46]) by mailforward.nyi.internal (Postfix) with ESMTP id 4CAEC1942C59 for ; Thu, 14 Jul 2022 05:49:11 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute2.internal (MEProxy); Thu, 14 Jul 2022 05:49:11 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:date:feedback-id:feedback-id:from:from:in-reply-to :message-id:mime-version:reply-to:sender:subject:subject:to:to :x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm3; t=1657792151; x=1657878551; bh=KofV042zVZsDx3SZ1TPCvZV0XyMi PZ9nJg5CMXesMLU=; b=gMfIRUoe3YSlyUM7OAxm8IKwiAMwtV+ZWu0HXozLK0oe mRIvnOX09GqUDlAAVpu/lWzgxksWpwPRIIRqSlftnG9Jh8UQU3+2I5abSB6Mb0L5 hRkgKkcB7XhCvsJtKebEMnbHBkzchnAh0ej+kF362FfKWuepH+OxN9DTdGIL8r8f Z5USQi+nUWGgF/ExTYlVfiyVEw+YLSrvKkdxPTe44bx390ognV2I66K1EbrSG2zv 8HYlHB0wLEji2vK3n3rMTp6Ce9JwHqmoYHHswhB2aLmPkW8Jn0ESwibsSYNEunrX aFfzK53Nsoc5rGmmXwxrDdfQN0MpM45/Z9N06QbuZg== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvfedrudejledgvddtucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefkffggfgfvhffutgfgsehtkeertd dtfeejnecuhfhrohhmpeffuhhntggrnhcujghouhhnghcuoeguuhhntggrnhdrhihouhhn ghesphhosghogidrtghomheqnecuggftrfgrthhtvghrnhepkefghfdtudekteffvdeuie efgeeliefgffffledtfeekvdejvdduteeltdehffdtnecuvehluhhsthgvrhfuihiivgep tdenucfrrghrrghmpehmrghilhhfrhhomhepughunhgtrghnrdihohhunhhgsehpohgsoh igrdgtohhm X-ME-Proxy: Feedback-ID: icff441ad:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Thu, 14 Jul 2022 05:49:10 -0400 (EDT) Received: from mail.duncanyoung.org (mail.duncanyoung.org [10.0.0.68]) by triple0.internal (Postfix) with ESMTP id 12A011DF72C for ; Thu, 14 Jul 2022 19:49:07 +1000 (AEST) Received: from [10.0.0.107] (Linhof.duncanyoung.org [10.0.0.107]) by mail.duncanyoung.org (Postfix) with ESMTP id 03D911AE3C for ; Thu, 14 Jul 2022 19:49:07 +1000 (AEST) Message-ID: <2fc98bcb-e43a-0398-13a2-f0f50c0a411b@pobox.com> Date: Thu, 14 Jul 2022 19:49:06 +1000 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.11.0 To: freebsd-virtualization@freebsd.org Content-Language: en-AU From: Duncan Young Subject: triple faults on windows guests with bhyve 13.0-RELEASE Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4Lk8pJ0zlrz3cNW X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=gMfIRUoe; dmarc=fail reason="No valid SPF, DKIM not aligned (relaxed)" header.from=pobox.com (policy=none); spf=neutral (mx1.freebsd.org: 66.111.4.239 is neither permitted nor denied by domain of duncan.young@pobox.com) smtp.mailfrom=duncan.young@pobox.com X-Spamd-Result: default: False [-4.29 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-0.999]; NEURAL_HAM_MEDIUM(-0.99)[-0.988]; R_DKIM_ALLOW(-0.20)[messagingengine.com:s=fm3]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.239:from]; DMARC_POLICY_SOFTFAIL(0.10)[pobox.com : No valid SPF, DKIM not aligned (relaxed),none]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[messagingengine.com:+]; RCVD_TLS_LAST(0.00)[]; MLMMJ_DEST(0.00)[freebsd-virtualization]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; RCVD_COUNT_FIVE(0.00)[6]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_NEUTRAL(0.00)[?all]; TO_DN_NONE(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[] X-ThisMailContainsUnwantedMimeParts: N Hi all I've been having ongoing issues with windows ( 10, 11 and 2019 ) just spontaneously halting with  an status 3 exit (triple fault). Guests will run for weeks or days or less than an hour. I have set these up using vm-bhyve and am using virtio-net for network and nvme for disk ( storage is a file ). The host is running on 13.0-RELEASE-p11 on a Threadripper 1920 12-Core with 128Gb memory with zfs. The machine is part used as a home lab with 4 windows vms, a couple of pfsense vms, a linux vm and about 10 jails. I thought perhaps it could be the version of virtio-net (I have tried several versions and 185 seemed more stable, but last night win11 and a win10 both stopped (at different times). After a restart the win10 vm halted 5 minutes later. What I would appreciate, is some indication of where to start, to create some type of crash dumps etc. to help figure out what is causing this. regards Duncan