From nobody Mon Aug 16 19:56:50 2021 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 0B4EF17600C4 for ; Mon, 16 Aug 2021 19:57:02 +0000 (UTC) (envelope-from bergerkos@yahoo.co.uk) Received: from sonic302-21.consmr.mail.ir2.yahoo.com (sonic302-21.consmr.mail.ir2.yahoo.com [87.248.110.84]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4GpQ0r5jjRz3Kxw for ; Mon, 16 Aug 2021 19:57:00 +0000 (UTC) (envelope-from bergerkos@yahoo.co.uk) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.co.uk; s=s2048; t=1629143813; bh=SxvmcSFt08JTW20HTWx6eK9LWSgyI/jjf7SlUDGRSHc=; h=Date:From:To:In-Reply-To:References:Subject:From:Subject:Reply-To; b=H8Cw3ku48jgbY04jrZmVsXMAaon6FB3VXo/otFDBHFfi9VMRsjVhtE4BjleFcrp2gZ01WLY+D/kMgT7D0MvRmrjQo9CTuc85Onb80vmM0i/ygCO7tvgHm8T3N+dWXmf96WiK5cRtFSDJeOWkQgoGRGDocvlQQMEbiLiJMmnszzb7VvOnMlbioIKM9iFTBQZYdrQYrzge8AcBl86PSuSIddbTQH+8GdWP4ite5lq1t3N+GDE7AQYl97Buld3cBgqThyhmUwnghVrs7oEmtNu623RONgW4yUvSC/WGGarvwiE072FfSdopAonQYuVwJHL7mBsjYZUwBUDADbAWxmuwcg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1629143813; bh=s/uGw/etp+3l1E1Al99t6T20XusjFpdprRZ54QCqlBK=; h=X-Sonic-MF:Date:From:To:Subject:From:Subject; b=ETD+D7F7B5aH8Ixe9gBD9xw1bnA3IudBLO1J8ZHyrOz3AmTr3q3arg+XOUZ+8atqS+LiuIBGy/XxxReJImltnKYBjEPFI+/FWZguEyKdn3tHz9TKb846OGBzO2QbCCU38ydiKR5MFFHTbL8XQ8ka9VDwRPIK7T8uX+ReuLmNyBcbT7ofZrYOLiDgySGpkVEHoJwpAYLU23ihSHjYPmwS29OuDtTic0EvhP9fnaka4FUHyASY9xS/GlPVw9gUXnOYCsMiQIcoLlDrCBz5lMI4Ashy/mhn0hG0w0vnZ2r5phKC2Fb3nFI00XtjITtAb4mH34COvcDIWUmUFSsLNeAimQ== X-YMail-OSG: WJ5zEUIVM1mfLEaamNodBd9CZBisdTXp3xQPnaWwgZkMcFfgn2HpjPQhCXabAKn _EumjMqI.4yuSkah0ileU136dCf1Y1eVPtoHMGcqlTziBBcyZXmdLKSfFuo_bHRO7LaS33yHlJSe tOyhBhG7k2qOQR6E_kYhP02zeAH5xtmfE5Lpnva6vFkBbK5StUKDkSI8OjkQaSPGy7PAKBQU46yH c2CnPJrQt3SK62EGk3zW9PJDGB7VYQCW5SBdhvTTCTHLvVROqOdM3TumMBJXGNOHRz1lCq75VAuG q.fMm4E3ybhdhihxXpcdz.38iMmTPsttcEvnhU_FpHaQLrOhS4BP40hFWQ9mZaHhZlR8uHpevFie IlE6HbsArpMGUmUi4JCxUtbzMeJQatEwJZzCb8DpGF8EY1LRGsfifYaxQmmZEFae42rNom4yhMyU DsHDRXpr.ebtcH09TaHN_A2VUZlcSjF8x07uERki6MvEGdAP2HQ4_a64FkacNxQ4RAs6XvrpXnom c7G_m2cda1VaAwX1pKL2tJXeXCMyoWOyQNA5wyax_8tF_JrU4Ght3KEbuSYyxyp86bIK.iBp9tIG 7gvVkOvnpmBDfjGTJKSNG0v8GvwKV.iDSGgagGvrW4UjsafTl6msy422zMB.04aGabeleh2FqDJe BdGCfxcvdjxIijKad7AX88qQ8Ofl2MgFVzEyaMZWO1hRO_RdYnB4VgW6O8gfT9fw1MEyGDEOx7wh QQtD9dr.D5ZJNTb4RqlGQSCiK1Ciad7eNgo34Gy08aQ6BMeZhBQLjGJs1KI82mzYUq.aO8VbFIJC p0wuLGYEFBDjPqheTDIbbmNXBT.aYbYzzgmcJz_nnP7GWOi7oswkD2AIA6w_goex1X9aURwEvsYD kwJTTBrMjhpC8Sn4XXXgLCT3KtcuIWR6NqmJto7IfqO8wMuMulASYl0PiVdM3GytXRDhRmCckwGl uSgi_6bvF5Ey00hJJ0Z8zmi37noprlbcQfN._1Cc30EhcZoNbT6EQdwn6KzEGC4ocqYxL9tKqDVB y3g7_S49R0CnE9QPV2n_B1.141BVDyLACWvtvymdocXvpC.RCMnKBwyTnl3Z79QdGJh5Wl80YJtW ZMBvru2oi9dfw9p9U7ByzH_Er937kwtblV1XptPer6ko0LO6rG_TIznkpC8mAlSAPbOpg0mSwypR zJsvDkVrCg0irCg3XSNF45ear5.qOIlYND9BMAyUjk.drtbH9VcR02UY2lhaQyF0CfeXpZvKgUCp XO9GYrqjVJh2GC6uyTLzEhb0vfACSz1Ow_Ug06RplHgcAM4XaY49_7qsrefaZybkb1lPnH.G_7bl oAoa2rOku6O7bfl8fFXJKmoiC.wmayWaCfxuPer51QywI0iWdtQnMRmdNx_4ERhbEbnBXvsMBN6O ItiW1KyCAXrzhEiAQDiNMjt96QjNLydjD2ZqFXVaUVbAzHwDZ83Qzzy9cltoIFeU5y_Gf_IlO91l hJ7Z9YIQq.BO9ox8X77GNaWPiHE5hi2J6E8q3HmAlhmVEsswKUhS0OPN5oGj9PG0Y7Rx8v7D6R90 iy0DJMPpFEKgQUomXHwDUboA_N0V.sXoinmRje8VnVFG4wpbxcY6xCUnAaZC5YpnGW8Vtdo_m0ti BZtChkWy._700ihfHb_xaJ0y2ogS.avgoB690FHZ.QEFTev..5BbgKcQgQpt9Dq3ZeHylRKUFboU EOskxeeO5YB5fGuFAkzAFlE38agPMaYxaX7EKxwO6nsnOBkxFV121A07HQwWMx9SRrm_BuvPRWvn yJJcIuaOQwlMcwYKagoSpRq49Ne7v5oX_Uk3WocTgaemqhnUsx4u0HxmW1SRebMz0aXKpqsqgbuL PwumAdmdE.x.25cu3GmjD5qtEJ7dDtkDdLIm3V4S5hYr8v4ekGhDlFqE7Tjhj1yYK_eXpYgoAzdV ExWcsc9g_scdumfouZaZF_Ys.01CTddnXTTyx38XqJxRd9gRYKN4wQ_xlj_Q0YopbZ5Z4fVHvRbz fvpySJ3JnckZCGXKzhHt1L5gFuemsTsIy34DhBqjvAGhrJcY92jzhqB2dQsGLiII4hCR43SqwZ.y mltllZ_VwS9lg5zJiImkrX412HuTZdjBytUZ0jY9ykDzatAkO6l.U0a61_SPNhhLjXsXJ7MxBZ5K Pr4ppfSl.gmQo1KWEK7f08N40sNQ7gpYAr03qO3NNJFzVuB.pkoBMmyOshWeC1c8p5d3AdNP2qZ8 VtMWsNTp1gMPMPGRh.ne6WJuGxl3tagEbFsjP6zWjqwNuwxElJRIShMINrqjNmes- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic302.consmr.mail.ir2.yahoo.com with HTTP; Mon, 16 Aug 2021 19:56:53 +0000 Date: Mon, 16 Aug 2021 19:56:50 +0000 (UTC) To: "freebsd-virtualization@FreeBSD.org" Message-ID: <1464014049.1262174.1629143810702@mail.yahoo.com> In-Reply-To: <272551640.837942.1629097084918@mail.yahoo.com> References: <1719430894.822301.1629094618334.ref@mail.yahoo.com> <1719430894.822301.1629094618334@mail.yahoo.com> <272551640.837942.1629097084918@mail.yahoo.com> Subject: Re: debug crash List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_1262173_2045274447.1629143810700" X-Mailer: WebService/1.1.18850 YMailNorrin X-Rspamd-Queue-Id: 4GpQ0r5jjRz3Kxw X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.co.uk header.s=s2048 header.b=H8Cw3ku4; dmarc=pass (policy=reject) header.from=yahoo.co.uk; spf=pass (mx1.freebsd.org: domain of bergerkos@yahoo.co.uk designates 87.248.110.84 as permitted sender) smtp.mailfrom=bergerkos@yahoo.co.uk X-Spamd-Result: default: False [-4.00 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.co.uk:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.co.uk]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_ONE(0.00)[1]; DKIM_TRACE(0.00)[yahoo.co.uk:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.co.uk,reject]; RCVD_IN_DNSWL_NONE(0.00)[87.248.110.84:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; TO_DN_EQ_ADDR_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[yahoo.co.uk]; ASN(0.00)[asn:34010, ipnet:87.248.110.0/24, country:GB]; RCVD_COUNT_TWO(0.00)[2]; RWL_MAILSPIKE_POSSIBLE(0.00)[87.248.110.84:from] Reply-To: bergerkos@yahoo.co.uk From: Kostya Berger via freebsd-virtualization X-Original-From: Kostya Berger X-ThisMailContainsUnwantedMimeParts: N ------=_Part_1262173_2045274447.1629143810700 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable OK, here is another part of the crash message:vm exit[0] reason VMX ip 0x00000000015eaa03 = inst_length 2 status 0 exit_reason 2 (Triple fault) = qualification 0x0000000000000000 inst_type 0 inst_error 0Additional information: this ONLY happens to Windows-10 based = VMs -- whether existing one or just a Win-10 Pro installation ISO booted fo= r initial setup.Tried to boot Ubuntu on the same machine -- all boots fine. With kindest regards, Kostya Berger =20 =20 On Monday, 16 August 2021, 09:58:54 GMT+3, Kostya Berger via freebsd-vi= rtualization wrote: =20 =20 Forgot to mention, I'm using 2 passthrough PCI-e cards. But the problem is= , it crashes even without passthrough enabled. With kindest regards, Kostya Berger =20 =20 =C2=A0 =C2=A0 On Monday, 16 August 2021, 09:16:58 GMT+3, Kostya Berger wrote:=C2=A0=20 =20 Hello, dear friends :) I"m on 13.0-p3. Suddenly, after some hardware reconfiguration (PCI-e cards = exchanged slots) my bhyve stopped working.In particular, in my Win 10 VM, i= t goes as far as offer to type in BitLocker password, after which starts bo= oting and immediately crashes. However, I tried to start afresh without ANY= disks attached, except Win 10 installation ISO. Gets as far as 'type a key= to boot from CD', then crashes on an attempt to boot. This is the message that I see on the screen:./bhyve-1: line 11: =C2=A02954= Abort trap =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0bhyve -S -c soc= kets=3D1,cores=3D4,threads=3D2 -m 8G -H -w -s 0,hostbridge -s 4,virtio-blk,= win-alt.img,sectorsize=3D512/4096 -s 5,ahci-cd,Win10_21H1_English_x64.iso -= s 29,fbuf,tcp=3D0.0.0.0:5900,w=3D1600,h=3D900,wait -s 30,xhci,tablet -s 31,= lpc -l com1,stdio -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd w= indows-10 For the purity of experiment, I tried it with a fresh installation on the s= ame machine -- same thing. So I assume it is hardware related. As such, I r= ecall in the past there was a patch=20 NOTE: in the past, pre-13.0, I had similar crash related to a PCI-e card wi= th multiple bars, as described here:https://forums.freebsd.org/threads/bhyv= e-pci-passthru-windows-10-problem.74265/ However, the patch cured that, and it has long been incorporated into the b= hyve code... But the card is still in my machine, it's a 4-port Intel NIC. = I haven't yet tried removing this or that card from my system... didn't hav= e the time yet. But I'd like to keep having it, of course... My question is, how can I debug this crash? In dmesg it only says:pid 2954 = (bhyve), jid 0, uid 0: exited on signal 6=20 With kindest regards, Kostya Berger =20 =C2=A0 =20 ------=_Part_1262173_2045274447.1629143810700--