From nobody Tue Jun 07 06:18:09 2022 X-Original-To: freebsd-xen@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7F1251BD1E40 for ; Tue, 7 Jun 2022 06:18:16 +0000 (UTC) (envelope-from buhrow@nfbcal.org) Received: from nfbcal.org (ns.NFBCAL.ORG [157.22.230.125]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "nfbcal.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LHKsy4f6nz3kT8 for ; Tue, 7 Jun 2022 06:18:13 +0000 (UTC) (envelope-from buhrow@nfbcal.org) Received: from nfbcal.org (localhost [127.0.0.1]) by nfbcal.org (8.15.2/8.14.1-NFBNETBSD) with ESMTPS id 2576I9nU026022 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Mon, 6 Jun 2022 23:18:09 -0700 (PDT) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.102.2 at lothlorien.nfbcal.org Received: (from buhrow@localhost) by nfbcal.org (8.15.2/8.12.11) id 2576I9NI026060; Mon, 6 Jun 2022 23:18:09 -0700 (PDT) Message-Id: <202206070618.2576I9NI026060@nfbcal.org> From: Brian Buhrow Date: Mon, 6 Jun 2022 23:18:09 -0700 In-Reply-To: X-Mailer: Mail User's Shell (7.2.6 beta(4.pl1)+dynamic 20000103) To: Roger Pau =?utf-8?B?TW9ubsOp?= Subject: Re: Stable/13 doesn't boot with xen Cc: freebsd-xen@freebsd.org, buhrow@nfbcal.org X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (nfbcal.org [127.0.0.1]); Mon, 06 Jun 2022 23:18:09 -0700 (PDT) X-Rspamd-Queue-Id: 4LHKsy4f6nz3kT8 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of buhrow@nfbcal.org designates 157.22.230.125 as permitted sender) smtp.mailfrom=buhrow@nfbcal.org X-Spamd-Result: default: False [-3.00 / 15.00]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+a:ns.nfbcal.org:c]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:7091, ipnet:157.22.0.0/16, country:US]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.70)[-0.705]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[nfbcal.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-xen]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-xen List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-xen@freebsd.org X-BeenThere: freebsd-xen@freebsd.org hello. Following up on my recent post, here is the log of the failed shutdown from FreeBSD head. This probably doesn't tell you everything, but hopefully it will give you a clue. -thanks -Brian Jun 6 10:25:34 xen-lothlorien shutdown[1582]: reboot by buhrow: Stopping sshd. Waiting for PIDS: 1292. Stopping cron. Waiting for PIDS: 1276. Stopping devd. Waiting for PIDS: 537. Writing entropy file: . Writing early boot entropy file: . Terminated . Jun 6 10:25:34 xen-lothlorien syslogd: exiting on signal 15 Waiting (max 60 seconds) for system process `vnlru' to stop... done Waiting (max 60 seconds) for system process `syncer' to stop... Syncing disks, vnodes remaining... 2 3 2 1 0 done All buffers synced. Uptime: 39m13s GEOM_MIRROR^Oyk^[ce gptback: provider destroyed. GEOM_MIRROR: Device gptswap: provider destroyed. GEOM_MIRROR: Device gptswap destroyed. GEOM_MIRROR: Device gptroot: provider destroyed. GEOM_MIRROR: Device gptroot destroyed. uhub4: detached uhub0: detached uhub2: detached uhub3: detached uhub1: detached Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address = 0x188 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff82cafe74 stack pointer ^O^R = 0x28:0xfffffe00d18a9bb0 yk^[y nter = 0x28:0xfffffe00d18a9bb0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 0 (xbbd0 taskq) trap number = 12 panic: page fault cpuid = 0 time = 1654536343 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d18a9970 vpanic() at vpanic+0x151/frame 0xfffffe00d18a99c0 panic() at panic+0x43/frame 0xfffffe00d18a9a20 trap_fatal() at trap_fatal+0x387/frame 0xfffffe00d18a9a80 trap_pfault() at trap_pfault+0xab/frame 0xfffffe00d18a9ae0 calltrap() at calltrap+0x8/frame 0xfffffe00d18a9ae0 --- trap 0xc, rip = 0xffffffff82cafe74, rsp = 0xfffffe00d18a9bb0, rbp = 0xfffffe00d18a9bb0 --- dmu_objset_zil() at dmu_objset_zil+0x4/frame 0xfffffe00d18a9bb0 zil_open() at zil_open+0xf/frame 0xfffffe00d18a9bd0 l_ensure_zilog() at zvol_ensure_zilog+0xf1/frame 0xfffffe00d18a9bf0 zvol_geom_bio_strategy() at zvol_geom_bio_strategy+0x90/frame 0xfffffe00d18a9c70 xbb_dispatch_dev() at xbb_dispatch_dev+0x274/frame 0xfffffe00d18a9d20 xbb_run_queue() at xbb_run_queue+0xbf5/frame 0xfffffe00d18a9e40 taskqueue_run_locked() at taskqueue_run_locked+0xaa/frame 0xfffffe00d18a9ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xc2/frame 0xfffffe00d18a9ef0 fork_exit() at fork_exit+0x80/frame 0xfffffe00d18a9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00d18a9f30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: panic [ thread pid 0 tid 100355 ] Stopped at kdb_enter+0x32: movq $0,0x12a22a3(%rip) db> reboot (XEN) d0v0 Unexpected vmexit: reason 3 (XEN) domain_crash called from vmx.c:4460 (XEN) Domain 0 (vcpu#0) crashed on cpu#1: (XEN) ----[ Xen-4.16.0 x86_64 debug=n Not tainted ]---- (XEN) CPU: FLAGS: 0000000000000093 CONTEXT: hvm guest (d0v0) (XEN) rax: 000000006e458498 rbx: fffffe00d35bc720 rcx: 000006d0ca72787c (XEN) rdx: 00000000000006d0 rsi: 000006d06e44de28 rdi: 000000000007a120 (XEN) rbp: fffffe00d18a9550 rsp: fffffe00d18a9510 r8: 0000000000000000 (XEN) r9: ffffffff81bd4c97 r10: ffffffff81bd4c97 r11: d9ff9c96919e8f00 (XEN) r12: 0000000000000004 r13: 0000000000000000 r14: 0000000000000001 (XEN) r15: ffffffff81a5b430 cr0: 000000008005003b cr4: 00000000000606e0 (XEN) cr3: 000000000281e002 cr2: 0000000000000188 (XEN) fsb: 0000000822808080 gsb: ffffffff82a10000 gss: 0000000000000000 (XEN) ds: 003b es: 003b fs: 0013 gs: 001b ss: 0028 cs: 0020 (XEN) Hardware Dom0 crashed: rebooting machine in 5 seconds.