From nobody Tue Aug 31 07:05:51 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 09E96178D4A4 for ; Tue, 31 Aug 2021 07:06:01 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4GzJBJ3dd4z3q1q for ; Tue, 31 Aug 2021 07:06:00 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.16.1/8.16.1) with ESMTPS id 17V75pLb081909 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Tue, 31 Aug 2021 10:05:54 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua 17V75pLb081909 Received: (from kostik@localhost) by tom.home (8.16.1/8.16.1/Submit) id 17V75p08081908; Tue, 31 Aug 2021 10:05:51 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Tue, 31 Aug 2021 10:05:51 +0300 From: Konstantin Belousov To: Dustin Marquess Cc: FreeBSD CURRENT Subject: Re: New loader_lua.efi causes kernels to hang at boot Message-ID: References: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.5 X-Spam-Checker-Version: SpamAssassin 3.4.5 (2021-03-20) on tom.home X-Rspamd-Queue-Id: 4GzJBJ3dd4z3q1q X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N On Tue, Aug 31, 2021 at 01:29:27AM -0500, Dustin Marquess wrote: > On Mon, Aug 30, 2021 at 4:33 AM Konstantin Belousov wrote: > > > On Sun, Aug 29, 2021 at 08:27:02PM -0500, Dustin Marquess wrote: > > > I am upgrading a -CURRENT box from a build that's exactly 2 weeks old to > > > one I built about 2 hours ago. After installkernel I updated the > > bootloader > > > the same way I normally do: > > > > > > # mount_msdosfs /dev/da8p1 /mnt > > > # cp /mnt/EFI/BOOT/BOOTX64.efi /mnt/EFI/BOOT/BOOTX64.bak > > > # cp loader_lua.efi /mnt/EFI/BOOT/BOOTX64.efi > > > # umount /mnt > > > > > > After rebooting, however, the kernel hangs right after: > > > > > > real memory = 137438953472 (131072 MB) > > > avail memory = 133651951616 (127460 MB) > > > ACPI APIC Table: > > > > > > It never makes it to this line: > > > > > > FreeBSD/SMP: Multiprocessor System Detected: 32 CPUs > > > FreeBSD/SMP: 2 package(s) x 8 core(s) x 2 hardware threads > > > > > > So I rebooted a selected kernel.old at the boot menu and.. same thing. > > > That's strange! > > > > > > So I booted off a USB stick, mounted the EFI partition and copied > > > BOOTX64.bak back to BOOTX64.efi and now the machine booted normally. > > > > > > So for some reason the newer loader_lua.efi is causing both the new > > kernel > > > AND the old kernel to hang, but the older loader_lua.efi seems to work > > with > > > both no problem. > > > > Show your loader.conf. > > > > Try to add > > exec="copy_staging enable" > > line to it, does it hide the problem? > > > > Indeed, it does! > > Full loader.conf is: > > comconsole_speed="115200" > console="comconsole" > boot_serial="1" > zfs_load="YES" > vfs.root.mountfrom="zfs:zroot/ROOT/default" > net.isr.maxthreads="32" > net.isr.bindthreads="1" > net.isr.maxqlimit="60480" > net.link.ifqmaxlen="90000" > kern.eventtimer.et.LAPIC.quality="1" > hw.pci.do_power_nodriver="3" > vfs.zfs.arc_max="8G" > zpool_cache_load="YES" > zpool_cache_type="/etc/zfs/zpool.cache" > zpool_cache_name="/etc/zfs/zpool.cache" > hint.apic.0.clock="0" > hint.atrtc.0.clock="0" > hint.attimer.0.clock="0" > hint.hpet.0.legacy_route="1" > kern.geom.label.disk_ident.enable="0" > kern.geom.label.gptid.enable="0" > if_cxgbe_load="NO" > if_vlan_load="YES" > if_tap_load="YES" > if_bridge_load="YES" > if_epair_load="NO" > if_lagg_load="YES" > vmm_load="YES" > ioat_load="YES" > hw.x2apic_enable="1" > hw.cxgbe.nrxq="32" > hw.cxgbe.ntxq="32" > hw.cxgbe.fl_pktshift="0" > hw.cxgbe.cong_drop="1" > hw.cxgbe.pause_settings="0" > hw.cxgbe.rdmacaps_allowed="0" > hw.cxgbe.iscsicaps_allowed="0" > hw.cxgbe.fcoecaps_allowed="0" > cc_htcp_load="YES" > machdep.hyperthreading_allowed="1" > machdep.hyperthreading_intr_allowed="1" > cpu_microcode_load="YES" > cpu_microcode_name="/boot/firmware/intel-ucode.bin" > vm.pmap.pti="0" > machdep.mitigations.rngds.enable="0" > machdep.mitigations.taa.enable="0" > machdep.mitigations.mds.disable="0" > machdep.mitigations.ssb.disable="0" > machdep.mitigations.ibrs.disable="1" > exec="copy_staging enable" I hope that 9939af1a161e5c219ece5e7c5 would fix the problem for you, i.e. system should boot with and without the exec line in loader.conf.