Re: October 2026 stabilization week

On Tue, Oct 27, 2026 at 03:23:28PM +0300, Dima Panov wrote:
> 
> 
> On 27.10.2026 15:05, Konstantin Belousov wrote:
> > On Tue, Oct 27, 2026 at 01:52:43PM +0300, Dima Panov wrote:
> > > Hello!
> > > 
> > > 
> > > Houston, we have a problem!
> > > 
> > > When building latest stabweek world in poudriere on my aarch64 machine, I've got an error in libthr when pkg command is called:
> > > 
> > > 
> > > ===> Creating FreeBSD-kernel-generic-nodebug-16.snap20261026210619
> > > Fatal error 'mutex 0x41814480 own 0x8c935 is on list 0x0 0x409e0008' at line 154 in file /opt/poudriere/jails/16aarch64/usr/src/lib/libthr/thread/thr_mutex.c (errno = 0)
> > > Abort trap (core dumped)
> > > 
> > > Host system was a 16.0-CURRENT #0 main-461da47e45e7: Sun Oct 18 02:22:28 MSK 2026
> > > Same error on host FreeBSD 16.0-CURRENT #0 main-5250c9890848: Tue Oct 27 00:49:17 MSK 2026
> > > 
> > > But when I revert host to 16.0-CURRENT #0 main-17af098383ba: Fri Sep 18 23:23:19 MSK 2026
> > > all builds runs without any errors
> > > 
> > > Looks like some of latest commits between Sept 18 and Oct18 in libthr causes this failure
> > > 
> > > 4472a048cf95c9c1593a8b04655a59096b44b0c9
> > > 192781bf5d047cceff3a1947bfc754c8b5eb0835
> > > 1d21e67e720a08992e81d626cff9d76524a81f22
> > > 627e7d5b72cf967eae3cd9e9e0707ce0ff63a4da
> > > 99edcc3bd52614c6cf972ea8424a7807ed3fe1e3
> > > de2c0f157a9cce0b763da9ae97ada870fa4d1824
> > > 305c3044e0249ea24a9b4571dfa6ae319a5bcdec
> > > 5fb07bbcd5d5d9a865d9e7765fb93e9ba5edef1c
> > > a0e152973613e0d0d55257f4e1f614509b7ec4c9
> > > 894f70a2bd8c7f67f131b76b9ce122a752818af3
> > 
> > What is the program that asserted?
> 
> pkg when generates packages for recently build jail
> 
> > Get the core dump and backtrace.
> 
> /usr/obj/opt/poudriere/jails/16aarch64/usr/src/arm64.aarch64/packages/utilities$ sudo gdb pkg pkg.core
> GNU gdb (GDB) 15.1 [GDB v15.1 for FreeBSD]
> [skip]
> Type "apropos word" to search for commands related to "word"...
> Reading symbols from pkg...
> Reading symbols from /usr/lib/debug//usr/sbin/pkg.debug...
> [New LWP 170934]
> Core was generated by `pkg -o ABI=FreeBSD:16:aarch64 -o OSVERSION=1600029 -o ALLOW_BASE_SHLIBS=yes -o S'.
> Program terminated with signal SIGABRT, Aborted.
> Sent by kill() from pid 45354 and user 0.
> #0  0x0000000040fd52f4 in ?? ()
> (gdb) bt
> #0  0x0000000040fd52f4 in ?? ()
> #1  0x00000000002fb784 in ?? ()
> Backtrace stopped: previous frame identical to this frame (corrupt stack?)
> (gdb)

You should build the system libraries with the debug symbols.
Otherwise the backtrace is not useful.