Re: October 2026 stabilization week

From: Dima Panov <fluffy_at_FreeBSD.org>
Date: Tue, 27 Oct 2026 12:28:14 UTC

On 27.10.2026 15:05, Konstantin Belousov wrote:
> On Tue, Oct 27, 2026 at 01:52:43PM +0300, Dima Panov wrote:
>> Hello!
>>
>>
>> Houston, we have a problem!
>>
>> When building latest stabweek world in poudriere on my aarch64 machine, I've got an error in libthr when pkg command is called:
>>
>>
>> ===> Creating FreeBSD-kernel-generic-nodebug-16.snap20261026210619
>> Fatal error 'mutex 0x41814480 own 0x8c935 is on list 0x0 0x409e0008' at line 154 in file /opt/poudriere/jails/16aarch64/usr/src/lib/libthr/thread/thr_mutex.c (errno = 0)
>> Abort trap (core dumped)
>>
>> Host system was a 16.0-CURRENT #0 main-461da47e45e7: Sun Oct 18 02:22:28 MSK 2026
>> Same error on host FreeBSD 16.0-CURRENT #0 main-5250c9890848: Tue Oct 27 00:49:17 MSK 2026
>>
>> But when I revert host to 16.0-CURRENT #0 main-17af098383ba: Fri Sep 18 23:23:19 MSK 2026
>> all builds runs without any errors
>>
>> Looks like some of latest commits between Sept 18 and Oct18 in libthr causes this failure
>>
>> 4472a048cf95c9c1593a8b04655a59096b44b0c9
>> 192781bf5d047cceff3a1947bfc754c8b5eb0835
>> 1d21e67e720a08992e81d626cff9d76524a81f22
>> 627e7d5b72cf967eae3cd9e9e0707ce0ff63a4da
>> 99edcc3bd52614c6cf972ea8424a7807ed3fe1e3
>> de2c0f157a9cce0b763da9ae97ada870fa4d1824
>> 305c3044e0249ea24a9b4571dfa6ae319a5bcdec
>> 5fb07bbcd5d5d9a865d9e7765fb93e9ba5edef1c
>> a0e152973613e0d0d55257f4e1f614509b7ec4c9
>> 894f70a2bd8c7f67f131b76b9ce122a752818af3
> 
> What is the program that asserted?
> Get the core dump and backtrace.

Oh, found another related core with more info
On a host system while upgrading port's packages (host was 16.0-CURRENT #0 main-461da47e45e7: Sun Oct 18 02:22:28 MSK 2026)

sudo gdb /usr/local/libexec/packagekitd packagekitd.core
GNU gdb (GDB) 15.1 [GDB v15.1 for FreeBSD]
[skip]
Type "apropos word" to search for commands related to "word"...
Reading symbols from /usr/local/libexec/packagekitd...
(No debugging symbols found in /usr/local/libexec/packagekitd)
[New LWP 839108]
[New LWP 657547]
[New LWP 838888]
[New LWP 838889]
[New LWP 838890]
[New LWP 839107]

warning: .dynamic section for "/lib/libthr.so.3" is not at the expected address (wrong library or version mismatch?)

warning: .dynamic section for "/lib/libgcc_s.so.1" is not at the expected address (wrong library or version mismatch?)

warning: .dynamic section for "/libexec/ld-elf.so.1" is not at the expected address (wrong library or version mismatch?)
Core was generated by `/usr/local/libexec/packagekitd'.
Program terminated with signal SIGSEGV, Segmentation fault.
Address not mapped to object.
#0  0x00000000436ff31c in unixShmSystemLock () from /usr/local/lib/libpkg.so.4
[Current thread is 1 (LWP 839108)]
(gdb) bt
#0  0x00000000436ff31c in unixShmSystemLock () at /usr/local/lib/libpkg.so.4
#1  0x00000000436fe268 in unixShmLock () at /usr/local/lib/libpkg.so.4
#2  0x00000000437064f0 in walTryBeginRead () at /usr/local/lib/libpkg.so.4
#3  0x0000000043700fc8 in sqlite3PagerSharedLock () at /usr/local/lib/libpkg.so.4
#4  0x00000000437005f0 in btreeBeginTrans () at /usr/local/lib/libpkg.so.4
#5  0x0000000043716248 in sqlite3VdbeExec () at /usr/local/lib/libpkg.so.4
#6  0x00000000436e79dc in sqlite3_step () at /usr/local/lib/libpkg.so.4
#7  0x00000000438cc0ec in pkgdb_file_exists () at /usr/local/lib/libpkg.so.4
#8  0x00000000438f5a84 in pkg_jobs_solve () at /usr/local/lib/libpkg.so.4
#9  0x0000000041c8410c in ??? () at /usr/local/lib/packagekit-backend/libpk_backend_freebsd.so
#10 0x0000000000247b4c in ??? ()
#11 0x00000000404c0748 in ??? () at /usr/local/lib/libglib-2.0.so.0
#12 0x00000000406c4968 in _thr_umutex_unlock2 (id=<optimized out>, defer=<optimized out>, mtx=<optimized out>) at /opt/poudriere/jails/16aarch64/usr/src/lib/libthr/thread/thr_umtx.h:157
#13 _thr_umutex_unlock (id=<optimized out>, mtx=<optimized out>) at /opt/poudriere/jails/16aarch64/usr/src/lib/libthr/thread/thr_umtx.h:187
#14 _thr_detach (pthread=0x41c31018) at /opt/poudriere/jails/16aarch64/usr/src/lib/libthr/thread/thr_detach.c:58
#15 0x0000000000000000 in ??? ()
(gdb)

-- 
Sincerely,
Dima (fluffy@FreeBSD.org, https://t.me/FluffyBSD, @fluffy:matrix-dev.freebsd.org)
(desktop, kde, x11, office, ports-secteam)@FreeBSD team