Re: HEADS-UP: pkgbase pkg upgrade breaks systems Re: after updating to latest, pkg base segfaults and leaves me unbootable

From: Dan Mahoney (Ports) <freebsd_at_gushi.org>
Date: Sat, 09 Aug 2025 08:58:34 UTC

> On Aug 9, 2025, at 12:55 AM, Florian Smeets <flo@smeets.xyz> wrote:
> 
> Adding current@ to CC
> 
> On 09.08.25 01:38, Dan Mahoney wrote:
>> 
>> 
>> (Resending from phone after realizing my list-specific from: wasn’t set, apologies for weird formatting)
>> Hey all,
>> After the recent big sleep in pkgbase, I hit the following trying to upgrade to whatever snapshot was published today:
>> [598/1127] Deleting files for p5-MIME-Base32-1.303: 100%
>> [599/1127] Deinstalling p5-MIME-Base64-3.16...
>> [599/1127] Deleting files for p5-MIME-Base64-3.16: 100%
>> Child process pid=21537 terminated abnormally: Segmentation fault
>> (oh crap)
>> root@poudriere:/home/dmahoney # pkg upgrade
>> ELF interpreter /libexec/ld-elf.so.1 not found, error 2
>> Abort
>> (double crap)
> 
> Yes, I had the same issue yesterday evening. When the system was back, I was too tired to summarize and send something to the mailing list.
> 
> FWIW, I revived the system by deleting all newer packages rm /var/cache/pkg/*snap20250808* and just untaring the stuff in /var/cache/pkg to /
> 
> cd / ; for i in `/rescue/ls -1 /var/cache/pkg/FreeBSD-* ` ; do /rescue/tar xvzf $i ; done
> 
> After that, I resorted to building from source and installing to get the system into a half way consistent state with a chance of surviving a reboot.
> 
> When starting my upgrade I saw that it wanted to remove a lot of non pkgbase packages (how are we doing to differentiate pkgbase packages and "ports" packages in the future?). I thought this might be related to the krb5 thing, so I created an up to date poudriere jail via pkgbase method and rebuilt all my pkgs, but even then I saw the same thing as Den, that pkg wanted to remove a lot of ports pkgs, as this system is not important I thought I can resolve that after the pkgbase upgrade and started the upgrade.
> 
> I didn't save scroll back. In my case I saw at the top the first ~100 pkg transactions were uninstalling pkgbase pkgs, then it upgraded some, then pkg exited with a segfault.
> 
> Leaving me with ELF interpreter /libexec/ld-elf.so.1 not found, error 2
> 
> One thing I checked was /libexec/ was completely empty.
> 
> Florian

Florian,

I'm sorry you hit this issue as well, but I feel a bit less crazy now.  At least, about this.  I'm also glad I was able to capture something you weren't.  Long live "gnu screen" being my primary window manager.

I myself had a standby VM from before we converted to pkgbase, so it's a little old, and we might need to re-create a poudriere jail or two, but I'm currently building world as well (pkgbase is in time-out, mister!).  Nothing is lost here, but if any devs would like me to run more commands, or catch more forensics, please let me know.  I suspect this might need to wait for bapt to come back, but I'm not sure.

I'm not trying to get into the recent (ahem) lively discussion thread -- but I am interested in helping solve a problem in any way.  Anyone, free to email me directly, or Paeps has my mobile number and can ping me out of band.  Since I have that other VM, I'm going to leave this VM as-is other than doing a few ls'es to figure out which jails/ports trees I need to re-create.  Sadly, I don't have a snapshot of just before the failure to try to reproduce.

-Dan