Re: poudriere and the user ... is it mostly a lost idea?

Reply: Paul Mather : "Re: poudriere and the user ... is it mostly a lost idea?"
Reply: Mark Millard : "Re: poudriere and the user ... is it mostly a lost idea?"
In reply to: Mark Millard : "RE: poudriere and the user ... is it mostly a lost idea?"
Go to: [ bottom of page ] [ top of archives ] [ this month ]
From: Dennis Clarke <dclarke_at_blastwave.org>
Date: Fri, 17 Jan 2025 18:30:44 UTC
On 1/15/25 21:20, Mark Millard wrote:
> Dennis Clarke <dclarke_at_blastwave.org> wrote on
> Date: Wed, 15 Jan 2025 15:16:58 UTC :
> 
>> Over the past month or so I see endless fails in builds for the big
>> three user facing window manager things. This means that a simple user
>> type person can not get a desktop. Really? Yes really. For at least a
>> month or more you can not build KDE5 nor LXDE nor XFCE desktop. . . .
> 
> Here you seem to have leaped from your context's bulk build
> problems to most everyone else's bulk builds of similar
> software having similar bulk build problems.
> 

     I apologize for the rant. Clearly a rant. Pure frustration as I try
to do some testing of the big RELEASE stuff from 13.4 up to 15-CURRENT.
It was a hand waving rant wherein I have seens build failures for weeks
and weeks and it really feels like a hit or miss throw a dart good luck
and spin the wheel maybe you are a winner today situation.

> (Since Jan-7 I'm I'm temporarily without access to the FreeBSD
> systems that I normally do. Also, I do not normally build those
> specific ports. So I do not have evidence about those from my
> own activities.)
>

     I have plenty of logs. Piles of them. Perhaps the problem is that I
am building on a 15-CURRENT machine which has poudriere jails like so :

titan# poudriere jails -l 
 

JAILNAME VERSION                              ARCH  METHOD 
TIMESTAMP           PATH 

134amd64 13.4-RELEASE-p2 1304000 3f40d5821eca amd64 git+https 
2025-01-10 10:42:08 /poudriere/jails/134amd64 

142amd64 14.2-RELEASE 1402000 c8918d6c7412    amd64 git+https 
2024-12-03 12:50:29 /poudriere/jails/142amd64 

140amd64 14.2-STABLE 1402501 e6de39be80e2     amd64 git+https 
2025-01-13 21:36:43 /poudriere/jails/140amd64 

150amd64 15.0-CURRENT 1500030                 amd64 src=/usr/src 
2025-01-12 07:44:29 /poudriere/jails/150amd64 

titan#

The one called 140stable is a bit strange given that I built it with the
branch called "releng" for 14 and what I get is 14.2-STABLE. Whatever
that is. I had the silly notion that something called "STABLE" is a good
place to build packages. A stable is where one may keep horses. Maybe
goats. Other than that I really do not know if building packages in that
jail would be of any value compared to the 142amd64 jail. Who knows?
  I surely do not.


I tend to kick off something like this :

titan# ls -lApbtr /poudriere/data/packages/ 
 

total 60 
 

drwxr-xr-x  3 root wheel 15 Jan 15 21:40 134amd64-latest/ 
 

drwxr-xr-x  3 root wheel 15 Jan 16 07:20 150amd64-2025Q1/ 
 

drwxr-xr-x  3 root wheel 15 Jan 16 07:23 140amd64-2025Q1/ 
 

drwxr-xr-x  3 root wheel 15 Jan 16 10:15 142amd64-latest/ 
 

drwxr-xr-x  3 root wheel 15 Jan 16 10:36 142amd64-2025Q1/ 
 

drwxr-xr-x  3 root wheel 15 Jan 16 14:00 150amd64-latest/ 
 

drwxr-xr-x  3 root wheel 15 Jan 16 14:09 134amd64-2025Q1/ 
 

titan#
titan#  /usr/bin/time -p idprio 0 poudriere bulk -r -j 140amd64 -p 
2025Q1 -f /root/pkg.list
[00:00:00] Creating the reference jail... done 
 

[00:00:00] Mounting system devices for 140amd64-2025Q1 
 

[00:00:01] Stashing existing package repository 
 

[00:00:01] Mounting ccache from: /var/cache/ccache 
 

[00:00:01] Mounting ports from: /poudriere/ports/2025Q1 
 

[00:00:01] Mounting packages from: 
/poudriere/data/packages/140amd64-2025Q1 

[00:00:01] Mounting distfiles from: /poudriere/distfiles 
 

/etc/resolv.conf -> 
/poudriere/data/.m/140amd64-2025Q1/ref/etc/resolv.conf 

[00:00:01] Starting jail 140amd64-2025Q1 
 

Updating /var/run/os-release done. 
 

[00:00:01] Will build as nobody:nobody (65534:65534) 
 

[00:00:01] Logs: 
/poudriere/data/logs/bulk/140amd64-2025Q1/2025-01-16_14h18m02s 

[00:00:01] Loading MOVED for 
/poudriere/data/.m/140amd64-2025Q1/ref/usr/ports 

[00:00:02] Ports supports: FLAVORS SUBPACKAGES SELECTED_OPTIONS 
 

[00:00:02] Inspecting ports tree for modifications to git checkout... no 
 

[00:00:03] Ports top-level git hash: 1bbe39c25 
 

[00:00:03] Gathering ports metadata 
 

[00:00:08] Calculating ports order and dependencies 
 

[00:00:10] Trimming IGNORED and blacklisted ports 
 

[00:00:10] Sanity checking the repository 
 

[00:00:10] Checking packages for incremental rebuild needs 
 

[00:00:13] Deleting rsync-3.4.0.pkg: new version: 3.4.1 
 

[00:00:14] Deleting mariadb1011-server-10.11.10_1.pkg: missing 
dependency: rsync-3.4.0 

[00:00:14] Deleting mariadb114-server-11.4.4.pkg: missing dependency: 
rsync-3.4.0 

[00:00:15] Deleting stale symlinks... done 
 

[00:00:15] Deleting empty directories... done 
 

[00:00:15] Unqueueing existing packages 
 

[00:00:16] Unqueueing orphaned build dependencies 
 

[00:00:16] Sanity checking build queue 
 

[00:00:16] Processing PRIORITY_BOOST 
 

[00:00:16] Balancing pool 
 

[140amd64-2025Q1] [2025-01-16_14h18m02s] [balancing_pool] Queued: 13 
Built: 0  Failed: 0  Skipped: 0  Ignored: 0  Fetched: 0  Tobuild: 13  T 
             ime: 00:00:15 
 

[00:00:16] Recording filesystem state for prepkg... done 
 

[00:00:16] Building 13 packages using up to 13 builders 
 

[00:00:16] Hit CTRL+t at any time to see build progress and stats 
 

[00:00:16] [01] [00:00:00] Builder starting 
 

[00:00:16] [02] [00:00:00] Builder starting 
 

[00:00:16] [01] [00:00:00] Builder started 
 

[00:00:16] [01] [00:00:00] Building x11-toolkits/libwnck3 | 
libwnck3-3.36.0_2 

[00:00:16] [02] [00:00:00] Builder started 
 

[00:00:16] [02] [00:00:00] Building net/rsync | rsync-3.4.1 
 

[00:00:26] [02] [00:00:10] Finished net/rsync | rsync-3.4.1: Success 
 

[00:00:26] [02] [00:00:00] Building databases/mariadb114-server | 
mariadb114-server-11.4.4 

[00:00:26] [03] [00:00:00] Builder starting 
 

[00:00:27] [03] [00:00:01] Builder started 
 

[00:00:27] [03] [00:00:00] Building databases/mariadb1011-server | 
mariadb1011-server-10.11.10_1 

[00:00:36] [01] [00:00:20] Finished x11-toolkits/libwnck3 | 
libwnck3-3.36.0_2: Failed: build 

[00:00:36] [01] [00:00:20] Skipping x11/libxfce4windowing | 
libxfce4windowing-4.20.0: Dependent port x11-toolkits/libwnck3 | 
libwnck3-3.36.0              _2 failed 
 

[00:00:36] [01] [00:00:20] Skipping x11-fm/thunar | thunar-4.20.1: 
Dependent port x11-toolkits/libwnck3 | libwnck3-3.36.0_2 failed 

[00:00:36] [01] [00:00:20] Skipping x11-wm/xfce4 | xfce-4.20: Dependent 
port x11-toolkits/libwnck3 | libwnck3-3.36.0_2 failed 

[00:00:36] [01] [00:00:20] Skipping x11-wm/xfce4-desktop | 
xfce4-desktop-4.20.0: Dependent port x11-toolkits/libwnck3 | 
libwnck3-3.36.0_2 fa              iled 
 

[00:00:36] [01] [00:00:20] Skipping deskutils/xfce4-notifyd | 
xfce4-notifyd-0.9.6_1: Dependent port x11-toolkits/libwnck3 | 
libwnck3-3.36.0_              2 failed 
 

[00:00:36] [01] [00:00:20] Skipping x11-wm/xfce4-panel | 
xfce4-panel-4.20.0: Dependent port x11-toolkits/libwnck3 | 
libwnck3-3.36.0_2 failed
[00:00:36] [01] [00:00:20] Skipping sysutils/xfce4-power-manager | 
xfce4-power-manager-4.20.0: Dependent port x11-toolkits/libwnck3 | 
libwnc              k3-3.36.0_2 failed 
 

[00:00:36] [01] [00:00:20] Skipping x11-wm/xfce4-session | 
xfce4-session-4.20.0: Dependent port x11-toolkits/libwnck3 | 
libwnck3-3.36.0_2 fa              iled 
 

[00:00:36] [01] [00:00:20] Skipping x11-wm/xfce4-wm | xfce4-wm-4.20.0: 
Dependent port x11-toolkits/libwnck3 | libwnck3-3.36.0_2 failed 

[00:02:51] [02] [00:02:25] Finished databases/mariadb114-server | 
mariadb114-server-11.4.4: Success 

[00:02:52] [03] [00:02:25] Finished databases/mariadb1011-server | 
mariadb1011-server-10.11.10_1: Success 

[00:02:53] Stopping 13 builders 
 

[00:02:54] Creating pkg repository 
 

Creating repository in /tmp/packages: 100% 
 

Packing files for repository: 100% 
 

[00:03:12] Committing packages to repository: 
/poudriere/data/packages/140amd64-2025Q1/.real_1737037274 via .latest 
symlink
[00:03:12] Removing old packages 
 

[00:03:12] Built ports: net/rsync databases/mariadb114-server 
databases/mariadb1011-server 

[00:03:12] Failed ports: x11-toolkits/libwnck3:build 
 

[00:03:12] Skipped ports: deskutils/xfce4-notifyd 
sysutils/xfce4-power-manager x11-fm/thunar x11-wm/xfce4 
x11-wm/xfce4-desktop x11-wm/xfce4-              panel 
x11-wm/xfce4-session x11-wm/xfce4-wm x11/libxfce4windowing 

[140amd64-2025Q1] [2025-01-16_14h18m02s] [committing] Queued: 13 Built: 
3  Failed: 1  Skipped: 9  Ignored: 0  Fetched: 0  Tobuild: 0   Time: 
           00:03:11 
 

[00:03:12] Logs: 
/poudriere/data/logs/bulk/140amd64-2025Q1/2025-01-16_14h18m02s 

[00:03:12] Cleaning up 
 

[00:03:12] Unmounting file systems 
 

real 192.36 
 

user 518.74 
 

sys 219.50 
 

titan#


Then straight away after that :

titan# /usr/bin/time -p idprio 0 poudriere bulk -r -j 140amd64 -p 2025Q1 
-f /root/pkg.list
[00:00:00] Updating portstree "2025Q1" with git+https... done
[00:00:00] Creating the reference jail... done
[00:00:00] Mounting system devices for 140amd64-2025Q1
[00:00:00] Stashing existing package repository
[00:00:00] Mounting ccache from: /var/cache/ccache
[00:00:00] Mounting ports from: /poudriere/ports/2025Q1
[00:00:00] Mounting packages from: /poudriere/data/packages/140amd64-2025Q1
[00:00:00] Mounting distfiles from: /poudriere/distfiles
/etc/resolv.conf -> /poudriere/data/.m/140amd64-2025Q1/ref/etc/resolv.conf
[00:00:00] Starting jail 140amd64-2025Q1
Updating /var/run/os-release done.
[00:00:00] Will build as nobody:nobody (65534:65534)
[00:00:00] Logs: 
/poudriere/data/logs/bulk/140amd64-2025Q1/2025-01-17_07h00m48s
[00:00:00] Loading MOVED for 
/poudriere/data/.m/140amd64-2025Q1/ref/usr/ports
[00:00:01] Ports supports: FLAVORS SUBPACKAGES SELECTED_OPTIONS
[00:00:01] Inspecting ports tree for modifications to git checkout... no
[00:00:02] Ports top-level git hash: ea08b2ed7
[00:00:02] Gathering ports metadata
[00:00:07] Calculating ports order and dependencies
[00:00:09] Trimming IGNORED and blacklisted ports
[00:00:10] Sanity checking the repository
[00:00:10] Checking packages for incremental rebuild needs
[00:00:13] Deleting stale symlinks... done
[00:00:13] Deleting empty directories... done
[00:00:13] Unqueueing existing packages
[00:00:14] Unqueueing orphaned build dependencies
[00:00:14] Sanity checking build queue
[00:00:14] Processing PRIORITY_BOOST
[00:00:15] Balancing pool
[140amd64-2025Q1] [2025-01-17_07h00m48s] [balancing_pool] Queued: 10 
Built: 0  Failed: 0  Skipped: 0  Ignored: 0  Fetched: 0  Tobuild: 10 
Time: 00:00:14
[00:00:15] Recording filesystem state for prepkg... done
[00:00:15] Building 10 packages using up to 10 builders
[00:00:15] Hit CTRL+t at any time to see build progress and stats
[00:00:15] [01] [00:00:00] Builder starting
[00:00:15] [01] [00:00:00] Builder started
[00:00:15] [01] [00:00:00] Building x11-toolkits/libwnck3 | 
libwnck3-3.36.0_2
[00:00:33] [01] [00:00:18] Finished x11-toolkits/libwnck3 | 
libwnck3-3.36.0_2: Failed: build
[00:00:33] [01] [00:00:18] Skipping x11/libxfce4windowing | 
libxfce4windowing-4.20.0: Dependent port x11-toolkits/libwnck3 | 
libwnck3-3.36.0_2 failed
[00:00:33] [01] [00:00:18] Skipping x11-fm/thunar | thunar-4.20.1: 
Dependent port x11-toolkits/libwnck3 | libwnck3-3.36.0_2 failed
[00:00:33] [01] [00:00:18] Skipping x11-wm/xfce4 | xfce-4.20: Dependent 
port x11-toolkits/libwnck3 | libwnck3-3.36.0_2 failed
[00:00:33] [01] [00:00:18] Skipping x11-wm/xfce4-desktop | 
xfce4-desktop-4.20.0: Dependent port x11-toolkits/libwnck3 | 
libwnck3-3.36.0_2 failed
[00:00:33] [01] [00:00:18] Skipping deskutils/xfce4-notifyd | 
xfce4-notifyd-0.9.6_1: Dependent port x11-toolkits/libwnck3 | 
libwnck3-3.36.0_2 failed
[00:00:33] [01] [00:00:18] Skipping x11-wm/xfce4-panel | 
xfce4-panel-4.20.0: Dependent port x11-toolkits/libwnck3 | 
libwnck3-3.36.0_2 failed
[00:00:33] [01] [00:00:18] Skipping sysutils/xfce4-power-manager | 
xfce4-power-manager-4.20.0: Dependent port x11-toolkits/libwnck3 | 
libwnck3-3.36.0_2 failed
[00:00:33] [01] [00:00:18] Skipping x11-wm/xfce4-session | 
xfce4-session-4.20.0: Dependent port x11-toolkits/libwnck3 | 
libwnck3-3.36.0_2 failed
[00:00:33] [01] [00:00:18] Skipping x11-wm/xfce4-wm | xfce4-wm-4.20.0: 
Dependent port x11-toolkits/libwnck3 | libwnck3-3.36.0_2 failed
[00:00:33] Stopping 10 builders
[00:00:33] Creating pkg repository
Creating repository in /tmp/packages: 100%
Packing files for repository: 100%
[00:00:52] Committing packages to repository: 
/poudriere/data/packages/140amd64-2025Q1/.real_1737097300 via .latest 
symlink
[00:00:52] Removing old packages
[00:00:52] Failed ports: x11-toolkits/libwnck3:build
[00:00:52] Skipped ports: deskutils/xfce4-notifyd 
sysutils/xfce4-power-manager x11-fm/thunar x11-wm/xfce4 
x11-wm/xfce4-desktop x11-wm/xfce4-panel x11-wm/xfce4-session 
x11-wm/xfce4-wm x11/libxfce4windowing
[140amd64-2025Q1] [2025-01-17_07h00m48s] [committing] Queued: 10 Built: 
0  Failed: 1  Skipped: 9  Ignored: 0  Fetched: 0  Tobuild: 0   Time: 
00:00:51
[00:00:52] Logs: 
/poudriere/data/logs/bulk/140amd64-2025Q1/2025-01-17_07h00m48s
[00:00:52] Cleaning up
[00:00:52] Unmounting file systems
real 52.84
user 183.75
sys 123.83
titan#

I see things like that ALL the time. Daily.


>> . . .
>>
>> Why do I always see things like this :
> 
> Just rhetorical? (See more later.)
>


Sort of. Yes.  I think the specifics are just pine needles on the little
trees in a big big forest. Some are going to be dead and fall away. Some
will need a bit of trimming on some of the trees. That is the nature of
the forest. However I have been looking at poudriere build failures for
weeks. Right, it is the holidays and so I do not expect much and really
should not. I don't.

> 
> I've not seen anything presented that might allow someone to help
> improve what happens in your context --or even to test if they can
> specifically reproduce any of your builds' specific failures, not
> even if they can match which ports blocked the potentially more
> overall builds.
> 
> The note reads more as an expression of furstation than anything
> else, no attempt at getting help. Or, maybe, an attempt, in part,
> to see how many "me too" responses show up.

I was mostly dipping my toes in the water and waiting for the usual
flames. I have been doing something or other related to software package
stuff for a while now. I am not surprised when things go sideways a bit.
I am, yes, frustrated when building the big three window manager bits
and some database tools falls over. Daily. Weekly.


> 
> The note was sent to freebsd-current. I'm not sure if I should
> read someting into that or not.

Well, not sure else what/where to do what? I figure a 15.0-CURRENT
machine is what one would need to build with. Certainly for every
reasonable version from 13.4 upwards. Just a guess but I think that
is what would need.

> 
> Nothing hints at the platform(s) used vs. not or that fail
> vs. not.
> 
> Prior to my FreeBSD use stopping on 2025-Jan-7, bulk builds that
> I had done worked fine. But it is likely to be a rather different
> workload vs. yours.

Yep likely. I have a package list of stuff and it usually rounds out to
a grand whopping 1500+ things. Never more than 1600. Not ever.

> 
> Looking at the FreeBD package builders, I do see latest for
> main armv7 having:
> 
> x11/kde5           being blocked by libfido2-1.15.0
> x11-wm/xfce        being blocked by vte3-0.70.2_5
> x11/xfce4-goodies  being blocked by vte3-0.70.2_5
> x11/xfce4-terminal being blocked by vte3-0.70.2_5

Well, that is armv7?  I am looking at AMD64 on a Xeon machine. More or
less AMD64 or x86_64 depending on whose church we sit in.

> 
> But I did not see LXDE being blocked.
> 
> I did not see such blocks for amd64 or arm64.
> 
> Where I do see all of KDE5, LXDE, and XFCE blocked
> is by rust-1.81.0 in:
>

Funny. I have rust built on RISC-V :

enceladus$ uname -apKU
FreeBSD enceladus 15.0-CURRENT FreeBSD 15.0-CURRENT #2 
main-n274434-2e09cef8dc6f: Sun Dec 29 05:26:22 GMT 2024 
root@enceladus:/usr/obj/usr/src/riscv.riscv64/sys/SIFIVE-COMPAT11 riscv 
riscv64 1500029 1500029
enceladus$
enceladus$ rustc --version
rustc 1.83.0 (90b35a623 2024-11-26) (built from a source tarball)
enceladus$

However that is a wild red herring. Pay no attention to that.

> But I've no clue if any of this matches your example
> build failures.
> 


I am thankful for the reply. I am curious.  Given a hundred users of
FreeBSD the question would be how many build stuff themselves? The
numbers may be shockingly low.  I have no idea.  I am just guessing.

-- 
--
Dennis Clarke
RISC-V/SPARC/PPC/ARM/CISC
UNIX and Linux spoken