"poudriere bulk" - why does it fail on single package with missing port origin?

[Bryan Drewery]

On 9/11/2014 8:51 AM, Michael Jung wrote:
> Why does "poudriere bulk" need to bail because a single package has a
> missing port origin and not continue to build other packages in the
> package list?
> 
> If I remove x11/mate from my package list poudriere rocks on building
> all my other ports.
> 
> The missing origin is a RUN_DEPENDS in the x11/mate Makefile, but that
> dependency should only be for x11/mate right?
> 
> I can't seem to find a good explanation in the general man pages or
> searching the web.
> 
> Educate me please ;-)

A lot of the reason is just the way poudriere handles looking up
dependencies. I'm willing to explore moving this fatal error such that
the port is just listed as FAILED and anything depending on it is
SKIPPED. There's currently no way to do that without more logic.

This sort of error hits the package build system quite often. When
someone breaks INDEX they also break package building because of this
error. I am more and more convinced that we should not consider these
immediately fatal.

However, we should also consider a threshold feature such that too many
failures for bulk will cause the set to not be published. 3.1 adds a
feature called "atomic package repository" that builds packages outside
of the normal repository dir. Once the build is done the packages are
synced over. I added a way to prevent publishing the set if ANYTHING
fails, but it's not using a threshold yet. I'll improve that.

This will have to wait until after 3.1 though. It will be releasing once
I find time to focus on getting it out.

> 
> --mikej
> 
> Example:
> 
> poudriere 3.0.17/11.0-CURRENT #1 r264318M amd64
> 
> 
> [root at bsd11 /usr/local/poudriere/ports/default/x11/mate]# poudriere bulk
> -j 10stable -f /usr/local/etc/charon-list
> ====>> Creating the reference jail... done
> ====>> Mounting system devices for 10stable-default
> ====>> Mounting ports/packages/distfiles
> ====>> Mounting ccache from: /var/cache/ccache
> ====>> Mounting packages from:
> /usr/local/poudriere/data/packages/10stable-default
> ====>> Logs:
> /usr/local/poudriere/data/logs/bulk/10stable-default/2014-09-10_12h18m15s
> ====>> Appending to make.conf:
> /usr/local/etc/poudriere.d/10stable-make.conf
> /etc/resolv.conf ->
> /usr/local/poudriere/data/build/10stable-default/ref/etc/resolv.conf
> ====>> Starting jail 10stable-default
> ====>> Loading MOVED
> ====>> Calculating ports order and dependencies
> ====>> MOVED: databases/db41 renamed to databases/db48
> ====>> MOVED: databases/db42 renamed to databases/db48
> ====>> Error: Invalid port origin 'archivers/mate-file-archiver' not found.
> ====>> Cleaning up
> ====>> Umounting file systems
> [root at bsd11 /usr/local/poudriere/ports/default/x11/mate]#
> 
> 
> AFTER remove x11/mate from the list "charon-list"
> 
> 
> [root at bsd11 /usr/local/poudriere/ports/default/x11/mate]# poudriere bulk
> -j 10stable -f /usr/local/etc/charon-list
> ====>> Creating the reference jail... done
> ====>> Mounting system devices for 10stable-default
> ====>> Mounting ports/packages/distfiles
> ====>> Mounting ccache from: /var/cache/ccache
> ====>> Mounting packages from:
> /usr/local/poudriere/data/packages/10stable-default
> ====>> Logs:
> /usr/local/poudriere/data/logs/bulk/10stable-default/2014-09-10_12h20m14s
> ====>> Appending to make.conf:
> /usr/local/etc/poudriere.d/10stable-make.conf
> /etc/resolv.conf ->
> /usr/local/poudriere/data/build/10stable-default/ref/etc/resolv.conf
> ====>> Starting jail 10stable-default
> ====>> Loading MOVED
> ====>> Calculating ports order and dependencies
> ====>> MOVED: databases/db41 renamed to databases/db48
> ====>> MOVED: databases/db42 renamed to databases/db48
> ====>> Sanity checking the repository
> ====>> Deleting old version: liboil-0.3.17_1.txz
> ====>> Deleting old version: p5-DBD-Pg-3.4.0.txz
> ====>> Deleting old version: p5-Net-SSLeay-1.65.txz
> ====>> Deleting stale symlinks
> ====>> Deleting empty directories
> ====>> Cleaning the build queue
> ====>> Building 490 packages using 8 builders
> ====>> Starting/Cloning builders
> ====>> Hit CTRL+t at any time to see build progress and stats
> _______________________________________________
> freebsd-ports at freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-ports
> To unsubscribe, send any mail to "freebsd-ports-unsubscribe at freebsd.org"


-- 
Regards,
Bryan Drewery

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 488 bytes
Desc: OpenPGP digital signature
URL: <http://lists.freebsd.org/pipermail/freebsd-ports/attachments/20140912/a732225e/attachment.sig>