Poudriere Timeout

[Matthew Seaman]

On 23/01/2015 02:34, Cy Schubert wrote:
> In message <54C18193.1000701 at FreeBSD.org>, Bryan Drewery writes:
>> This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
>> --NvIRPgp2pVcRmjhwtM9TwAvH1900GK90a
>> Content-Type: text/plain; charset=windows-1252
>> Content-Transfer-Encoding: quoted-printable
>>
>> On 1/18/2015 7:45 PM, Cy Schubert wrote:
>>> Hi,
>>> =20
>>> =20
>>> Has anyone seen this before?=20
>>> =20
>>> print/texlive-texmf texlive-texmf-20140525_4 package/timeout runaway_pr=
>> ocess
>>> =20
>>> =20
>>> /usr/bin/touch /wrkdirs/usr/ports/print/texlive-texmf/work/stage/usr/lo=
>> cal/s
>>> hare
>>> /texmf-dist/doc/.keep_me
>>> /bin/mkdir -p /wrkdirs/usr/ports/print/texlive-texmf/work/stage/usr/loc=
>> al/sh
>>> are/
>>> texmf-dist/source
>>> /usr/bin/touch /wrkdirs/usr/ports/print/texlive-texmf/work/stage/usr/lo=
>> cal/s
>>> hare
>>> /texmf-dist/source/.keep_me
>>> =3D=3D=3D=3D> Compressing man pages (compress-man)
>>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
>> =3D
>>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D<p=
>> hase: package        >=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>>> =3D=3D=3D>  Building package for texlive-texmf-20140525_4
>>> =3D=3D=3D=3D>> Killing timed out build after 3600 seconds
>>> =3D=3D=3D=3D>> Cleaning up wrkdir
>>> =3D=3D=3D>  Cleaning for texlive-texmf-20140525_4
>>> build of print/texlive-texmf ended at Fri Jan 16 23:49:09 PST 2015
>>> build time: 02:41:43
>>> !!! build failure encountered !!!
>>> =20
>>> Building the port by hand, make package, took just over 19 minutes (115=
>> 0=20
>>> seconds). Would increasing the timeout from 3600 to something larger (l=
>> ike=20
>>> 7200 -- I know this will require hacking the code) address the issue?
>>> =20
>>> =20
>>
>> I'm curious why building outside of poudriere took 19 minutes, but
>> inside took over 60 minutes. Did you have MFS or TMPFS enabled at the
>> time of 60+ minutes?
> 
> No. I don't have enough memory to support mfs or tmpfs except for /tmp. 
> Having said that, my poudriere jails don't have tmpfs /tmp while all my 
> servers (and laptop) do.
> 
>>
>> Is pkg the same version in the jail as your host? It may be a recent pkg
>> create regression.
> 
> All the software is the same. The difference is that the failed build was 
> on an AMD 64 X2 4600+ (dual core with 5.5 GB) whereas the successful build 
> was on an Intel Core I3 dual core with four threads with 6 GB. All 
> filesystems are ZFS.
> 
> My guess is that the speed of the processors may have had something to do 
> with it. I don't think the extra 500 MB ram mattered much. All my build 
> systems are amd64 architecture.
> 

I've been seeing the same sort of problem with texlive-texmf.  I only
build a relatively small number of packages (1500) and I usually do a
complete rebuild on Saturdays, and daily updates otherwise.  I also
enable package jobs everywhere as this does in general lead to faster
compilation times despite the system load thrashing around at about
60-ish.  This has the result that at the weekend, the single-threaded
texlive-texmf 'pkg create' process is competing against many other
processes for CPU time, and can overshoot the 3600 second timeout, hence
resulting in the process being killed.  During the week, generally there
are only a few ports needing rebuild and texlive-texmf usually ends up
as the only thing building, in which case it finishes just fine.

I've a pretty simplistic work-around to this I intend to commit to pkg
over the weekend: just add a counter to 'pkg create' so it puts out some
output while processing the package's files.

	Cheers,

	Matthew

-- 
Dr Matthew J Seaman MA, D.Phil.

PGP: http://www.infracaninophile.co.uk/pgpkey
JID: matthew at infracaninophile.co.uk

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 971 bytes
Desc: OpenPGP digital signature
URL: <http://lists.freebsd.org/pipermail/freebsd-ports/attachments/20150123/7e69db39/attachment.sig>