Re: main 16 and 15.0-ALPHA4 [on amd64]: using a USB3 context gets extensive "flswai" [and "rename"] STATE time during poudriere builds (UFS context happens to be in use); more
Date: Wed, 01 Oct 2025 07:46:20 UTC
On Sep 30, 2025, at 22:20, Mark Millard <marklmi@yahoo.com> wrote:
> [Resending: Correcting an Email address copy/paste error
> and adding adjusting a little wording.]
>
> [This note's additions are tied to "flswai" STATE instead
> of to "rename" STATE.]
I messed up substituting without noticing at the time.
Ignore my "flswai" STATE material.
> On Sep 30, 2025, at 20:43, Mark Millard <marklmi@yahoo.com> wrote:
>
>> [The new material here ends up being about nameicap_cleanup
>> and its exclusive use of mnt_renamelock being one potential
>> bottleneck involved here. I make no claim it has anything to
>> do with the flswai activity reported. The possible
>> bottleneck is an observation, not something that I claim
>> there is any alternative to. I do not know if this is of any
>> interest or not.]
>>
>> On Sep 29, 2025, at 16:06, Mark Millard <marklmi@yahoo.com> wrote:
>>
>>> On Sep 29, 2025, at 13:01, Mark Millard <marklmi@yahoo.com> wrote:
>>>
>>>> An example is during the cpdup activities when multiple happen
>>>> in overlappingtime frames:
>>>
>>> I'll note that I see this on the amd64 32-FreeBSD-cpu system
>>> but not on the aarch64 8-FreeBSD-cpu Windows Dev Kit 2023
>>> system. May be at some point I'll try the older 16-FreeBSD-cpu
>>> aarch64 (Cortex-A72) system.
>>>
>>> Also, on the 7950X3D amd74 system, I see the behavior with
>>> 14.3-Stable. Apparently, this is not new with 15+. It has
>>> been a long time since I'd tried using an amd64 system for
>>> such activity based on using USB3 media. But it has been
>>> common for me for aarch64 over that time frame.
BEGIN IGNORE
> previous to modern:
> @@ -2659,8 +2659,7 @@ bwillwrite(void)
> mtx_lock(&bdirtylock);
> while (buf_dirty_count_severe()) {
> bdirtywait = 1;
> - msleep(&bdirtywait, &bdirtylock, (PRIBIO + 4),
> - "flswai", 0);
> + msleep(&bdirtywait, &bdirtylock, PVFS, "flswai", 0);
> }
> mtx_unlock(&bdirtylock);
>
> where in modern code:
>
> /usr/src/sys/sys/priority.h:#define PRIBIO (PRI_MIN_KERN + 3)
> and:
> /usr/src/sys/sys/priority.h:#define PVFS (PRI_MIN_KERN + 4)
>
> Presuming slpflags == 0 (see later reference code)
> as an example context:
>
> previous vs. now for . . .
> bufspace_wait: (PRIBIO + 4) vs. (PRI_MIN_KERN + 3 + 4)
> bwillwrite: (PRIBIO + 4) vs. (PRI_MIN_KERN + 4) // now a smallest, previously a largest (of the 3)
> bufobj_wwait: (PRIBIO + 1) vs. (PRI_MIN_KERN + 3 + 1)
Actually, referencing previous vs. new correctly:
bufspace_wait: (PRIBIO + 4) vs. (PRI_MIN_KERN + 4)
bwillwrite: (PRIBIO + 4) vs. (PRI_MIN_KERN + 4)
bufobj_wwait: (PRIBIO + 1) vs. (PRI_MIN_KERN + 3)
So order is preserved, including equality.
Sorry for the noise for flswai.
> Suggestive summary, using routine names to indicate values
> (for slpflags == 0 contexts):
>
> bufobj_wwait < bwillwrite == bufspace_wait (previous)
> vs.
> bufobj_wwait == bwillwrite < bufspace_wait (now)
>
> QUOTE
> Since RQ_PPQ is 4, differences of less than 4 are insignificant, so just
> remove them. These small differences have not been changed for years,
> so it is likely they have no real meaning (besides having no practical
> effect). One can still consult the changes history to recover them if
> ever needed.
> END QUOTE
>
> The above code does not "just remove them", but creates
> new small differences and causes a change in the
> relative order for the 3 contexts.
>
> Any chance that is a potential performance problem for
> some types of use now?
>
> For reference:
>
> diff --git a/sys/kern/vfs_bio.c b/sys/kern/vfs_bio.c
> index ea66a81b5903..fa655c43d155 100644
> --- a/sys/kern/vfs_bio.c
> +++ b/sys/kern/vfs_bio.c
> @@ -756,7 +756,7 @@ bufspace_wait(struct bufdomain *bd, struct vnode *vp, int gbflags,
> break;
> }
> error = msleep(&bd->bd_wanted, BD_LOCKPTR(bd),
> - (PRIBIO + 4) | slpflag, "newbuf", slptimeo);
> + PVFS | slpflag, "newbuf", slptimeo);
> if (error != 0)
> break;
> }
> @@ -2659,8 +2659,7 @@ bwillwrite(void)
> mtx_lock(&bdirtylock);
> while (buf_dirty_count_severe()) {
> bdirtywait = 1;
> - msleep(&bdirtywait, &bdirtylock, (PRIBIO + 4),
> - "flswai", 0);
> + msleep(&bdirtywait, &bdirtylock, PVFS, "flswai", 0);
> }
> mtx_unlock(&bdirtylock);
> }
> @@ -5239,7 +5238,7 @@ bufobj_wwait(struct bufobj *bo, int slpflag, int timeo)
> while (bo->bo_numoutput) {
> bo->bo_flag |= BO_WWAIT;
> error = msleep(&bo->bo_numoutput, BO_LOCKPTR(bo),
> - slpflag | (PRIBIO + 1), "bo_wwait", timeo);
> + slpflag | PRIBIO, "bo_wwait", timeo);
> if (error)
> break;
> }
END IGNORE
>
>>>> . . .
>>>> 29502 0 root 0 0 20976Ki 4832Ki biowr 2 0:00 0.06% cpdup -i0 -s0 -f -x ref 01
>>>> 29479 0 root 0 0 20976Ki 4836Ki biord 7 0:01 0.75% cpdup -i0 -o ref 32
>>>> 29467 0 root 0 0 20976Ki 4824Ki getblk 26 0:01 0.63% cpdup -i0 -o ref 31
>>>> 29429 0 root 1 0 20976Ki 4768Ki flswai 23 0:01 0.61% cpdup -i0 -o ref 30
>>>> 29414 0 root 0 0 20976Ki 4780Ki flswai 28 0:01 0.70% cpdup -i0 -o ref 29
>>>> 29396 0 root 59 0 16872Ki 4948Ki wait 9 0:00 0.00% /usr/local/libexec/poudriere/sh -e -o pipefail /usr/local/share/poudriere/bulk.sh -jofficial-amd64 -c -f /usr/home/root/o
>>>> 29382 0 root 0 0 20976Ki 4876Ki flswai 15 0:01 0.95% cpdup -i0 -o ref 28
>>>> 29353 0 root 59 0 16872Ki 4948Ki wait 7 0:00 0.00% /usr/local/libexec/poudriere/sh -e -o pipefail /usr/local/share/poudriere/bulk.sh -jofficial-amd64 -c -f /usr/home/root/o
>>>> 29326 0 root 0 0 20976Ki 4804Ki biord 5 0:01 0.44% cpdup -i0 -o ref 27
>>>> 29308 0 root 0 0 20976Ki 4816Ki biord 2 0:01 0.77% cpdup -i0 -o ref 26
>>>> 29307 0 root 59 0 16872Ki 4948Ki wait 5 0:00 0.00% /usr/local/libexec/poudriere/sh -e -o pipefail /usr/local/share/poudriere/bulk.sh -jofficial-amd64 -c -f /usr/home/root/o
>>>> 29273 0 root 59 0 16872Ki 4944Ki wait 4 0:00 0.00% /usr/local/libexec/poudriere/sh -e -o pipefail /usr/local/share/poudriere/bulk.sh -jofficial-amd64 -c -f /usr/home/root/o
>>>> 29262 0 root 0 0 20976Ki 4768Ki flswai 20 0:01 0.76% cpdup -i0 -o ref 25
>>>> 29233 0 root 0 0 20976Ki 4784Ki flswai 3 0:01 0.71% cpdup -i0 -o ref 24
>>>> 29232 0 root 59 0 16872Ki 4944Ki wait 6 0:00 0.00% /usr/local/libexec/poudriere/sh -e -o pipefail /usr/local/share/poudriere/bulk.sh -jofficial-amd64 -c -f /usr/home/root/o
>>>> . . .
>>>>
>>>> It took over 6 minutes for the 32 builders to finish. (Normal is
>>>> under 2 seconds.)
>>>>
>>>>
>>>> Also, later activity gets extensive "rename" STATE time, again, at least
>>>> some of it during cpdup activity:
>>
>> Looks like the "rename" state is new (and I've only
>> seen in for 15+):
>>
>> /usr/src/sys/kern/vfs_mount.c has as the source
>> of the name used for the "rname" STATE:
>>
>> static int
>> mount_init(void *mem, int size, int flags)
>> {
>> struct mount *mp;
>>
>> mp = (struct mount *)mem;
>> mtx_init(&mp->mnt_mtx, "struct mount mtx", NULL, MTX_DEF);
>> mtx_init(&mp->mnt_listmtx, "struct mount vlist mtx", NULL, MTX_DEF);
>> lockinit(&mp->mnt_explock, PVFS, "explock", 0, 0);
>> lockinit(&mp->mnt_renamelock, PVFS, "rename", 0, 0);
>> mp->mnt_pcpu = uma_zalloc_pcpu(pcpu_zone_16, M_WAITOK | M_ZERO);
>> mp->mnt_ref = 0;
>> mp->mnt_vfs_ops = 1;
>> mp->mnt_rootvnode = NULL;
>> return (0);
>> }
>>
>> author Konstantin Belousov <kib@FreeBSD.org> 2025-06-02 07:05:06 +0000
>>
>> committer Konstantin Belousov <kib@FreeBSD.org> 2025-07-04 15:23:42 +0000
>> commit ef6ea91593ebff73e2fc201efd9f848b71c5a125 (patch)
>> tree 5f90f06e4b190a3a8fe9b5f3a016b69415d62a6d /sys/kern/vfs_mount.c
>> parent f9cf745a5084dc0a38733db8e774252e4ed2f444 (diff)
>>
>> VOP_RENAME: add mp-global lock
>>
>> It is before all vnode locks, but after vn_start_write().
>>
>> The lock prevents parallel rename operations on the same mount point,
>> which should in (near future) simplify a lot of code in VFS/fs that
>> otherwise need to code with either the changing hierarchy, or with the
>> lock order for vnodes due to changed hierarchy.
>>
>> On renames, the lock is taken on the lowest stacked filesystem.
>> Otherwise rename could still occur in parallel, by performing one of op
>> on the lower fs.
>>
>> Proposed by: mjg (long time ago)
>> Reviewed by: markj, olce
>> Tested by: pho
>> Sponsored by: The FreeBSD Foundation
>> MFC after: 1 week
>> Differential revision: https://reviews.freebsd.org/D50648
>> . . .
>>
>> The context here is not renaming activity, so my
>> guess here is that the following may be in use
>> in a wider range of contexts.
>>
>> /usr/src/sys/kern/vfs_lookup.c has:
>>
>> static void
>> nameicap_cleanup(struct nameidata *ndp, int error)
>> {
>> struct nameicap_tracker *nt, *nt1;
>> struct mount *mp;
>>
>> KASSERT((ndp->ni_nctrack_mnt == NULL &&
>> TAILQ_EMPTY(&ndp->ni_cap_tracker)) ||
>> (ndp->ni_lcf & NI_LCF_CAP_DOTDOT) != 0,
>> ("tracker active and not strictrelative"));
>>
>> TAILQ_FOREACH_SAFE(nt, &ndp->ni_cap_tracker, nm_link, nt1) {
>> mp = nt->mp;
>> lockmgr(&mp->mnt_renamelock, LK_RELEASE, 0);
>> vfs_rel(mp);
>> TAILQ_REMOVE(&ndp->ni_cap_tracker, nt, nm_link);
>> free(nt, M_NAMEITRACKER);
>> }
>>
>> mp = ndp->ni_nctrack_mnt;
>> if (mp != NULL) {
>> if (error == ERESTART) {
>> lockmgr(&mp->mnt_renamelock, LK_EXCLUSIVE, 0);
>> lockmgr(&mp->mnt_renamelock, LK_RELEASE, 0);
>> }
>> vfs_rel(mp);
>> ndp->ni_nctrack_mnt = NULL;
>> }
>> }
>>
>> and it may be the source of the large number
>> "rename" STATE processes that are all waiting
>> on "rename" below, forcing 1 of 32 at a time
>> for cpdup (32 poudriere builders). Later there
>> is an example of cc also waiting on it when
>> there is also cpdup activity waiting on it.
>>
>>
>>>> . . .
>>>> 80055 0 root 59 0 16872Ki 4968Ki wait 31 0:00 0.00% sh: poudriere[official-amd64-default][06]: build_pkg (boost-jam-1.88.0) (sh)
>>>> 78347 0 root 0 0 20976Ki 4624Ki rename 0 0:00 1.05% cpdup -i0 -s0 -f -x ref 31
>>>> 78331 0 root 59 0 16872Ki 4960Ki wait 18 0:00 0.00% sh: poudriere[official-amd64-default][31]: build_pkg (lua53-5.3.6_1) (sh)
>>>> 77930 0 root 0 0 20976Ki 4636Ki rename 29 0:00 1.02% cpdup -i0 -s0 -f -x ref 30
>>>> 77912 0 root 59 0 16872Ki 4960Ki wait 25 0:00 0.00% sh: poudriere[official-amd64-default][30]: build_pkg (libsunacl-1.0.1_1) (sh)
>>>> 75398 0 root 0 0 20976Ki 4628Ki rename 2 0:00 0.99% cpdup -i0 -s0 -f -x ref 16
>>>> 75335 0 root 59 0 16872Ki 4960Ki wait 20 0:00 0.00% sh: poudriere[official-amd64-default][16]: build_pkg (iwmbt-firmware-20250410) (sh)
>>>> 75324 0 root 0 0 20976Ki 4628Ki rename 24 0:00 1.04% cpdup -i0 -s0 -f -x ref 19
>>>> 75308 0 root 59 0 16872Ki 4960Ki wait 24 0:00 0.00% sh: poudriere[official-amd64-default][19]: build_pkg (lua54-5.4.8) (sh)
>>>> 74963 0 root 0 0 20976Ki 4624Ki rename 4 0:00 1.05% cpdup -i0 -s0 -f -x ref 32
>>>> 74922 0 root 59 0 16872Ki 4960Ki wait 26 0:00 0.00% sh: poudriere[official-amd64-default][32]: build_pkg (lzo2-2.10_1) (sh)
>>>> 72722 0 root 0 0 20976Ki 4776Ki rename 1 0:00 1.28% cpdup -i0 -s0 -f -x ref 15
>>>> 72647 0 root 59 0 16872Ki 4960Ki wait 26 0:00 0.00% sh: poudriere[official-amd64-default][15]: build_pkg (indexinfo-0.3.1_1) (sh)
>>>> 71967 0 root 0 0 20976Ki 4856Ki rename 30 0:00 1.48% cpdup -i0 -s0 -f -x ref 25
>>>> 71917 0 root 59 0 16872Ki 4960Ki wait 1 0:00 0.00% sh: poudriere[official-amd64-default][25]: build_pkg (mpg123-1.33.2) (sh)
>>>> 71629 0 root 0 0 20976Ki 4828Ki rename 31 0:00 1.61% cpdup -i0 -s0 -f
>>>> . . .
>>>>
>>>> But I'll also see such on c compiles, ld commands, etc. I've
>>>> not seen rename for pkg-static but I have seen flswai for it.
>>>>
>>>> The system spends lots of time 95%+ idle from the wait
>>>> activities.
>>>>
>>>> I see such directly booted from the USB3 media (a 15.0-ALPHA4
>>>> context on UFS media) and when using that media via chroot
>>>> from both ZFS and UFS boots that are not USB based. The ZFS
>>>> and UFS boots do not show the behavior with the normal
>>>> non-USB3 media used instead.
>>>>
>>>> The system in use is an AMD 7950X3D with 32 FreeBSD cpus,
>>>> 192 GiBytes of RAM. main 16 booting for non-USB boots
>>>> and 15.0-ALPHA4 boots for the USB3 boots. kernel and
>>>> world are via official pkgbase distribution installs:
>>>> it is not a personal build of the kernel or world.
>>>>
>>>>
>>>> More rename and flswai examples:
>>>>
>>>> . . .
>>>> 39320 183 nobody 59 0 171676Ki 160576Ki rename 29 0:00 2.17% cc -D_BLD_DLL -fPIC -D_BLD_ast -Os -Wno-unused-value -Wno-parentheses -Wno-logical-op-parentheses -fno-strict-aliasing -I
>>>> 62772 183 nobody 59 0 14376Ki 3372Ki wait 25 0:00 0.04% mamake -C lib/libast install
>>>> 12602 183 nobody 59 0 14376Ki 3072Ki wait 17 0:00 0.00% mamake -r */* install
>>>> 12600 183 nobody 59 0 14376Ki 3076Ki wait 22 0:00 0.00% mamake install
>>>> 12596 183 nobody 0 0 14068Ki 2688Ki piperd 10 0:00 0.01% tee -a /wrkdirs/usr/ports/shells/ksh/work/ksh-1.0.10/arch/freebsd15.i386-64/lib/package/gen/make.out
>>>> 8980 183 nobody 59 0 14744Ki 3732Ki wait 6 0:00 0.00% /bin/sh bin/package flat make
>>>> 8977 183 nobody 59 0 14744Ki 3436Ki wait 3 0:00 0.00% /bin/sh -e /tmp/makelMk4B8
>>>> 8929 183 nobody 59 0 14288Ki 3872Ki wait 4 0:00 0.00% /usr/bin/make -C /usr/ports/shells/ksh build
>>>> 39327 179 nobody 59 0 105680Ki 93264Ki biowr 2 0:00 0.61% /usr/bin/ld --eh-frame-hdr -dynamic-linker /libexec/ld-elf.so.1 --hash-style=both --enable-new-dtags -o test /usr/lib/crt
>>>> 39325 179 nobody 59 0 165928Ki 155088Ki wait 17 0:00 1.00% /usr/bin/cc -o test ../test.o
>>>> 39294 179 nobody 59 0 14744Ki 3448Ki wait 10 0:00 0.01% sh /wrkdirs/usr/ports/shells/ksh93/work/ast-93u/arch/freebsd16.amd64/lib/probe/C/make/probe /usr/bin/cc PREROOT='' UNIVER
>>>> 39293 179 nobody 59 0 15264Ki 3704Ki piperd 19 0:00 0.00% /wrkdirs/usr/ports/shells/ksh93/work/ast-93u/arch/freebsd16.amd64/lib/probe/probe C make /usr/bin/cc
>>>> 39291 179 nobody 59 0 16344Ki 4960Ki wait 10 0:00 0.00% /wrkdirs/usr/ports/shells/ksh93/work/ast-93u/arch/freebsd16.amd64/bin/nmake --ignorelock --keepgoing --errorid=lib/libast
>>>> 39290 179 nobody 59 0 14744Ki 3444Ki wait 12 0:00 0.00% sh /dev/fd/3
>>>> 39258 179 nobody 59 0 14744Ki 3452Ki piperd 0 0:00 0.00% sh /dev/fd/3
>>>> 37014 179 nobody 0 0 14068Ki 2692Ki piperd 30 0:00 0.00% tee -a /wrkdirs/usr/ports/shells/ksh93/work/ast-93u/arch/freebsd16.amd64/lib/package/gen/make.out
>>>> 37013 179 nobody 0 0 16728Ki 5320Ki select 14 0:00 0.00% /wrkdirs/usr/ports/shells/ksh93/work/ast-93u/arch/freebsd16.amd64/bin/nmake -k -K recurse believe nmake
>>>> 32949 179 nobody 13 0 14744Ki 4136Ki wait 31 0:00 0.00% /bin/sh bin/package flat make ksh93
>>>> 32948 179 nobody 59 0 14744Ki 3444Ki wait 19 0:00 0.00% /bin/sh -e /tmp/makeW36tmB
>>>> 32940 179 nobody 59 0 14288Ki 3892Ki wait 21 0:00 0.00% /usr/bin/make -C /usr/ports/shells/ksh93 build
>>>> 32453 0 root 0 0 20976Ki 5020Ki rename 22 0:03 0.47% cpdup -i0 -s0 -f -x ref 26
>>>> 32420 0 root 0 0 20976Ki 5024Ki rename 13 0:03 0.50% cpdup -i0 -s0 -f -x ref 11
>>>> 32358 0 root 0 0 20976Ki 5068Ki rename 26 0:03 0.53% cpdup -i0 -s0 -f -x ref 20
>>>> 32333 0 root 59 0 16872Ki 4960Ki wait 11 0:00 0.00% sh: poudriere[official-amd64-default][26]: build_pkg (linux-c7-numactl-libs-2.0.12_1) (sh)
>>>> 32313 0 root 59 0 16872Ki 4960Ki wait 9 0:00 0.00% sh: poudriere[official-amd64-default][20]: build_pkg (linux-c7-libaio-0.3.109) (sh)
>>>> 32301 0 root 59 0 16872Ki 4960Ki wait 19 0:00 0.00% sh: poudriere[official-amd64-default][11]: build_pkg (linux-c7-dosfstools-3.0.20) (sh)
>>>> 13808 0 root 0 0 20976Ki 4984Ki rename 4 0:03 0.57% cpdup -i0 -s0 -f -x ref 19
>>>> 12316 0 root 0 0 20976Ki 5072Ki biowr 27 0:03 0.56% cpdup -i0 -s0 -f -x ref 13
>>>> 12283 0 root 0 0 20976Ki 5068Ki rename 5 0:03 0.53% cpdup -i0 -s0 -f -x ref 01
>>>> 12277 0 root 0 0 20976Ki 5068Ki rename 28 0:03 0.54% cpdup -i0 -s0 -f -x ref 14
>>>> 12096 0 root 59 0 16872Ki 4960Ki wait 27 0:00 0.00% sh: poudriere[official-amd64-def
>>>> . . .
>>>>
>>>>
>>>> . . .
>>>> 39927 183 nobody 59 0 171676Ki 160396Ki flswai 13 0:00 2.03% cc -D_BLD_DLL -fPIC -D_BLD_ast -Os -Wno-unused-value -Wno-parentheses -Wno-logical-op-parentheses -fno-strict-aliasing -I
>>>> 62772 183 nobody 59 0 14376Ki 3400Ki wait 3 0:00 0.06% mamake -C lib/libast install
>>>> 12602 183 nobody 59 0 14376Ki 3072Ki wait 17 0:00 0.00% mamake -r */* install
>>>> 12600 183 nobody 59 0 14376Ki 3076Ki wait 22 0:00 0.00% mamake install
>>>> 12596 183 nobody 0 0 14068Ki 2688Ki piperd 28 0:00 0.01% tee -a /wrkdirs/usr/ports/shells/ksh/work/ksh-1.0.10/arch/freebsd15.i386-64/lib/package/gen/make.out
>>>> 8980 183 nobody 59 0 14744Ki 3732Ki wait 6 0:00 0.00% /bin/sh bin/package flat make
>>>> 8977 183 nobody 59 0 14744Ki 3436Ki wait 3 0:00 0.00% /bin/sh -e /tmp/makelMk4B8
>>>> 8929 183 nobody 59 0 14288Ki 3872Ki wait 4 0:00 0.00% /usr/bin/make -C /usr/ports/shells/ksh build
>>>> 39924 179 nobody 59 0 125140Ki 95572Ki flswai 20 0:00 0.60% /usr/bin/ld --eh-frame-hdr -dynamic-linker /libexec/ld-elf.so.1 --hash-style=both --enable-new-dtags -o dynamic.exe /usr/
>>>> 39924 179 nobody 59 0 125140Ki 95572Ki uwait 0 0:00 0.01% /usr/bin/ld --eh-frame-hdr -dynamic-linker /libexec/ld-elf.so.1 --hash-style=both --enable-new-dtags -o dynamic.exe /usr/
>>>> 39924 179 nobody 59 0 125140Ki 95572Ki uwait 13 0:00 0.01% /usr/bin/ld --eh-frame-hdr -dynamic-linker /libexec/ld-elf.so.1 --hash-style=both --enable-new-dtags -o dynamic.exe /usr/
>>>> 39924 179 nobody 59 0 125140Ki 95572Ki uwait 16 0:00 0.01% /usr/bin/ld --eh-frame-hdr -dynamic-linker /libexec/ld-elf.so.1 --hash-style=both --enable-new-dtags -o dynamic.exe /usr/
>>>> 39924 179 nobody 59 0 125140Ki 95572Ki uwait 27 0:00 0.01% /usr/bin/ld --eh-frame-hdr -dynamic-linker /libexec/ld-elf.so.1 --hash-style=both --enable-new-dtags -o dynamic.exe /usr/
>>>> 39923 179 nobody 59 0 165928Ki 155092Ki wait 0 0:00 1.00% /usr/bin/cc -o dynamic.exe -dynamic dynamic.o
>>>> 39294 179 nobody 59 0 14744Ki 3464Ki wait 9 0:00 0.02% sh /wrkdirs/usr/ports/shells/ksh93/work/ast-93u/arch/freebsd16.amd64/lib/probe/C/make/probe /usr/bin/cc PREROOT='' UNIVER
>>>> 39293 179 nobody 59 0 15264Ki 3704Ki piperd 19 0:00 0.00% /wrkdirs/usr/ports/shells/ksh93/work/ast-93u/arch/freebsd16.amd64/lib/probe/probe C make /usr/bin/cc
>>>> 39291 179 nobody 59 0 16344Ki 4960Ki wait 10 0:00 0.00% /wrkdirs/usr/ports/shells/ksh93/work/ast-93u/arch/freebsd16.amd64/bin/nmake --ignorelock --keepgoing --errorid=lib/libast
>>>> 39290 179 nobody 59 0 14744Ki 3444Ki wait 12 0:00 0.00% sh /dev/fd/3
>>>> 39258 179 nobody 59 0 14744Ki 3452Ki piperd 0 0:00 0.00% sh /dev/fd/3
>>>> 37014 179 nobody 0 0 14068Ki 2692Ki piperd 30 0:00 0.00% tee -a /wrkdirs/usr/ports/shells/ksh93/work/ast-93u/arch/freebsd16.amd64/lib/package/gen/make.out
>>>> 37013 179 nobody 0 0 16728Ki 5320Ki select 14 0:00 0.00% /wrkdirs/usr/ports/shells/ksh93/work/ast-93u/arch/freebsd16.amd64/bin/nmake -k -K recurse believe nmake
>>>> 32949 179 nobody 13 0 14744Ki 4136Ki wait 31 0:00 0.00% /bin/sh bin/package flat make ksh93
>>>> 32948 179 nobody 59 0 14744Ki 3444Ki wait 19 0:00 0.00% /bin/sh -e /tmp/makeW36tmB
>>>> 32940 179 nobody 59 0 14288Ki 3892Ki wait 21 0:00 0.00% /usr/bin/make -C /usr/ports/shells/ksh93 build
>>>> 32453 0 root 0 0 20976Ki 5020Ki flswai 17 0:03 2.82% cpdup -i0 -s0 -f -x ref 26
>>>> 32420 0 root 1 0 20976Ki 5024Ki flswai 25 0:03 2.81% cpdup -i0 -s0 -f -x ref 11
>>>> 32358 0 root 1 0 20976Ki 5068Ki flswai 14 0:03 2.79% cpdup -i0 -s0 -f -x ref 20
>>>> 32333 0 root 59 0 16872Ki 4960Ki wait 11 0:00 0.00% sh: poudriere[official-amd64-default][26]: build_pkg (linux-c7-numactl-libs-2.0.12_1) (sh)
>>>> 32313 0 root 59 0 16872Ki
>>>> . . .
>>>>
>>>>
>>>> . . .
>>>> 53486 185 root 0 0 66428Ki 34196Ki getblk 25 0:01 0.26% /usr/local/sbin/pkg-static add -A /packages/All/perl5-5.42.0_1.pkg
>>>> 53485 185 root 59 0 23308Ki 12024Ki wait 0 0:00 0.00% /usr/local/sbin/pkg-static add -A /packages/All/perl5-5.42.0_1.pkg
>>>> 53446 185 root 59 0 14744Ki 3504Ki wait 11 0:00 0.00% /bin/sh /usr/ports/Mk/Scripts/do-depends.sh
>>>> 53445 185 root 59 0 14284Ki 3828Ki wait 1 0:00 0.00% /usr/bin/make -C /usr/ports/textproc/p5-YAML-Tiny build-depends
>>>> 96359 183 root 0 0 66428Ki 34196Ki flswai 31 0:00 1.43% /usr/local/sbin/pkg-static add -A /packages/All/perl5-5.42.0_1.pkg
>>>> 96358 183 root 59 0 23308Ki 12020Ki wait 29 0:00 0.00% /usr/local/sbin/pkg-static add -A /packages/All/perl5-5.42.0_1.pkg
>>>> 96331 183 root 59 0 14744Ki 3504Ki wait 5 0:00 0.00% /bin/sh /usr/ports/Mk/Scripts/do-depends.sh
>>>> 96330 183 root 59 0 14284Ki 3860Ki wait 27 0:00 0.00% /usr/bin/make -C /usr/ports/security/cyrus-sasl2 patch-depends
>>>> 9658 170 nobody 59 0 14224Ki 2852Ki flswai 3 0:00 0.02% install -m 0644 ./libcdio.info /wrkdirs/usr/ports/sysutils/libcdio/work/stage/usr/local/share/info
>>>> 9652 170 nobody 59 0 14744Ki 3420Ki wait 2 0:00 0.00% /bin/sh -c srcdirstrip=`echo "." | sed 's|.|.|g'`; \\\nlist='./libcdio.info'; test -n "/usr/local/share/info" || list=; \
>>>> 9643 170 nobody 59 0 14744Ki 3420Ki wait 8 0:00 0.03% /bin/sh -c srcdirstrip=`echo "." | sed 's|.|.|g'`; \\\nlist='./libcdio.info'; test -n "/usr/local/share/info" || list=; \
>>>> 9642 170 nobody 59 0 14776Ki 3652Ki wait 21 0:00 0.04% /usr/local/bin/gmake install-exec-am install-data-am
>>>> 9641 170 nobody 59 0 14776Ki 3632Ki wait 3 0:00 0.04% /usr/local/bin/gmake install
>>>> 9636 170 nobody 59 0 14744Ki 3424Ki wait 15 0:00 0.03% /bin/sh -c fail=; \\\nif (target_option=k; case ${target_option-} in ?) ;; *) echo "am__make_running_with_option: interna
>>>> 9635 170 nobody 59 0 14776Ki 3708Ki wait 0 0:00 0.06% /usr/local/bin/gmake INSTALL_PROGRAM=/bin/sh /wrkdirs/usr/ports/sysutils/libcdio/work/libcdio-2.2.0/install-sh -c -s inst
>>>> 9634 170 nobody 59 0 14776Ki 3680Ki wait 29 0:00 0.08% /usr/local/bin/gmake -f Makefile DESTDIR=/wrkdirs/usr/ports/sysutils/libcdio/work/stage install-strip
>>>> 9633 170 nobody 59 0 14744Ki 3428Ki wait 13 0:00 0.02% /bin/sh -e /tmp/makeOENiKj
>>>> 9611 170 nobody 59 0 16848Ki 3876Ki wait 21 0:00 0.22% /usr/bin/make -C /usr/ports/sysutils/libcdio stage
>>>> 51574 158 root 0 0 74620Ki 34184Ki flswai 20 0:01 0.28% /usr/local/sbin/pkg-static add -A /packages/All/perl5-5.42.0_1.pkg
>>>> 51573 158 root 59 0 23308Ki 12020Ki wait 20 0:00 0.00% /usr/local/sbin/pkg-static add -A /packages/All/perl5-5.42.0_1.pkg
>>>> 51547 158 root 59 0 14744Ki 3512Ki wait 18 0:00 0.00% /bin/sh /usr/ports/Mk/Scripts/do-depends.sh
>>>> 51545 158 root 59 0 14284Ki 3852Ki wait 27 0:00 0.00% /usr/bin/make -C /usr/ports/textproc/hyphen build-depends
>>>> 56591 157 root 0 0 66428Ki 34184Ki getblk 17 0:01 0.25% /usr/local/sbin/pkg-static add -A /packages/All/perl5-5.42.0_1.pkg
>>>> 56590 157 root 59 0 23308Ki 12024Ki wait 12 0:00 0.00% /usr/local/sbin/pkg-static add -A /packages/All/perl5-5.42.0_1.pkg
>>>> 56528 157 root 59 0 14744Ki 3504Ki wait 28 0:00 0.00% /bin/sh /usr/ports/Mk/Scripts/do-depends.sh
>>>> 56469 157 root 59 0 14284Ki 3832Ki wait 4 0:00 0.00% /usr/bin/make -C /usr/ports/converters/p5-MIME-Base32 build-depends
>>>> 56593 155 root 0 0 66428Ki 34188Ki getblk 8 0:01 0.26% /usr/local/sbin/pkg-static add -A /packages/All/perl5-5.42.0_1.pkg
>>>> 56592 155 root 59 0 23308Ki 12024Ki wait 4 0:00 0.00% /usr/local/sbin/pkg-static add -A /packages/All/perl5-5.42.0_1.pkg
>>>> 56559 155 root 59 0 14744Ki 3508Ki wait 18 0:00 0.00% /bin/sh /usr/ports/Mk/Scripts/do-depends.sh
>>>> 56532 155 root 59 0 14284Ki 3828Ki wait 13 0:00 0.00% /usr/bin/make -C /usr/ports/devel/p5-Parse-Yapp build-depends
>>>> 52781 145 root 0 0 74620Ki 34244Ki flswai 12 0:01 0.25% /usr/local/sbin/pkg-static add -A /packages/All/perl5-5.42.0_1.pkg
>>>> 52780 145 root 59 0 23308Ki 12024Ki wait 22 0:00 0.00% /usr/local/sbin/pkg-static add -A /packages/All/perl5-5.42.0_1.pkg
>>>> 52753 145 root 59 0 14744Ki 3508Ki wait 24 0:00 0.00% /bin/sh /usr/ports/Mk/Scripts/do-depends.sh
>>>> 52749 145 root 59 0 14284Ki 3824Ki wait 21 0:00 0.00% /usr/bin/make -C /usr/ports/converters/p5-JSON build-depends
>>>> 9610 0 root 59 0 16872Ki 4972Ki wait 14 0:00 0.01% sh: poudriere[official-amd64-default][14]: build_pkg (libcdio-2.2.0) (sh)
>>>> 99560 0 root 1 0 20976Ki 4860Ki flswai 15 0:00 2.82% cpdup -i0 -s0 -f -x ref 01
>>>> 99539 0 root 59 0 16872Ki 4960Ki wait 10 0:00 0.00% sh: poudriere[official-amd64-default][01]: build_pkg (texi2html-5.0_5,1) (sh)
>>>> 98112 0 root 1 0 20976Ki 4828Ki flswai 19 0:00 3.47% cpdup -i0 -s0 -f -x ref 28
>>>> 98096 0 root 59 0 16872Ki 4960Ki wait 31 0:00 0.00% sh: poudriere[official-amd64-default][28]: build_pkg (gdbm-1.26) (sh)
>>>> 97694 0 root 1 0 20976Ki 4844Ki flswai 7 0:01 2.51% cpdup -i0 -s0 -f -x ref 27
>>>> 97665 0 root 59 0 16872Ki 4960Ki wait 0 0:00 0.00% sh: poudriere[official-amd64-default][27]: build_pkg (sudo-1.9.17p2) (sh)
>>>> 96108 0 root 0 0 20976Ki 4800Ki flswai 29 0:01 3.06% cpdup -i0 -s0 -f -x ref 19
>>>> 96091 0 root 59 0 16872Ki 4960Ki wait 31 0:00 0.00% sh: poudriere[official-amd64-default][19]: build_pkg (libgpg-error-1.55) (sh)
>>>> 93884 0 root 0 0 20976Ki 5064Ki flswai 19 0:01 2.43% cpdup -i0 -s0 -f -x ref 26
>>>> 93857 0 root 59 0 16872Ki 4960Ki wait 16 0:00 0.00% sh: poudriere[official-amd64-default][26]: build_pkg (libxml2-2.14.5) (sh)
>>>> 93271 0 root 0 0 20976Ki 5224Ki flswai 5 0:01 2.38% cpdup -i0 -s0 -f -x ref 12
>>>> 93212 0 root 59 0 16872Ki 4960Ki wait 11 0:00 0.00% sh: poudriere[official-amd64-default][12]: build_pkg (lame-3.100_5) (sh)
>>>> 88119 0 root 0 0 20976Ki 5212Ki flswai 0 0:01 2.51% cpdup -i0 -s0 -f -x ref 32
>>>> 88077 0 root 0 0 20976Ki 5176Ki flswai 0 0:01 2.38% cpdup -i0 -s0 -f -x ref 31
>>>> . . .
===
Mark Millard
marklmi at yahoo.com