From nobody Sat Mar 08 01:19:59 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Z8lhL2Mydz5qBxH for ; Sat, 08 Mar 2025 01:20:18 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic314-20.consmr.mail.gq1.yahoo.com (sonic314-20.consmr.mail.gq1.yahoo.com [98.137.69.83]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Z8lhK1lz0z49F5 for ; Sat, 08 Mar 2025 01:20:17 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=sNlk8dQl; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.83 as permitted sender) smtp.mailfrom=marklmi@yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1741396815; bh=kSoo/2CNzPkTaUoi4feC3hpMDTZMlJuFhQMEjCIzLsE=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=sNlk8dQlVTku2MQ09+znkAuqnnXvgJUzrhxn5vwhU1J4tvjsXQlsimtsN1mkZJKpWG+8Tx+y5HCZlv4/5BCWhN82ZSLAQkoWx79lEgqxtzEMiQDpkw3PRGY/tZ2nm9pvbGuMWxGNFCMOS9rGC/UUNYHF3tRWZKLZdC8/iTgbBEBm2aFG8iOYi1jN5i2h4wnGDKPHFlYp0KjlzPp6+Abh22jAEz50chYn49ERPQcVIhjqIiq0/gyJHOL+XyzZyreOQ5Gfbb5pdj1H/bLty8R6ehBvCNdbcuQIYN9D0itZsHBqCz79P4Dfz5TUbPWnfqdPzHkmTZyQjjk32T9xWLbOPA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1741396815; bh=GaGjM4JCN7g4UoOO1ITkUZxZcxYTx4S6JZqqEWVLR5P=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=bj7CAv9MT8SlkQikpRJqvPxWvbfSXF5c2gERyMnbv88pHdeqkTa2tb1e9hCjgBVwCSD3J+zasBl5ymkmrjrxnhojt5N36hCCWiyM9xzuJTHgdjHPwztWmBrq0P/hKkoPd+2A5HzWCKVWETt5WXP8F+0XZUMmzyDUxVsST3FQOsxKHV4XDqJBTnwlLi2vPcgXd4DiI+vnbHSVKd6dOjAaTNf5SuSJ1gL0LWJg0kSIA3dwpK3E+Mj24jfomc0DUvCyQDJbae8Ri+RW5FtKUm/RGaVsU95e9N0CvQnCazXndsbrzK13zXnLMUdm4FB6XRSdwVo1vIeYH4A90OrSXWlz8w== X-YMail-OSG: qseP3AcVM1lFHU84mQn7t6gZPeKIdpb9XUmCtyaphAJEJ6UZB8q9QapQFGPr.j3 NH1Tv3QWSUm.k4rExiMaZkb8SnFVxQ_dBwacrf.lLah7CVYDj235Wsz4xSvf.xBwL_9R1fUidTMN 9dpxxncJ9FJbDcouTti0QkVF.9TnlmAY20SiCXP7RBpbdF7N_Al4UhignCZCVsAoY7T1JwnR7qcg f_b3_wplcQfR14Ub6v3s0ui2p6o.6zQZaf03SgFRO6xsy62VgP945tHWC8STbLU7IQ0zr9y53hyR meSZ6TgZJ3CdtugnHl0WGrbvsjp8rduWr.Tt4aps4UBIvCcyF3soQWRIp4WL41uQo_DPuNpOnJj8 aajEI4k0p4BvdqfDjVFMTaNfJJ.X984et3uFSljwBW8xHMNvpVkJ6lTVtAGuy.cDDg.FK87dBjrL aAAXGcQfDEGuoLoG.UbMatPdZnfr6e35XmKqTR.GxT0pH.2BlMMPGIm755cmRah5OebZ14_bGzWa 5AsRuwvjjK6vqF_pEGrVyY9gOLQMag4RwD0MQCOT.OahSjLtfnaW.2pJfAxAsXMSxaA.95ecxdto fLHob2aJaAfr4Ac95Lk6JwB857RVR9k5BkPyugG2LFVuP5SNtyljYZA775uwcoX1cxtQg2PodeFx 0ewuaH8Yq_FyxqtFiarBAdqsjPHJAWfqqbw.gFpWj0O0YVwZEDOzhcEcBM1dTqdR5Lldl27Ma5yK 0OQ066ye7mcJrryqjNyzElqL6n0xWISnd70dGSm3C7Gr9DZk8FdO5fnzIEGNRtZGkOQbNv63liq2 P8MVvMzBtm8EpQgxMelpjNpfQPvXxzlP4iacAwF.JL_DdYIORloEhNqM_oX0ApT0bqC_nntUD3PL _uFLYV59dKAwfl8DL885Bs_a5IOohVsP1uBaz6Wfc6zjNcvR7Xx12_ZLEqBbG2wOSMLx1MG9igxX zgqVO07meVmtAsn5dczE7xL9nnCxdLJT_BSy61_ef6rWbY6k46kE5U7DAAzROUfMtnqpH8j2PSHF J4vHyeSdn.yElg85KjYxhlEHkIIpt9mYoiMd5AO_H2qbRasSNQp2Ly1zG5objJRA3ac5qKmNzBhu qsJ3ld5OJxNBNjxOZxYynjKIiYkzhzDHHA3b7XC5zPA6Poy36js7rsMKCZio.dRIjX5c8e65wkyT .DY57ZeANG2Vd09vRuVVIH._azVeGN2j.qUH.0rg7yBPhcEG9BEIiv8JZYojjFCc5XdbDuKSyq9U teHCoG3g1Lxp.1raZ44OO7c.BakJwfFwR9439ks.k7Xfg._RALDnrb98e_d8r9Ccj4F04cnqWVrO LiEDJDI3aefGAb1TMh5EdJ7Yzzhdm27SH9a4dpgv8Ja3bq.E0l7tcvfnYNNvuS2P28jcnGLNn3d3 jbAuOAJPi4iMNcwOXfiW3NPNJ1hyE7YMt9gpTFRs4AfunKGl3SQyd94QRN_JMxmXfiQ.tERYzqXR KEVp1qHNWUua9ROAjnELYhJ9bMEd4Acdy0NdSdCfmDkGu5K4YaPEEpyIuhXVU8DBMfkYJwhUphHo 7nWzSB50sYP1bCieMcY7tuAK3mAGMZSuJpmybhjmrrR9apnbFZnMfOb3HPpr61URUCax7guWPn4_ jUVU7ev5SkvUT.NTuWR2cfSGJZFN1Yp6EjoD2zJkcb0cPxnLysra.O9fbJdx0mxGF8Z5nwgi73ne nngJPRJg93Vm_ZXKIKpwJYBSsUUvu2uLLqGsWOAthAtbzoKbBGNHA_tSYH6fyKu7hGLDcthESa4i UBf63JXAo7BezKf8oEzbkg3EzYfITUqlgUSwNTW5PxsrbP_eH5CZIJofSlH3nBZ0eDIg1V8DJPSD 27mc3ZFx2dHii6DDVlTrQneFVcLE1E9SY2CB0d9rFK1eYrL6J7mzeg30ydPe6wQOq8U79FDRudsY f36oAfSC6.zKcaet3nywrJcZUVcqbbmH5Lz9XQ1DrBObqUwFc5iH5c2WcTXQNqUi4idCU7gENURs KqX7g4.DvcJBysc7GpXqcOcWeRodkciMLxeH_ANwtWIjZfrgt3GqI8xAE2JQLFL7Yp9EUXmd_PUQ ogcd8V3GG4h.GSWgASiowOM1QfqNCVVijlmFAIqfSlXlAICaba76_poLyOJFPppaHUsjO.ehmuPv G.rW1fWKn2lTdFpDyll7eea6N1wAX6mdO6EQG3YFGefH8hW3Ssu.bPlWvux9E6IOc6KumDAMcmul J38t45UoA82eAhHiH2cBV4rmemiz5YtFkdYNLCfA2QK_pCxCrvXZRU3tEwfa1Cyw1PuvDO97Q6hW CgjmNHkhq X-Sonic-MF: X-Sonic-ID: 6924073b-1f81-483f-881a-01011ab0e63c Received: from sonic.gate.mail.ne1.yahoo.com by sonic314.consmr.mail.gq1.yahoo.com with HTTP; Sat, 8 Mar 2025 01:20:15 +0000 Received: by hermes--production-gq1-7d5f4447dd-9qjv2 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID c89c55d0eea968c1db1b1721700c3abb; Sat, 08 Mar 2025 01:20:10 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.400.131.1.6\)) Subject: RE: building port www/chromium fails due to paging problem Message-Id: <5449D69F-85F3-4302-81B4-22C9D1130845@yahoo.com> Date: Fri, 7 Mar 2025 17:19:59 -0800 To: guru@unixarea.de, FreeBSD Current X-Mailer: Apple Mail (2.3826.400.131.1.6) References: <5449D69F-85F3-4302-81B4-22C9D1130845.ref@yahoo.com> X-Spamd-Result: default: False [-3.17 / 15.00]; RBL_SENDERSCORE_REPUT_9(-1.00)[98.137.69.83:from]; NEURAL_HAM_MEDIUM(-0.92)[-0.924]; NEURAL_HAM_SHORT(-0.69)[-0.694]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-0.05)[-0.048]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; TO_DN_SOME(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FREEMAIL_FROM(0.00)[yahoo.com]; DKIM_TRACE(0.00)[yahoo.com:+]; FROM_HAS_DN(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.83:from]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.83:from] X-Rspamd-Queue-Id: 4Z8lhK1lz0z49F5 X-Spamd-Bar: --- Matthias Apitz wrote on Date: Fri, 07 Mar 2025 12:59:49 UTC : > I'm building ports on a recent 15.0-CURRENT with ports tree from git = on March 3: >=20 > # uname -a > FreeBSD jet 15.0-CURRENT FreeBSD 15.0-CURRENT #0 = main-n275738-7ee310c80ea7: Sun Mar 2 01:13:00 CET 2025 = guru@jet:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 >=20 > # sysctl vfs.read_max=3D128 > # sysctl vfs.aio.max_buf_aio=3D8192 > # sysctl vfs.aio.max_aio_queue_per_proc=3D65536 > # sysctl vfs.aio.max_aio_per_proc=3D8192 > # sysctl vfs.aio.max_aio_queue=3D65536 > # sysctl vm.pageout_oom_seq=3D120 > # sysctl vm.pfault_oom_attempts=3D-1=20 >=20 > # poudriere bulk -f /usr/local/etc/poudriere-list -J 3 -j 150-CURRENT = -p ports20250303 >=20 > The file /usr/local/etc/poudriere-list contains only www/chromium, = because > all other ~2400 pkg are already made. >=20 > The job gets killed with: > ... > =3D=3D=3D> chromium-133.0.6943.141_1 depends on package: py311-ply>0 - = found > =3D=3D=3D> Returning to build of chromium-133.0.6943.141_1 > =3D=3D=3D> chromium-133.0.6943.141_1 depends on executable: bindgen - = not found > =3D=3D=3D> Installing existing package = /packages/All/rust-bindgen-cli-0.71.1_2.pkg > [150-CURRENT-ports20250303-job-01] Installing = rust-bindgen-cli-0.71.1_2... > [150-CURRENT-ports20250303-job-01] `-- Installing llvm19-19.1.7_1... > [150-CURRENT-ports20250303-job-01] | `-- Installing = libedit-3.1.20240808,1... > [150-CURRENT-ports20250303-job-01] | `-- Extracting = libedit-3.1.20240808,1: .......... done > [150-CURRENT-ports20250303-job-01] | `-- Installing lua53-5.3.6_1... > [150-CURRENT-ports20250303-job-01] | `-- Extracting lua53-5.3.6_1: = .......... done > [150-CURRENT-ports20250303-job-01] | `-- Installing perl5-5.36.3_2... > [150-CURRENT-ports20250303-job-01] | `-- Extracting perl5-5.36.3_2: = .......... done > [150-CURRENT-ports20250303-job-01] | `-- Installing zstd-1.5.7... > [150-CURRENT-ports20250303-job-01] | | `-- Installing = liblz4-1.10.0,1... > [150-CURRENT-ports20250303-job-01] | | `-- Extracting liblz4-1.10.0,1: = .......... done > [150-CURRENT-ports20250303-job-01] | `-- Extracting zstd-1.5.7: = .......... done > [150-CURRENT-ports20250303-job-01] `-- Extracting llvm19-19.1.7_1: = .....Killed > Child process pid=3D66963 terminated abnormally: Killed Note that the above died while extracting from llvm19-19.1.7_1.pkg . What are you using in /usr/local/etc/poudriere.conf for USE_TMPFS=3D and for the likes of TMPFS_BLACKLIST=3D and TMPFS_BLACKLIST_TMPDIR=3D ? I'll note that the file system space use is vastly larger on later stages of building. Using RAM+SWAP via TMPFS use would have the file system competing for the RAM as well. How many FreeBSD cpus? in /usr/local/etc/poudriere.conf wat are you using for ALLOW_MAKE_JOBS=3D ? For ALLOW_MAKE_JOBS_PACKAGES=3D ? With -J3 in use, later in a bulk run there could be questions of what the RAM+SWAP usage is like for other jobs happening in parallel. > # grep 66963 /var/log/messages > Mar 7 10:24:34 jet kernel: pid 66963 (pkg-static), jid 3, uid 0, was = killed: failed to reclaim memory The above message means that FreeBSD had a sustained period of being unable to have its Free Memory threshold met. ven a single process (thread) that both stays runnable and causes a sufficiently large Active Memory figure can lead to this condition. There is a tunable for giving more time for something to complete before that happens. For example, in /boot/loader.conf : vm.pageout_oom_seq=3D120 is 10 times larger than the default of 12. # sysctl -Td vm.pageout_oom_seq vm.pageout_oom_seq: back-to-back calls to oom detector to start OOM It is also writable on a live system: # sysctl -Wd vm.pageout_oom_seq vm.pageout_oom_seq: back-to-back calls to oom detector to start OOM So: # sysctl vm.pageout_oom_seq=3D120 vm.pageout_oom_seq: 120 -> 120 (I use 120 over a wide variety of contexts.) > # swapctl -l > Device: 1024-blocks Used: > /dev/da0p3 4194304 3144 The above added 4 GiBytes of SWAP that (mostly) do not complete for RAM. So RAM+SWAP is effectively about 16 GiByte + 4 GiByte =3D=3D 20 GiByte. It is not clear for the below what type of /dev/md* is in use in each case: malloc? vnode? swap? ( better not be: null ) Presuming vnode: quoting = https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D206048#c7 QUOTE On 2017-Feb-13, at 7:20 PM, Konstantin Belousov = wrote on the freebsd-arm list: . . . swapfile write requires the write request to come through the filesystem write path, which might require the filesystem to allocate more memory and read some data. E.g. it is known that any ZFS write request allocates memory, and that write request on large UFS file might require allocating and reading an indirect block buffer to find the block number of the written block, if the indirect block was not yet read. As result, swapfile swapping is more prone to the trivial and = unavoidable deadlocks where the pagedaemon thread, which produces free memory, needs more free memory to make a progress. Swap write on the raw partition = over simple partitioning scheme directly over HBA are usually safe, while = e.g. zfs over geli over umass is the worst construction. END QUOTE So I'd not recommend the use of vnode /dev/md* based swap spaces. Nor would I recommend one of the types: malloc, swap, or null for /dev/md* swap space creation. "man 8 mdconfig" reports: QUOTE -t type Select the type of the memory disk. malloc Storage for this type of memory disk is allocated with malloc(9). This limits the size to the malloc bucket limit in the kernel. If the -o reserve option is not set, creating and filling a large malloc-backed memory disk is a very easy way to panic the system. vnode A file specified with -f file becomes the backing store for this memory disk. swap Storage for this type of memory disk is allocated from buffer memory. Pages get pushed out to swap when the system is under memory pressure, otherwise they stay in the operating memory. Using swap backing is generally preferred instead of using malloc backing. null Bitsink; all writes do nothing, all reads return ze- roes. END QUOTE > /dev/md9 10485760 3060 > /dev/md10 10485760 3448 > /dev/md11 10485760 2924 > =20 > I checked all swap devices with (example): >=20 > # dd if=3D/dev/md10 of=3D/dev/null bs=3D8m >=20 > all "devices" are fine. >=20 > The box has 16 GByte RAM. >=20 > What else could I check/do? =3D=3D=3D Mark Millard marklmi at yahoo.com