From nobody Sun Sep 19 09:12:17 2021 X-Original-To: freebsd-toolchain@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id F0C7117CB4FE for ; Sun, 19 Sep 2021 09:12:31 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic304-23.consmr.mail.gq1.yahoo.com (sonic304-23.consmr.mail.gq1.yahoo.com [98.137.68.204]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4HC25V2YLvz3Fpc for ; Sun, 19 Sep 2021 09:12:30 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1632042743; bh=G0PyIJP81j3gRmAVDu0ZUVfCrnq/lUhE0P+RQpdDi5M=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=XfB4CELA7Qupz4J9ujsbP4iEcdQRKLdLmEdOfh5okuxH1GfafLb2lVVxXvyDgiaJ6yeQAWjlZ60h/anTECD/Q9OQThcA9RFwePxc12JhUyB4ZvM/1QYMoP+owA4QnVlzIZX85KMQjGtsQQzBElA6nJ4Lr6xxarBVVhsES8eik1GZeUw5rCosw5CNtjxXs9FhPvjMQFvfc97wXVmfA9VxxsxS77rhCja7LpZ2/BZ5ZcdMH8fmUcE2w8z4c+XdOu1zjaFyEbfa3Cvk42oFoD2TjeFniqLCfXbhOoq79mfU6uO75xkTtPUxCinyqAf8BONsWX8dXcgpO93Hb02Z8tse8g== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1632042743; bh=RYyMp9pDkEHWXtJ0MX9iRLj5HWE0iold8V/tv/pbycy=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=ksMI1WEPnFSppDZUYN80AoulFd5mF+B9Yw21Y5k1aAQHGJiIEOxxJ80LhoZWg70mR/UhGl1AGuNfKofhWDxPvBwhW/n2yD0ChM5H/FaJGuDNNyzOPu3+Gnb4hIAZribVEKGhZXU1Q0cyqQuteibgS3kDGMYpisAdmBBUEmbXZ3lRnPYoJrrQzDjbshuvDDN7VJ69dtrF15PKGkvft45K31rE2PS0+bzJHzcgYeUOr3kRCfpbmZEjFRL/soubcN1mUG+/O4CfbuXXovVr0Y0dPCx7Bqr22nyFVfLG2z3/urWuYelZP1gB3YNVqB6/gG3Ze50lZyVxm3lIHsmceaIhNA== X-YMail-OSG: QA7U7BYVM1ncM5Sh5P4Azzxd1vlHvijGb4FTUDNdgIDSlcBvFEvh1ZwhhjViLGy 6ARg5oQV3LhKkV_iTbQLeGPDsuaQ5RXzhWiUI5T_WgCd4c_mkYmCVZAfQq94ea4VETuFNJ9C6rLF ExbgGFD0T8VFLIDB9DtWAm4aqNbEDCWmG3ivC5UFwhdNNNdQ3hSxweQAvfmcqZXbEp1uy3fPQG9z x5R2MazAGtcgYBqcRtPaAqdBfkSZmiDT1ZmjJdM27NcixgO8KLjlfiQ4QT3BG0EFA5cXi6XinA_e btzTh0aNsf3O4DXQSeuNAowjC2hpAgAOggRqCcO_HvyWKYpD6hcwppmWcoHG7xlJpCVj7.VR.TEP 7oI3L0qdrVo9bgZPPzQr6Q4SZCSAyl.1VglS20XaYfw62Be6M6mOCHpZkdz2.MtgbZ4.0LokShHM F4tsO.48BzwldAiK6xS4EKYCfO4hWkxAxK3MJoRrdrbi81zmdO4Vh4ZRkBjvL4Gy.fBr_iOcz_Ul Ps4xRkqkTZDcGADXr2NCMiVe.GFHr6TZzSd4PrQcpU_m9ZsPyLecQd4gxUQBY7tdh4f8_tvFrSrN MnCIMKSF2eHP7EuarpFV4s6OrNGHgE1XNeOAYcXRGgU0DYBptgzuX5Y.rEwtswcgE7aq9auZkdxz PvTf7RBFo.kyXI233NSjfgXCX8y0dxcjpGMJBSkxQ.M3et3Kh.9xz3LixG8d6hyp12J19AeGR9EB l0V.lZz2eIc_0gwlDObGbS5Y8fy71ZW.1sdqonQ7gOPzZx4VpcV.mM0FqAsZwh_hKEdYnfeaq9dt gshbyjXumnPX16O25a1nR7rS02iVIS1Ayu8Ia3yRqV_MmcuhK8ZFeOhSZQ63tPDIgDUdm9MOg0n9 W3YqYmj_PK0reNA.y76RoLKGjbrHkAS9PsztjJJyzexwqqlqt1_zsvXtIazey9CNsj_A0Mm9pz6r 97hy9yTMqxUPtEZCW_VuY2MYktmckT1Bbw3po.IIB3bcYT49lJLeGeBtfQNEtXFyTqnYj0koZbfQ EYxAS45CqRXCRg0NS7RWojlj78maXzZS9.NbbgKt8WvzonXYamUWjEAhpSp4JUwKvW27WDkfAjyV EDuskzGsaJwuqngek32XX6jDs9OCwHMPmkUEESuP8BETFt37MrN76KNrlzVEcTEwkQ5mWTSohiIm VnjmfHdNqlRuNzH3rLOCr2r.T4BMbF8n8kts_Jhgs1XQLQEE7uXHulfPrMVADT8EcvB_At4mTJD0 QqCqJ7PO7eWGC9cEEwHeQr0aXWLqxE2sJyJWx7wIZ7d1bJG4tYOgAqIInaamA2YLRkXRnTGglTbG FS7m23jFsQkvwKMnqvRXmGvutPHopq9lkPo_fLpyRmWINQe6ilnwCjl6B31wNbc8QKh8u3ewmlOW 1zi6EVLsu_T0TH6qrDQxWIuOrnrKFJ.743qGm.FUQBXyyHuz67Mc2jAl6iYjd2.76iomAle5fI9o rIJeOPOd90YJJeuqn6s.AB86ryFTp_9W_NSBRmsXGJfaYgIVbSZ7t_7xZQr3W36MpzAkTLLyAVA2 PcZNFD600hSveu.46iw.KIVuqS1dK1Ji6N7e2damED1gTa2jQObw2krbxPC068U95sqfFHlzTbRp POvxUyfQ_EUvUu2wNqdcgPdy1NED9yCVYNEoy2synHgAaHhykaT7G_VkicqTlAIXrNH8ylUNFD.I OPbY0Iy2Wa9_7DIUZUz0YCkHPkq9jjP5eNZFoZwphhEuQQ174nzgETQh9OTmj8qK.c8rvGJZ4YMD NL0odj0sf_snO7fJIznj03FtuUBnrXY1GqCMwE.PrAyZ9OSrDsZyrCfVuSDZOAqJjrGttuAykLNC 0GTKfNys88tiCXbVSzhdyPM7xq64r27HB3KqLZfNScyw0gzPr.edfl2c_T8fKhZUwWa0.oJkhRiC Lvj.WNVe_uIOh_nsiwb.OOinijHydCelA2rt0MXqmQze8CXgwgi1cwrUcR.b9Nx39c8lMEk_YWsO EwMqJJ4Z5QjzevRVgJVH.oRU39La6uLlT_XvzBvkvAuv5dUPM1eEM3WoM1SxnwFJpzQZ6ayFzhDr BUeKXD1cE95nkmeD5AL1G2NcSVkkqngMRlEOW.Fcm1SdCmE1TroGE8qi4E1SzDkZSqLLadeAhy.e 4lfMMb2Y3ARYPSiGbTp2N38lvjt_B4ZI4_3KJVRrF5raIOUL1rIOAolDOaXnTdyPBg2Dw4J.AmpC TWTEXOD0xP2Varfzs5Tclnc88mfl125b805gRAr2QYnQHNAwKgPjF4kysszNY5v8.UmvuvH511DS deXMM3Kdv8G0tDj.NSmF57LJVsNZsZDRZkdA2VjtBWEeaqByzrnGTL8ajYaoEaVSlicYmqI0- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic304.consmr.mail.gq1.yahoo.com with HTTP; Sun, 19 Sep 2021 09:12:23 +0000 Received: by kubenode517.mail-prod1.omega.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 28a1f03472fe233726af8a971b475b2f; Sun, 19 Sep 2021 09:12:19 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Maintenance of FreeBSD s integrated toolchain List-Archive: https://lists.freebsd.org/archives/freebsd-toolchain List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-toolchain@freebsd.org X-BeenThere: freebsd-toolchain@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: armv7 target (on aarch64 HW) and poudriere-based emulators/mame link failure vs. success based on the number of cores Message-Id: <64B80EEA-DECC-4286-AC80-5BE55B7F19D4@yahoo.com> Date: Sun, 19 Sep 2021 02:12:17 -0700 To: FreeBSD Toolchain , Free BSD , freebsd-ports@freebsd.org X-Mailer: Apple Mail (2.3654.120.0.1.13) References: <64B80EEA-DECC-4286-AC80-5BE55B7F19D4.ref@yahoo.com> X-Rspamd-Queue-Id: 4HC25V2YLvz3Fpc X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=XfB4CELA; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.68.204 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.50 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.204:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.204:from] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-toolchain X-Original-From: Mark Millard X-ThisMailContainsUnwantedMimeParts: N On a HoneyComb (16 cores) I did a bulk -a targetting armv7 that had emulators/mame fail as unable to allocate during a link. Linking by default use slightly more threads than the freebsd cpu count. The HoneyComb had 64 GiByte of RAM and over 120000 MiByte of swap partitioning set up. The swap was never used during the bulk -a examples. On a MACCHIATObin Double Shot (4 cores) with nearly identical media booted, attempting to build emulators/mame worked fine. (I did not try a bulk -a: it would take far too long for my time preferences.) (I've also gotten a report of success building on a RPi4B, also 4 cores.) The HoneyComb failure looks to me like like hitting the process size limitations for armv7, something that did not happen on the MACCHIATObin Double Shot or RPi4B (fewer cores). It looks to me like 32-bit architectures (such as armv7) should possibly have the multi-threaded link disabled by default for FreeBSD unless ports are adjusted to disable multi-threaded individually. (I do not claim that mame is the only example of such an issue in the bulk -a --or on systems with even more cores. It just happens to be an example that I noticed.) For reference: # uname -apKU FreeBSD CA72_4c8G_ZFS 14.0-CURRENT FreeBSD 14.0-CURRENT #12 = main-n249019-0637070b5bca-dirty: Tue Aug 31 02:24:20 PDT 2021 = root@CA72_16Gp_ZFS:/usr/obj/BUILDs/main-CA72-nodbg-clang/usr/main-src/arm6= 4.aarch64/sys/GENERIC-NODBG-CA72 arm64 aarch64 1400032 1400032 # cd /usr/ports/ # ~/fbsd-based-on-what-commit.sh=20 branch: main merge-base: b0c4eaac2a3aa9bc422c21b9d398e4dbfea18736 merge-base: CommitDate: 2021-09-07 21:55:24 +0000 b0c4eaac2a3a (HEAD -> main, freebsd/main, freebsd/HEAD) = security/suricata: Add patch for upstream locking fix n557269 (--first-parent --count for merge-base) BUT: a rust 1.55 was in use on the HoneyComb as a test for another issue, at least fore the second bulk -a run that then tried to see what would no longer fail when targeting armv7. (Note: The HoneyComb is busy doing a bulk -a targeting aarch64 now.) Side notes . . . I'll note that the HoneyComb can do a from-scratch bulk -a targeting armv7 in less time than the official FreeBSD servers do (via amd64). A specific exxample was a bulk -a completed in somewhat under 87.25 hours, building 26995 ports successfully. (Not that I configure and operate in a configuration matching official FreeBSD serves. I allow a huge load average: 16 builds with ALLOW_MAKE_JOBS defined and have a large swap partitioning for a 64 GiByte machine (for in case of an unfortunately combination of overlapping huge builds). Mostly this is likely due to having the lang/gcc* (and such) build via a full bootstrap on amd64 targeting armv7. The native-toochain cross-build use does not help after the first part of such a build. Note: I do not normally do bulk -a or build rust or build mame. The activity is experimental and a test of the HoneyComb. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)