From nobody Sat Mar 26 21:37:02 2022 X-Original-To: toolchain@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D7FFB1A4EE63 for ; Sat, 26 Mar 2022 21:37:14 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic314-20.consmr.mail.gq1.yahoo.com (sonic314-20.consmr.mail.gq1.yahoo.com [98.137.69.83]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KQsk12n9Mz3q2M for ; Sat, 26 Mar 2022 21:37:13 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1648330625; bh=6YZpULUItItcCb+zX/JgSNmrIJmE+Ukmgq5Bnx5UM5M=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=GPr04/OpM1R9Co8VvTeb9XYWnn41g2LZZEsN8cFX6SlXl9epLVwb6hgTM71lZ9V9ANxo5ziPVHKGlVjERSy2JXQqopp52MuVp05I1CljZaJroknW3vO0uER2RBkJBTHxNb1VbdK6kHCGiZZ4eXZTzloCnfnyO+752sKBjK41Kzz+AggdDb/PGEolIn7ZFbiDp7b4XtBz88ZSFHTIU3EbtDdfOEZZeYkb7xkDRp5yx55qIar/o75b+rk3G9bbrC9OzFrYIsBvMD/0djVI6TTAKL4NlvobR2DadrQcO1hClg19wz3M8hbnoYY8lXlGRA+bJSh2LTx53xNrYXyP8Q7jOw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1648330625; bh=U/qxwJj7K4GxftMzuACTL7rcpWuJqkFtAiSCZKDDqkd=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=gpuQsO70u9EutX2A+pj1MhU6GUExsSAdC6ImqDeSk2o0dAqtnNVQhIBh61Xh0LvcofBVo8seZdV9x/uFaFDni3+FJR+uQahH9vALQqJYx+ZxxqPNWmoD37T9XZAsseBcwIXBPTpEbE7qB42E+gvvUCZUiEV7NVaMrpR8q8eWlQiRz+3gvrmWwXMKTAM9RZClHgs574aLnbF7+rhVgV3FSVuAZDn13JehpcDvVH7rO1yu16PAmggr9IHLXzMFoU0SmstoMQD6l8v600DenF73YvInUshpp5AOEZYPdN9l/0PaeYD6YWXelDVxxDkIxtAOLjMNlU5IEJAzrVenkjiVCw== X-YMail-OSG: gEwW4YsVM1mbBwpb6FKioFQy.VSamRKoA7z3Vm0zUUP5mF_aI_i_RlVonmvnnyr iVwWWHYjxtMwebwuwfs8_qYOzwKCrwOGWcyFkarhOJ2U.aU7Lgph0kOt01f1xbqG0v1GGJ2MSHQl R5qL3XpcM.FwpnIlR.oShjCl8vJAAk3LTga1zkUlwGIg3P_.5hSs634PtJiedQS661e.JrjMnKLM KZ7HM80dfWv1nTT0ZQSUaJS_dmjuy9OGor1bspJXs93bX4tvhj4geQo5QeGYUdm41wmjqdPJYJtZ ZOm63fNqx6WZbc1WAIz_aW1GCYV58_zoPx5GxQRM7jq2M5GkSiGeZHvUEXL_k8k5CXdUFIyeuF_d kcyLNZXqXYYfhvnK3pgC8TKVNTBSTYH_B6n2DrwlZXQ7Ut2quJi43YvWI.tHhTwCpqREV0d4l5OE _pg6U2nOSDrMi2lWTJuSQzGfOrFlWFEkpbsvAhK5aRC7mEYb3v2o068tPhkhHCwh85cDTnTYXXwU e64ZEptqDFX49vdz43_cJTpAe42tvPHLJK7HsW6mznibHKEQmAPZTP1qo0FgtMJUVXyNvOFNbfef yydVAl2UZE2CGlbLDIJnx0_PSQF3JKrZEetCgE9y6v7t7T4Jxfqhsyh6WE_GpEjT9gXqgfoAGR39 g7ksfgHxNZmHqOjqHVaVLjFa1XcDYtUMp4mEdfZYsA6ZW4Jx0d7o1qtfOT7tEbOoMuyJufJEHzIt 9IhGLClnKlrCBWfb.8JLwAiU_Bufk8b5aVwh1fN9kBT3K3K0fhwSjq.mnins_SR9c2O1RH4i3y0I RvMlRkwzEz1uh1xgIrRFNFWGttZkwKYSw31KaeyHQ.7c73Zd7lc9J23aCrq6eSG8MmOJLwKPeGjL bpndqDNSKho4qsa4NB1N8SXuCmqr.9InbqP8egkUAXKXRHBE0aCXy_1W1xuQrbrXxxqvrlkp0eYh wsmCgMcszX9F.m25GVGYAJVUraTWi6sfN2YPUIuD55ZFXny.iTkYrMDyMrMaN_sl1DYBhs7LAnUe SNNqCaJu6u7L0ENfXnTachO_HRfD64GEXBJQrFAJ8_DbPAVlwmH.2Wfs31FPsJH8pzM5_MASqUJR axsiuHLGs2DF3hlKJ0yrRkSUZwkjnajeCdatbiExuDSc_1NixMNM11HWvajuMmcZLq_JQtHeQtaj 41t6YkLnlnyuDDyibK56vd6Bl2N.JRS9pJsRZIbBdn22nVTZzC02lIuhNk525OLeOqI_jAjhkgVJ w4eLuRX0ihSD.2ohJwR8Ldh9giPonXpbhRwBfjlkhJHD5IOaXDpO_8p9vhYT7PmwpJB8aru9uJ2F k97ZYgn.O3SMxtK58STXfEQVQAvroJv3VMoYwU7.7eddABwd5ltBlq3II80Uxr5vb5pk8lHDKaF_ BIwQ6kBtOnJu8e9xxjXTk9NnLHNsMF09HdXHql3ixS8pgZWDQPlEjyQgbmLqfKSZeA2Yw1TA1jXH LxGQryR20H3d_URjbcJU12ScjGRJMV8GCzidWuICUC5hrA66xeq9ByVHZl6DjcVQZN50jnCIkt0N rj5tsNGIyiwvQrzC7sLKRmemEYw9vrG7AW8UyU45KXB1ZLBC0pmF1WdG6ccK4dOk84lEmmHsBH3Q j6vzs7AECBWKhfvbuh_rD.4vk32vgnCpc0Pq3E2v0QBktu12SAe.eoD4k_htpyTkoe1YXicxRlIa .nRDfDOhhOFPNdjRHxWq4v_ECKl4XmIe4deji3fHKXOIle8ENPJQQcRjsiMy.b7YZw7XRaBMGZnB ZY5gOiScq_8BYTDg2d0UGK1K1hNXI89k6_9DlH7XVZYv7zkUCBi.oFdTINDdc96ETfgReO70nkRi OOVLqtcCgC5MjfiJWifFblJriYWtv8cbzR_lePIijc6Samwgw87t8r3ZLvY3xfbL6vR9u1qy5mom fUKUfkGCtYfArbpZy6ordndPZsShMsGNSMqjXarfWvRzd41q6jQTuNNM5fYDP5gl3zUILjAXXdq. 6mU1FsXBZEdptG0cwcK7d_UlV.nMn3GbFxCMQH66Og5ozbl8P6goEgJyc94LfpczMadAXWtZomN9 hcpUkZQ02xWpYe9MUmfXGSHpSRBATGEJdCxa.2Ys0LK5hV0hoLyo69Tjtl._ln5nvHKrkwwdHILV f9Wdk90fgKLNBAFCIxF2y.8XdpZBCCxx5KfbTHBU_fDNwXm.9BejY1abiwQ5l55LoZ6DMHryv8hY oAchOu9NDUFGDI0sldeeWREQ__O31b5BFMS45ER58ZaeC.7fMS4J3p_4O.UOO62.yKRPDo7ui6yn eU5pIDFN2BIuWB.qXUI.0DiTa8jsAv8vetCNuXxprJAa44YcTtri13rIEWE.J9c99jhSnTqw475P Fn_vF19gwjabiQI6ZuLxCozzw_T1zUe.c11Tj6YAXTmSna_qdtozZuHY- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic314.consmr.mail.gq1.yahoo.com with HTTP; Sat, 26 Mar 2022 21:37:05 +0000 Received: by kubenode510.mail-prod1.omega.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 6d3261a493b93869f0130c1be422fb11; Sat, 26 Mar 2022 21:37:04 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Maintenance of FreeBSD s integrated toolchain List-Archive: https://lists.freebsd.org/archives/freebsd-toolchain List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-toolchain@freebsd.org X-BeenThere: freebsd-toolchain@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: Re: [package - 130arm64-default][lang/gcc12-devel] Failed for gcc12-devel-12.0.1.s20220306_2 in build/runaway From: Mark Millard In-Reply-To: <75A61EB5-70D1-4E1F-89D2-524407854D6F@yahoo.com> Date: Sat, 26 Mar 2022 14:37:02 -0700 Cc: "toolchain@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: References: <202203261416.22QEGtRR065106@ampere3.nyi.freebsd.org> <21D1C2BF-151E-4252-936C-B5B22C9C8071@yahoo.com> <75A61EB5-70D1-4E1F-89D2-524407854D6F@yahoo.com> To: Dimitry Andric X-Mailer: Apple Mail (2.3654.120.0.1.13) X-Rspamd-Queue-Id: 4KQsk12n9Mz3q2M X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b="GPr04/Op"; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.83 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-2.87 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-0.95)[-0.952]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.42)[-0.416]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.83:from]; MLMMJ_DEST(0.00)[toolchain]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.83:from]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On 2022-Mar-26, at 13:16, Mark Millard wrote: > On 2022-Mar-26, at 12:35, Mark Millard wrote: >=20 >> On 2022-Mar-26, at 07:26, Dimitry Andric wrote: >>=20 >>> On 26 Mar 2022, at 15:16, pkg-fallout@freebsd.org = wrote: >>>>=20 >>>> You are receiving this mail as a port that you maintain >>>> is failing to build on the FreeBSD package build server. >>>> Please investigate the failure and submit a PR to fix >>>> build. >>>>=20 >>>> Maintainer: toolchain@FreeBSD.org >>>> Log URL: = http://ampere3.nyi.freebsd.org/data/130arm64-default/60ab72786154/logs/gcc= 12-devel-12.0.1.s20220306_2.log >>>> Build URL: = http://ampere3.nyi.freebsd.org/build.html?mastername=3D130arm64-default&bu= ild=3D60ab72786154 >>>=20 >>> So there isn't any actual error message in this log, except at the = end: >>>=20 >>> ... >>> =3D>> Cleaning up wrkdir >>> =3D=3D=3D> Cleaning for gcc12-devel-12.0.1.s20220306_2 >>> Killed >>> build of lang/gcc12-devel | gcc12-devel-12.0.1.s20220306_2 ended at = Sat Mar 26 14:16:58 UTC 2022 >>> build time: 12:31:35 >>> !!! build failure encountered !!! >>>=20 >>> It looks like the last command being run before "Killed" is the = cc1plus >>> executable being linked with LTO, so I am assuming the build is = killed >>> due to an out-of-memory condition? >>>=20 >>> But this is only visible to people that have access to the machine = the >>> poudriere instance is running on. Can somebody with access please = check? >>>=20 >>=20 >> I do not have access but I've started a poudriere build >> of my own on a HoneyComb. I've a patched top that monitors >> and reports various Maximum Observed (MaxObs????) figures, >> 64 GiBytes of RAM and slightly over 246 GiBytes of swap. >> So hopefully it will report on about how big the memory use >> gets. But it is allowed to use all 16 cores and there will >> be no competing bulk builds using resources. So not a match >> to the build server context. >>=20 >> Note: It is a ZFS context, so MaxObsWired is normally large >> and shrinks over times where memory needs to be used for >> other things. So the primary memory figures would be: >>=20 >> MaxObsSwapUsed (if any) >> MaxObsActive >> MaxObs(Act+Lndry+SwapUsed) >>=20 >>=20 >> Side Note: >>=20 >> = http://ampere3.nyi.freebsd.org/build.html?mastername=3D130arm64-default&bu= ild=3D60ab72786154 >>=20 >> reports a Time of 11:48:41 but the log reports "build time: = 12:31:35". >> My guess is that processing the log file for extracting the type of >> error makes some (much?) of the difference. (Type being = runaway_process >> in this case.) >>=20 >>=20 >=20 > I did just observe a cc1plus take somewhat over 30min > of CPU time before completing and the lto1 related activity > starting. It was under 5 GiBytes MaxObs(Act+Lndry+SwapUsed) > [No swap use observed] before the lto1 related activity > started. >=20 > For the lto1 related activity MaxObs(Act+Lndry+SwapUsed) > has, so far, gotten up to around 12 GiBytes, still > no swap use observed: >=20 > 12079Mi MaxObsActive > 12278Mi MaxObs(Act+Lndry+SwapUsed) >=20 > I'll note that: >=20 > last pid: . . .; load averages: . . . MaxObs: 28.02, 16.88, 15.82 > . . . threads: . . . running, . . . sleeping, 77 MaxObsRunning >=20 > So, on the timescale of the first load average, it does > not always stay limited to the hardware threads available. >=20 > No process with sustained CPU activity sticks around across > the lto1 activity. So I'll not be able to observe much about > cpu time. >=20 > The elasped time doing lto1 activity has been going for a > while but I'm unlikely to be able to observe its end happen. > So I'll likely not have a good clue about that. >=20 Looks it spent about 1.5 or so hours on the particular block of lto1 related activity. For reference, somewhat after that: last pid: . . .; load averages: . . . MaxObs: 28.02, 17.04, 16.87 The 16 core are Cortex-A72's. The following did not change (so far): 12079Mi MaxObsActive 12278Mi MaxObs(Act+Lndry+SwapUsed) Still no observed swap use reported.=20 The build is continuing. The build phase has been a little over 2.5 hr so far. =3D=3D=3D Mark Millard marklmi at yahoo.com