From nobody Sun Mar 27 01:43:44 2022 X-Original-To: toolchain@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id DAFC61A4A888 for ; Sun, 27 Mar 2022 01:43:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KQzBT4qnSz3DKT for ; Sun, 27 Mar 2022 01:43:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 8725942F7 for ; Sun, 27 Mar 2022 01:43:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 22R1hjnx046181 for ; Sun, 27 Mar 2022 01:43:45 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 22R1hjAr046180 for toolchain@FreeBSD.org; Sun, 27 Mar 2022 01:43:45 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: toolchain@FreeBSD.org Subject: [Bug 261977] lang/gcc12-devel: enable LTO Date: Sun, 27 Mar 2022 01:43:44 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: marklmi26-fbsd@yahoo.com X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: pkubaj@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Maintenance of FreeBSD s integrated toolchain List-Archive: https://lists.freebsd.org/archives/freebsd-toolchain List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-toolchain@freebsd.org X-BeenThere: freebsd-toolchain@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1648345425; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ld0qk+tWHTgAWQUwbuWpDsRAZ2GAyx2PxvEkoed48GY=; b=MaaenReeciVwJpP9ln4QRuiEuLsB5nGDkGx8rXYn70mtXppVDttL4c9FXET+JNTep0g3jv RQnAjdOZNTZBuAR6gyMhYdQ5RIg5z0f22NEsfvnkRFqoTBcl4TMvCgj2dftgohLTTxgkDu IaxLx/EnRcq2nzQgiAAjuLA96fp+XUOMoIu7XvOEXabZYlgbwUkQctUo9Lp0Zzv4KEHuNC Nz0nIpBi5jfQ1ciYs3ghInihmhN4N4eeubfjvyhw/bKqv73/Smsa3O9d4MzOqLPanHcwNZ 8T+zGqGROuHRxXMVpK/WD4c3Vi1dQ4WNwUyNt/n/z36saIIJ5cFg6ai6XvVbXg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1648345425; a=rsa-sha256; cv=none; b=tlICwASu4XGZyBB1qH5YvS6SzJobNdk4KcO+2/XOyBDrcQrup+FlIZGjtY8QqDsNJhY/pu i+Fp1I7b6zpbhe1WVEJDVi+g+QM9I6oMO2So0cRcS5pScsTAWd7Go+K8p4QKNzQI886e1e Ce4EWDrIEazgWIYkM3WrtoKHZ5r2NDnljHSp5Nkw/jiPSGLCSQc57kpgj7EpQ4WJ4fLMcc BGAmLi22TVtGUbwhndjO0pWnhH4aCsQwndoyh1eviFiWfJEH6xz/ih61iPJ44hLQVsqrdZ 7KOu5EWIOXfJSevvXPc0oAxnakrWc8Lb9o+gnKbfNWsQtJWRYaGslQYKUKmc+Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261977 Mark Millard changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |marklmi26-fbsd@yahoo.com --- Comment #6 from Mark Millard --- (In reply to commit-hook from comments #3 and #5) These changes have caused large increases in my build times and resource us= age build building gcc* 's --without providing an OPTION to control the behavio= r. For example, I built lang/gcc12-devel on a 16 Cortex-A72 HoneyComb with 64 GiByes of RAM. This was the only builder active and the machine was otherwi= se unloaded. It was allowed use of all 16 cores. It took 4 hours to build and at one point got: 12278Mi MaxObs(Act+Lndry+SwapUsed). [But no swap usage was ever reported, so: Act+Lndry.] At least twice there were 7 /usr/local/bin/ld processes doing lto1 activity at the same time over long periods. The large Act+Lndry was from one of these times. (I have a patched version of top that monitors and reports various "Maximum Observed" figures.) I'll note that my prior build of devel/llvm14 (.r4) by otself via the HoneyComb [also unloaded] took under 1hr 40 min. But, in that case, I had used: # more /usr/local/etc/poudriere.d/options/devel_llvm14/options=20 # This file is auto-generated by 'make config'. # Options for llvm14-14.0.0.r2 _OPTIONS_READ=3Dllvm14-14.0.0.r2 _FILE_COMPLETE_OPTIONS_LIST=3DBE_AMDGPU BE_WASM CLANG DOCS EXTRAS FLANG LIT= LLD LLDB MLIR OPENMP PYCLANG BE_FREEBSD BE_NATIVE BE_STANDARD OPTIONS_FILE_SET+=3DBE_AMDGPU OPTIONS_FILE_UNSET+=3DBE_WASM OPTIONS_FILE_SET+=3DCLANG OPTIONS_FILE_SET+=3DDOCS OPTIONS_FILE_SET+=3DEXTRAS OPTIONS_FILE_UNSET+=3DFLANG OPTIONS_FILE_SET+=3DLIT OPTIONS_FILE_SET+=3DLLD OPTIONS_FILE_SET+=3DLLDB OPTIONS_FILE_SET+=3DMLIR OPTIONS_FILE_SET+=3DOPENMP OPTIONS_FILE_UNSET+=3DPYCLANG OPTIONS_FILE_UNSET+=3DBE_FREEBSD OPTIONS_FILE_SET+=3DBE_NATIVE OPTIONS_FILE_UNSET+=3DBE_STANDARD So one could argue with how to make such a comparison. I looked around that the package status information from various builds and sometimes lang/gcc12-devel gets runaway_process and other times completes. My guess for the official build servers is that it depends on what other builders are doing over the same time frame. But there is another, possibly related issue. In my 16-core context, top reported: last pid: . . .; load averages: . . . MaxObs: 28.02, 17.04, 16.87 So, on the timescale of the first load average, the lang/gcc12-devel build does not always stay limited to the hardware threads available. (I happen to have my configuration set up for high load average contexts.) Overall, the implications of the LTO based builds for those with systems with signficantly less resources are messy for them. I understand having default options that match what the FreeBSD build servers are supposed to build. But not having control of such things without editing of the Makefiles seems odd for the general audience that does local builds. (I can maintain adjusted Makefiles so I am not stopped from reverting the code for my own activities. But still . . .) --=20 You are receiving this mail because: You are on the CC list for the bug.=