From nobody Tue Sep 07 22:28:56 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 74B7217A59C1 for ; Tue, 7 Sep 2021 22:29:12 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic304-25.consmr.mail.gq1.yahoo.com (sonic304-25.consmr.mail.gq1.yahoo.com [98.137.68.206]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4H40LH2cpRz3DSh for ; Tue, 7 Sep 2021 22:29:11 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1631053744; bh=pewqeb1039HC/ZgcQXBOUGwS/p6de9mHmbAlwJwjraM=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=P6obVC2SVawTjefRqa1C314pjqZWteA48dZ++cIAUTrgizn2la5xU6nUqolxXNMEz6CDWbH/zIywrqLEfYdRwNyj8lYUgP85KODPqSTCwSVUJfILFOreoUnEVkyrr1GI2n28aHEhWRFTteszKQLdmqNyJNWGNQANxYUorzME8EQ/H9yZioDwwNU0zAF8ofxWTgP/EgPEJ4L0I6nc/X4DBzxsEI4ave27WXWJNKeuReN4ZoQCLSmXg8ar8OeKGdlQlTBcnHej6/N5FmfHWYqd1eVC8MHkgzXbngprqE1GetNkOPltED4GEkN02UR4LfhkKbwjDaaZTlbmbzVSwL1UVw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1631053744; bh=gXXgoQVqh6XRNuOuGPInWUaOQ1bgTmj7ENngv9vAR14=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=XAoG074OOCqGPrkhBLvXEbsd8FvTOP1ZqmdsNGAwxK9PQIcV+PYeCxAUQONpDKzwdYEcyXkUSx/lEKvugb30KjJNn7DjkiIwNuKPfrMaYVisvpdPuw/h0cL4rVJbC/F9t4OpOHnzgovSL02gyMfu9IatU0ETVSNQbGtOGoagP8jeqlGseKRZ19KMGsz3wLrQli2i4TJaB2CoLcuM6rHvtovbIB9ptz+73qWQdREmmg+nv734IvMn6u1IZ6HCyaFnaOfbsv8j0D44uiMwTF9p3KQ+NYPiXzIb5ltt/dvoPn+s+caAgzrdSb66/8ebz+189SVqNx/4jP8FWxdv6fTYWw== X-YMail-OSG: Cmg3EwQVM1lghM40EYd4IenrSwtRcbsL_vsTbZ.NIyKvRPUDF36tEuhP9UkYV1z cZXb8AsLZi.NFITXlQIq0Z9F0Bm_m8jmAcghFVradrCYDERt_gBgz76lrGbzkcn6gPVfcgmR5JYv KheiYEYZFBL6yPBi63n3mLgPzlrzdid_wcSm5I42puID2l3lJ7UpSDI3an.0uFyi.ShZi7RSaV_g eASH8k8En_Tt..aDp9db.ZreCVdS3.PDdfxgcxxtmo4Pjdt2mtwU.A7.AJmztSWV2ATfWp.IE0VC orfEXlzotSZdpa2Kns75XLtFxCduGtRmVrK6UJ4eneCowpoKd3AZ2HjJudhncbodVQWbprHvk1Jq L3A3LrGRea7IyRKWekTQnwI1VxQwmNAF22i3zB43p8aQ946eD.RoMmB0Gj7lg_BHjZOT55uaV512 VBCwuqJYQydKLM6ekYA7dPCbFl7L89afEEo5De0q7xMVoNRiBpCBPo0Gyu1qTq9VKTcM2KFUp7I2 n4YCDJtvA7KkRQQIvmVjMPhlY5hOrV2uCzCT1PsKpBu20j5aNjONikAU4GwTXgLRKBAa2UPbmHfb _kekQYRM.g3rAcOZtowkX9mD1TxNbPXGTpU5KwIlanvr7sMNFaoagk4zEKzYMxiHIaS0KvUARL6L 8F.Fs8CK3EhR.flkHv_HWI5_Fuv1W8_H8IEshuqxY78gQi2C2jdZOm_W4k0ndlxAj10tRHdUdIbF FPYcxUz1SjukCljXuBJIFV47jUDPFRT5b25hTPIEb14YbfOzEzQlIavn5fwOKZ8vmNUH37IuVsQy NUCtgHNa9g2H3eamOrfeDZ77TKr3kqqgrvgJamK7JrGq6SX5hz3K5j2ZfT4qUQglBX7UDVxVmgDj vd5cPbC4pJ_V4dFAlaEPiUKPwHzEU.2jZx4q8G6TaZD6HvZ0zikoyO7_Rov5MRfgWUZAyLvHhXTs CBnqW5YpfKWorvVKE1QAIM61GUDEipx8U_DJDtA_hh3rOikz_fepp5ujfOWyKf5fNnqb9QWs2sc1 zxJ9JLGPvhDwxAF7CmF4KJbN4dKvfbMUzBHNM.thq0_Oy5dQrpt6jMAwxj2OwH5VwU6qFQBCHIlD Tj003EYieRc3wrIhbgeAdCnbiDZM3E0xtDFqkCWuF5lrxv9_.Su8HG9weGt.4DT_HPO.DSE4c6RO 8JyDYvt8mlJqwb8hSr7laIqzc8rNiH.7SDzuA1mok3FWJurDqRwD8QXhFYIVCuiwpJD2FnTxQ9nn pFic_Dt9E5Vmtn94DfEdyVowng0ouMkYh8yRUakx.F2OincIe5eQA2ZF2BzBNe_lOiyMzivgZYqh DU3rOj2NKwJRHSinI521QDv3WrwsULUOmPqZxtKvcYFSt7P9xZVgXO5I1gi0HmYUWsgMdkFPimKi 7fc1IDEeuEXrL7XmyJjIiLAevoIbZGf9v9MnfE24PVP9ljyhv4btOh58ohmHAgAuI4A1JKDaPtwv u3JYKoc78lYvnnbdnyDFNWlv5mg8MB9bYzTlaDCs8aSCmSxDzkRRoeGXkD_kvQHzuEmgwsg7409q MDrPDVCO01cEUl4OXOZoKskH7Tk7k9FirTeoaooTzSfKNexgi.dgIruwOI1OueYHqGCsf3dmEWs1 ZRiIcv5TeVrcsMAIthS9C7PsuI0EK7iWrYc3TF9zihgVekMqgk5XV53.dlX.bvs6Fjsg4_DmlxH_ BDfkXCPf29ENKLBm02NAVLgqccvLQcuMn6YBmV8V2xNY5Djy8c0mjUK8ZuSSaS1vK03JueFoakQU nQFSXLJ1dkh5Yi8rlCHrp2CSPkd2eX.QCVF481rxgsNpBNEi2A.VSSCpo634hcno962e0RqIBpNi imHCW4oWP6.hvG.wBCocTY_fxJ3Oa8bDhfe4XFlZlUsAOdQlUJzjQUzHHYeRKLiyN5WnY3P24r7d 0qClyn.HAwfmXViv.KcJO8Pw.KOYBE.ARfpC0441cP0_0jDKeXH3RCBgMJKFv5FrLHhffTZJEkcl BmZgKrcYuRr968wRFl1VbNuYUUeElDEg61XZzkL5gq9aL.5_f0BOtFi_XiC7Wt0KI0qIqvWu5GHm TRPnrSJus9DFU.IqfJK92_8k0tJw2cmon6Vrly8D.BJFxkScZxdeTIY4iKGnn_Dt2egiE.MQ.SzE vILfbEZ_.UnLvofYwXpcDrhOiA7gVQHYTGSL0cQuKKYe5ki5a6i58gY39btVKnvLNUrpyHDt9Bor LHXoXp.UbMNzqVDAtB64xk_6z83hgyXFyxYhlnU137IzwsqY2dGkS7nKYe_s8K9YZhrCIYol2DET zDBLY5W1SDoOY X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic304.consmr.mail.gq1.yahoo.com with HTTP; Tue, 7 Sep 2021 22:29:04 +0000 Received: by kubenode524.mail-prod1.omega.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID b1c895aa9a30f9d2b5cddaa07d4a2616; Tue, 07 Sep 2021 22:28:58 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: Re: -CURRENT compilation time Message-Id: Date: Tue, 7 Sep 2021 15:28:56 -0700 To: David Chisnall , freebsd-current X-Mailer: Apple Mail (2.3654.120.0.1.13) References: X-Rspamd-Queue-Id: 4H40LH2cpRz3DSh X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=P6obVC2S; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.68.206 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.50 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.206:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.206:from] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-current X-Original-From: Mark Millard X-ThisMailContainsUnwantedMimeParts: N > From: David Chisnall =20 > Date: Tue, 7 Sep 2021 14:51:21 +0100 > On 06/09/2021 20:34, Wolfram Schneider wrote: > > With the option WITHOUT_TOOLCHAIN=3Dyes the world build time is 2.5 > > times faster (real or user+sys), down from 48 min to 19.5 min real > > time. >=20 > Note that building LLVM with the upstream CMake + Ninja build system = is=20 > *significantly* faster on a decent multicore machine than the FreeBSD=20= > bmake-based in-tree version. Just examples of llvm12 builds from my checking this . . . poudriere-devel llvm12 buil times, nothing else being built, all prerequisites already built (not that such are trivial): amd64 ThreadRipper 1950X with 128 GiByte of RAM, optane 1.4T media, 32 = FreeBSD cpus: [00:00:07] [01] [00:00:00] Building devel/llvm12 | llvm12-12.0.1_4 [00:22:54] [01] [00:22:47] Finished devel/llvm12 | llvm12-12.0.1_4: = Success for: ---Begin OPTIONS List--- =3D=3D=3D> The following configuration options are available for = llvm12-12.0.1_4: BE_AMDGPU=3Don: AMD GPU backend (required by mesa) CLANG=3Don: Build clang COMPILER_RT=3Don: Sanitizer libraries DOCS=3Don: Build and/or install documentation EXTRAS=3Don: Extra clang tools GOLD=3Don: Build the LLVM Gold plugin for LTO LIT=3Don: Install lit and FileCheck test tools LLD=3Don: Install lld, the LLVM linker LLDB=3Don: Install lldb, the LLVM debugger OPENMP=3Don: Install libomp, the LLVM OpenMP runtime library PYCLANG=3Doff: Install python bindings to libclang =3D=3D=3D=3D> Options available for the single BACKENDS: you have to = select exactly one of them BE_FREEBSD=3Doff: Backends for FreeBSD architectures BE_NATIVE=3Don: Backend(s) for this architecture (X86) BE_STANDARD=3Doff: All non-experimental backends =3D=3D=3D> Use 'make config' to modify these settings ---End OPTIONS List--- Note the BE_NATIVE use. Also poudriere.conf has: ZPOOL=3Dzoptb USE_TMPFS=3Dyes ALLOW_MAKE_JOBS=3Dyes For reference: # uname -apKU FreeBSD amd64_ZFS 13.0-RELEASE-p4 FreeBSD 13.0-RELEASE-p4 #1 = releng/13.0-n244760-940681634ee1-dirty: Mon Aug 30 11:28:31 PDT 2021 = root@amd64_ZFS:/usr/obj/BUILDs/13_0R-amd64-nodbg-clang/usr/13_0R-src/amd64= .amd64/sys/GENERIC-NODBG amd64 amd64 1300139 1300139 The swap/paging space stayed unused. aarch64 Honycomb with 64 GiByte of RAM, optane 480 GiByte media, 16 = FreeBSD cpus: [00:00:15] [01] [00:00:00] Building devel/llvm12 | llvm12-12.0.1_4 [00:58:07] [01] [00:57:52] Finished devel/llvm12 | llvm12-12.0.1_4: = Success for: ---Begin OPTIONS List--- =3D=3D=3D> The following configuration options are available for = llvm12-12.0.1_4: BE_AMDGPU=3Don: AMD GPU backend (required by mesa) CLANG=3Don: Build clang DOCS=3Don: Build and/or install documentation EXTRAS=3Don: Extra clang tools LIT=3Don: Install lit and FileCheck test tools LLD=3Don: Install lld, the LLVM linker OPENMP=3Don: Install libomp, the LLVM OpenMP runtime library PYCLANG=3Doff: Install python bindings to libclang =3D=3D=3D=3D> Options available for the single BACKENDS: you have to = select exactly one of them BE_FREEBSD=3Doff: Backends for FreeBSD architectures BE_NATIVE=3Don: Backend(s) for this architecture (AArch64) BE_STANDARD=3Doff: All non-experimental backends =3D=3D=3D> Use 'make config' to modify these settings ---End OPTIONS List--- Note the BE_NATIVE use. Also poudriere.conf has: ZPOOL=3Dzopt0 USE_TMPFS=3D"data" ALLOW_MAKE_JOBS=3Dyes For reference: # uname -apKU FreeBSD CA72_16Gp_ZFS 13.0-RELEASE-p4 FreeBSD 13.0-RELEASE-p4 #4 = releng/13.0-n244760-940681634ee1-dirty: Mon Aug 30 11:35:45 PDT 2021 = root@CA72_16Gp_ZFS:/usr/obj/BUILDs/13_0R-CA72-nodbg-clang/usr/13_0R-src/ar= m64.aarch64/sys/GENERIC-NODBG-CA72 arm64 aarch64 1300139 1300139 The swap/paging space stayed unused. I've not yet figured out a good way to time just an analogous subset of buildworld . It would need to be stable/13 or main [so: 14] targetted to involve building an llvm12 based set of material. releng/13.0 is llvm11 based. One point is that likely the system builds libc++ and such but devel/llvm12 does not: devel/llvm12 likely is bound to the system libc++ and such. This may make "analogous subset of buildworld" harder to isolate. So I've not made it to well-measured differences in time-used yet. > One of the things I'd love to prototype if I had time is a CMake-based=20= > build system for FreeBSD so that we could get all of the tooling=20 > integration from the compile_commands.json, reuse LLVM's (and any = other=20 > contrib things that use CMake) build system without having to recreate=20= > it, and be able to use ninja, to build. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)