From nobody Fri Nov 07 18:14:20 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4d36f86cxYz6GKTF for ; Fri, 07 Nov 2025 18:14:40 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic313-20.consmr.mail.gq1.yahoo.com (sonic313-20.consmr.mail.gq1.yahoo.com [98.137.65.83]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4d36f84PQhz494G for ; Fri, 07 Nov 2025 18:14:40 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1762539274; bh=ZN4UMJ5DF8eOAeIknHdnYmLBwv5aWckmfBGXyEzLrNE=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=UzsJZJCkEPGmIyggtwSn4C8+DNaP6agIgLs6fYav4SiZvKEMOLOSuVsDZiyktrXe71wMrQFwmeXWxG8YjVWnQsbuH+fIVFBCXB1QLTPm7KyKGwhz+DIswJoh0U2jVX3N0tTMhHn9x2GTnr6tl3+IGSBa9VHiOpZAvCYnDJEA4H8ua87az0+JH3Yt9rSwBLsUKol8spgHvuqihr3rpY2/FMbLL7OSsMB63KmewK4/LYUKfWLBfAFNA5+JiEek0EOVuKp9K08UJ2Y92JBL5A8iBv7n/8XN6sbteTFqMif+bCeJlZddaaqgj7OBRzF5lTOeNNgwgDd0xiYJuZW3RBdAag== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1762539274; bh=VpRV2fnvZJvubzHlasJPhVIhTtRl05dymMOh1n+t5iC=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=W73ROmjydG38HbS8/gEo3D5WA7KyP151DlVVSDaN7Iy7S9gxSMxvcx6ZJ9WnrmtQTmLequK63upYtLKBGdtkIhXPMgMYsHeLq/HK/Kwvz+mnl6m2yMTMq/BvlRsyyjmxkEngQBt+vaL5wpYtdjIEj38kgjTR3lKXWpNIxJljN09i8r+eCQCanaevSg00NofrIwckIW+Dm1uS98e99TGt1RPR3uwLxyMcAW6WLgcKrlLiEHdQFDckBRKL2WTdjmNYasEuy66yg+TW5o1mUiXUWmylIGzPoUQ5FSnKnP8Z3nUQ3GvbyoPqRXMFyxWHSyCbXpRte+s+UOr5nbjXlqL6LQ== X-YMail-OSG: NNEVU6QVM1muhuoo1EODwz9kD3nM3CGUsvCNoXUeMtVYWOjFW2o1neutdnJXFDp faW7z0gRzskwpy5Tf_oj9_RpO0_.W8LRMGvCv_frXGuq254u6W19L7JoSdecNVefyufrdD_JO52H xz1eF.Sl7lWZnDNbKdZEJVpGVga_ruXhQf0twUqo3vAFoLlF0suDVNpjZ_ghGD5RTDOBfBeoRGSx NBdWlmmpzLIIk03p_VUeeV5HhafSJ9jX70C3nw0zPtMpTlzi6vrobiSFYYI5kdq.FZPF13R0SPxD nXS9LiRmhATEl3ot7Rkvuc.H7duZvFiUIZW2tJS_EhVlBr0SOeJDbQ_tEIPFSqcbQ5LASC00FNYV ufiVZG9hICUWNP3wqL2iP3.1VYgZDU38y7eq_26DqTkmYmWV9O.ehwOfDsPTAJqP3OfBqB4llMrN 12InCkm61IA4zdYGeFIEBhKad_ETz4cJll5voyGDaSifB4qeH9govOFzKLvVtcpKwzU7lYgltdbN aAvgen9qYX0csv3RVLAK6u20WdAVj3sWuFUU.6sy0.2AEvOETlVKjwC7EhnGfgvQvKEZmdQ6SQWT j0o1W2fWkTUvthQZQMuh3Y800Vt_f48HTwLR2mHpD0cFDYx9QcHgsv2kBTeNGTZNDzbbvsh38UTb E_68JEHs.1QIxUMne9rbZ4rvtk4MO53mbuKESa9AV.p2Jqbxz8z5Qty3fG6O2LfkaCXAepS7DbDy 1fwAG7wm5EKM75jjJJkU8bytGQfrEBeyttZFdu1pb6LLRj_JdSR_mrKjQSozdjPULqc0zUFLq98N pmVjIpy_RKS8QHeD_7HoXQX4HkWHUCAMRW45jozz9C1FdZfoIeYJx.kyMZ6wwcGr.DEa8vJ84PFQ fHHO4kppPDMKKNsOGzbZhm1mLA4r0ut6eHcoOBF5N_Y86U9apilXP2fwvbiD06mbMzY4EwYF6w3U XnV.1X8dNMqoBAeIBB7JANcobbS.NkqP_ratKLvzd_JPkpx5Ll0UFUpWFSGT256w31s3WPXA9HZk IPJnWCXimlRnTZhzyMajv8q9odj7meYIwVldFM4Gx9bsA09anVJjHVZtAeF4DEzfLmdc_r6CCH__ _4Q_Ge1p1ICzADhgtuC0ZzXWxizHXxE7STia2NxrHQShsKKFIOMs4qaU2WWtGQXRyAH3VTgcDMZe AETs.HEZOQJ_CuR7TmjQkE.48ZkeDcONSbuI3y2VQ8FyyS0ZC.mRuf9TrQfA3v.Wvkj5aHL1_17r BzFvsNj.c4xEgD8z7ZF2yu_NIV7kh_VDO.yPdd_gYgInUvHZoJeLGPswtQ5sYlbhtVZSPHiTwHMJ fi9f7KORRWuEjbZ9Xql3ss7F8rNAFh0Z5JzqTwCJlBLXHbG3gglY.EXZzOrdnN3YjFWZ_hvsbjyO LXw28Tq2v0sHaVCnPQBrWUnQ1OtqeRAzCvvp4tuewUZencma.GY.041Fn.yEV1ovc4u4R6FBPnWS 0t1I2DgGd7CUcVgTBlblRIA51eDxgfeWXgHv1kW.R0IbIuEFwPGqhYJIWzpdwmps2AmQFgh7Fjt2 kE24FCFB35ZhtkNMza6w1fCTHUbx4Bun.wBM_.axZlNO0NTB99yQPkrGf.LvzZWXyTbqYj6PpNHA KRvU5j2E6QNXTHcwO24mE8Zj4w.VXDonOj2LmqF7XPuMZL3ey5hqVsa1wY.FAjJj4HAROQgBDtW3 TopSgOze8C7kK9aplpOBhuQ5USRzr.vwyMw9SiCaqvn.CofbWw1hCr3BW9Sd7l254BNek1NTOun_ yaPtzl_YlI9SuduLFajmK_yjRmSoNIneXyktyBs13ZIwz.jOXttzBgklf8BmYN3Tz8tw_G.yLege msMAh5iYsMDlOBD8djdsJGJOxXW8WgHpFAEeoRFcB_ZcK3yt0OKbWX6godp7tF0wjy189cXLuz05 y8Rakc.SL7jXe3i24FSrImV9M64lXe.IV5QCcNsS1hXSsigR_GFhPzcIRfMOKpfse_ClCIppbJ2P 4X215jgQMzyVCaWG6VzOEELU2kKJDSotoPuYZbgqfr0HnVJdKppQpeCPLoxzPmYkiJ0jFHY2OZFB o8IL1E8q4.hIqtMfUJHhSHX.CXR9e5kKLLBmRowdeZxa1NGh7MhMUZzPb5ausvzUg1uLlCWri8J9 Fa0078WbhO1BB54bTvMbrTWOWnyH37LvMbFnlzq5UQ8lBN.JqWVRZ7p1BBNrn5QG5hv7ehpqdj3g dxq8LPM3crIRszLl4MWfi_AwhXhP.S4c1t.a82M3IHg9guhXdb.obrURriTuuirXfA3ra5P0dvpa jk2CS1g-- X-Sonic-MF: X-Sonic-ID: d0aaa5c8-ac33-4234-93a0-467eab0f9315 Received: from sonic.gate.mail.ne1.yahoo.com by sonic313.consmr.mail.gq1.yahoo.com with HTTP; Fri, 7 Nov 2025 18:14:34 +0000 Received: by hermes--production-gq1-86c5846576-ngzfg (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID b59663b4e007d16e816470d1780f8c66; Fri, 07 Nov 2025 18:14:32 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.700.81\)) Subject: Re: mongodb - Re: Arm v7 RPi2 -current unresponsive to debugger escape during buildworld From: Mark Millard X-Priority: 3 (Normal) In-Reply-To: <32DD797F-E5B6-4198-93D3-738C83A79AB3@gromit.dlib.vt.edu> Date: Fri, 7 Nov 2025 10:14:20 -0800 Cc: Ronald Klop , bob prohaska , freebsd-current@freebsd.org, freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <475995705.6919.1762440301455@localhost> <05ADBC62-E111-42F9-ACF2-3A92F2781870@yahoo.com> <8939ABFB-B315-4DFE-8CD9-296B8A117053@gromit.dlib.vt.edu> <1993483939.9508.1762530959936@localhost> <32DD797F-E5B6-4198-93D3-738C83A79AB3@gromit.dlib.vt.edu> To: Paul Mather X-Mailer: Apple Mail (2.3826.700.81) X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Rspamd-Queue-Id: 4d36f84PQhz494G On Nov 7, 2025, at 08:26, Paul Mather wrote: > On Nov 7, 2025, at 10:55=E2=80=AFam, Ronald Klop = wrote: >=20 >> Hi, >>=20 >> A bit off topic, but as maintainer of mongodb70 I can tell you that I = do my test building on a RPI4 with 8GB of memory. It has 16 GB of swap, = but that isn't used that much during my build tests. >>=20 >> I do add LDFLAGS+=3D -Wl,--threads=3D1 to the build. In my experience = the linker is using a lot of memory when multi threaded and at the end = of the mongo build you end up with 2 or 3 binaries being linked in = parallel if you are unlucky. >> You can also play with MAKE_JOBS_NUMBER=3D3 to keep it from running = to much in parallel. >> Of course limiting parallelism makes the duration longer, unless it = is swapping so much that sequential compiling without swapping is faster = than parallel building with trashing the swap space. Find the sweet = spot. >>=20 >> And yes, MongoDB is a monster to compile. >=20 >=20 > Many thanks for the MongoDB compilation tips. An extra complicating = factor in my case is I'm building via Poudriere and so the = poudriere.conf settings can confound things when it comes to controlling = resource usage. The mongodb70 port has caused me to change my = poudriere.conf settings. >=20 > Before I started building mongodb70, I had PARALLEL_JOBS=3D1; = ALLOW_MAKE_JOBS=3Dyes; TMPFS_LIMIT=3D8; MAX_MEMORY=3D5; and = USE_TMPFS=3Dall. Now, I have commented out PARALLEL_JOBS=3D1; = ALLOW_MAKE_JOBS=3Dyes; TMPFS_LIMIT=3D8; and MAX_MEMORY=3D5, and have = USE_TMPFS=3D"wrkdir data". I also added mongodb70 to TMPFS_BLACKLIST: = TMPFS_BLACKLIST=3D"rust mongodb*". >=20 > So, I went from 1 builder with multiple make jobs to multiple builders = with just 1 make job. (Before needing to build ports like rust and = mongodb70, I used to have multiple builders with multiple make jobs per = builder.) I've also dialled back a little in what TMPFS can be used = for. Usually, the system runs with 16 GB RAM and 8 GB swap on a 6-core = system. Right now, I have to add extra swap to let mongodb70 build = successfully. I suspect prior TMPFS usage is not helping matters. = Also, I don't know whether MongoDB is using a reproducible build, = because ccache doesn't seem to speed things up much for me after a = failed build. That's just a gut feeling, though. >=20 > I can echo your observation that the swap doesn't appear to be used = much for most of the build. It's just when it comes to a certain point = where everything explodes and LLVM dies from OOM. Adding extra swap has = got me past that point. The last time I did a "bulk -ca" test monitoring builder TMPFS usage for USE_TMPFS=3Dall (no blacklist), the larger usage builder runs were for: TMPFS: 39.11 GiB usr/local/ SIZE: 1.85 GiB = powerpc64le-rust-bootstrap-1.87.0 TMPFS: 38.77 GiB usr/local/ SIZE: 1.81 GiB powerpc-rust-bootstrap-1.87.0 TMPFS: 38.74 GiB usr/local/ SIZE: 1.84 GiB = powerpc64-rust-bootstrap-1.87.0 TMPFS: 38.61 GiB usr/local/ SIZE: 1.89 GiB aarch64-rust-bootstrap-1.87.0 TMPFS: 37.13 GiB usr/local/ SIZE: 1.74 GiB armv7-rust-bootstrap-1.87.0 TMPFS: 36.61 GiB usr/local/ SIZE: 1.75 GiB i386-rust-bootstrap-1.87.0 TMPFS: 35.93 GiB usr/local/ SIZE: 4.18 GiB electron35-35.6.0 TMPFS: 35.29 GiB usr/local/ SIZE: 0.32 GiB rust-nightly-1.90.0.20250624 TMPFS: 34.01 GiB usr/local/ SIZE: 0.32 GiB rust-1.87.0 TMPFS: 31.48 GiB usr/local/ SIZE: 4.43 GiB iridium-browser-2025.06.137.3 TMPFS: 31.05 GiB usr/local/ SIZE: 1.34 GiB clickhouse-22.1.3.7 TMPFS: 30.84 GiB usr/local/ SIZE: 0.35 GiB gcc-arm-embedded-14.2r1_1 TMPFS: 27.01 GiB usr/local/ SIZE: 1.51 GiB mongodb70-7.0.21_1 TMPFS: 26.35 GiB usr/local/ SIZE: 4.43 GiB = ungoogled-chromium-137.0.7151.103 TMPFS: 23.98 GiB usr/local/ SIZE: 1.89 GiB amd64-rust-bootstrap-1.87.0 TMPFS: 22.55 GiB usr/local/ SIZE: 2.53 GiB linux-ai-ml-env-1.0.0 TMPFS: 16.66 GiB usr/local/ SIZE: 2.75 GiB 0ad-0.27.0_9 TMPFS: 15.31 GiB usr/local/ SIZE: 3.48 GiB deno-2.2.9_1 TMPFS: 15.28 GiB usr/local/ SIZE: 4.08 GiB thunderbird-140.0_1 TMPFS: 14.69 GiB usr/local/ SIZE: 4.08 GiB librewolf-139.0.4 TMPFS: 14.65 GiB usr/local/ SIZE: 0.28 GiB grafana-12.0.2 TMPFS: 14.64 GiB usr/local/ SIZE: 4.14 GiB tor-browser-14.5.4 TMPFS: 14.44 GiB usr/local/ SIZE: 4.08 GiB thunderbird-esr-128.11.1 TMPFS: 13.93 GiB usr/local/ SIZE: 4.08 GiB firefox-140.0.2,2 TMPFS: 13.81 GiB usr/local/ SIZE: 4.18 GiB = gstreamer1-plugins-rust-0.13.6 TMPFS: 13.71 GiB usr/local/ SIZE: 0.67 GiB llvm-devel-21.0.d20250403 TMPFS: 13.68 GiB usr/local/ SIZE: 2.04 GiB = xtensa-esp-elf-13.2.0.20240530_8 TMPFS: 13.63 GiB usr/local/ SIZE: 3.24 GiB qt6-webengine-6.9.1 TMPFS: 13.46 GiB usr/local/ SIZE: 4.08 GiB waterfox-6.5.9_1,1 TMPFS: 13.09 GiB usr/local/ SIZE: 0.62 GiB alloy-1.6.1_3 TMPFS: 13.04 GiB usr/local/ SIZE: 4.08 GiB firefox-esr-128.12.0,1 TMPFS: 12.78 GiB usr/local/ SIZE: 0.28 GiB awslim-0.4.0 TMPFS: 12.52 GiB usr/local/ SIZE: 0.28 GiB telegraf-1.35.1 TMPFS: 12.50 GiB usr/local/ SIZE: 0.11 GiB texlive-docs-20250308 TMPFS: 12.47 GiB usr/local/ SIZE: 0.33 GiB ghc96-9.6.7 TMPFS: 12.17 GiB usr/local/ SIZE: 0.06 GiB nerd-fonts-3.3.0 TMPFS: 12.12 GiB usr/local/ SIZE: 0.33 GiB ghc94-9.4.8_1 TMPFS: 11.92 GiB usr/local/ SIZE: 0.28 GiB vault-1.19.5 TMPFS: 11.78 GiB usr/local/ SIZE: 0.33 GiB ghc92-9.2.8_1 TMPFS: 11.35 GiB usr/local/ SIZE: 0.28 GiB grafana-loki-2.9.2_13 TMPFS: 11.01 GiB usr/local/ SIZE: 3.31 GiB virtualbox-ose-71-7.1.10_1 TMPFS: 10.92 GiB usr/local/ SIZE: 0.28 GiB trivy-0.63.0_1 TMPFS: 10.38 GiB usr/local/ SIZE: 0.28 GiB vuls-0.33.1 TMPFS: 10.29 GiB usr/local/ SIZE: 0.67 GiB llvm20-20.1.6 TMPFS: 10.27 GiB usr/local/ SIZE: 0.67 GiB llvm19-19.1.7_1 TMPFS: 10.24 GiB usr/local/ SIZE: 0.67 GiB llvm18-18.1.8_2 TMPFS: 10.15 GiB usr/local/ SIZE: 1.75 GiB ringrtc-2.53.0 . . . Below 10 GiBytes omitted here . . . It was an AMD64 context. So mongod70 was a little over 27 GiBytes for TMPFS and rust was a little over 34 GiBytes. So for a bad relative timing: a little over 61 GiBytes possible contribution to TMPFS use with both building at the same time. Of course, without TMPFS use it is normal storage media use instead of RAM+SWAP. Such things have lead me use MUTUALLY_EXCLUSIVE_BUILD_PACKAGES as part of managing RAM+SWAP use/competition and/or file system space, even if TMPFS_BLACKLIST is in use for some things. (I also build some port-packages on system configurations that have no chance of being able to handle USE_TMPFS=3Dall or the like without TMPFS_BLACKLIST and such.) Also, there are some port-packages that TMPFS_BLACKLIST does not help nearly as much and so still use significant file system space when listed in TMPFS_BLACKLIST . =3D=3D=3D Mark Millard marklmi at yahoo.com