From nobody Mon Nov 21 04:24:15 2022 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4NFvRm4BZvz4hMnp for ; Mon, 21 Nov 2022 04:24:36 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic306-21.consmr.mail.gq1.yahoo.com (sonic306-21.consmr.mail.gq1.yahoo.com [98.137.68.84]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4NFvRk5m0lz4Cgj for ; Mon, 21 Nov 2022 04:24:34 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=MUnCBLJY; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.68.84 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1669004672; bh=hARqPhrZOEwbkHqwMKU77+oGgweMSRYX1MXWpD/wAUo=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=MUnCBLJYXxzsCs4xW0xbFu226UcCt3ELt98qTSgeoa+XeZBWPy4nvXj7/s9GBVsCNw0RUG04tT3eQkmUf69FOE8W+9ZfCQGEAIAG5o8ebJe/ce70+e8o5tXa+rVxjUPPDujcXETR3V15tJx4D2kExBOaedtArTbMa9rCc8lmWMdUb77R/JznlJvyJjLTCORBbmMIuNnhJ417VdQMS6sPVhB5VbvNmUgEYplwX8a6zAb4bRodfWqWLuFnzcke/E6ZBeP2elhndFeN2Yj7x5FKWzIzcozbjOmM78J3NRfB++K7Y9H0JUB7tVDSGZnDopEAAlUMxiPwVhNLJG+qTs5H8Q== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1669004672; bh=k0x9qmQ4izj/KZJPQ8bVdd9Kti5TLfTI1jJ7xzsWfdC=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=BgpG72o7ui2J2kHgxcjrPjsi2xfR+DjvaddEOnx78Tf/EayU96a4hxtbEG/F8sM2MfK3eBQDpiF40JxMRoOZv/218r1VF6TgpkakBtDxMnswESZGF+3izGkv7zC0Vg5R0VI5EJmiVQOE4ecZ87YWL2HC4QatWM4H1eCURZYwX4c91k2sxxxQmbbtqB+/lgG06ya/nnCatjmr1bzupA9TBj+HDOdAQgW+JntMPFHPCNL0TJFR53zx0gVCtfT/J1zp3b0Jy0xF/6Io5QHyk+xt67g5lDPMkwzTXXJDIZCuHPMhmpds6l4RSecbqRh5Og14LqtTH2inmx4Y2FHMqc2UKQ== X-YMail-OSG: lbOpOHMVM1nBkKfuY8V_6YPVRqNXpRT9dhxu.5K7QoAggNjeeqTFVjjtj.jV7vL z0UoOaC.M0KJIsJGWZslMX8jsp6reafjbx8LpZ97sX9aVuFwpz_N0Egc6u26YAYC92h_W6LlzRJa aawbhjXR5opntbdUdhpEITFAz1geCvoCN1JTLBSwV.fOr4OLCWVdCE6qgjhXanJEMbuGpILDHPRG xUCCx.ld4HlQ3.zUPH7p4ukvFdnQVl1oIjGHqsFs27mSjf8GM3ke8faumrmruTDWZPuwGJKBQ7zw C5AiiokKAQkeNsodP4tJre4CFYgI8m59ynM8Hk2FW5ddIiV5DFY7qDa0yVtPyS.VS5kyHmfZR6kP 9h86Mt8KDusj710aBwmlg_gbJMlJbwZUh.NI7rMvoLsVbsfLFMhl5kZBX.Wrx_l.3Gkty8C07wF_ RVl0mbcFheg1PS.pFtVGPVS1bLZvYawbGjXo4M8JDWBHGaoz1IeZiUrjCLKQBHgWUDoeIk1s8MQc YbMWT7rGiMBvQ3jpGxi3TAwAoH1qwky9EHPGdj4Y5lYWAU.ZoeQMWH8fk8lCS9kOfaNxfEOM5UGw gBRG12ljHjAB685X_4r9yDgd2ONXQcqy6nII3orCRw3fvnPh_8wOE68Ai7mfvbg.cB2nUbZ_sYQS dys4X2KDANNNXqi2WjEK869JgQuX3SHALfE7NYaln6xT0dG2h0erOADagfLGqhivKgJu1JEDSeCa Cus4aOcL6kmiSG2xR_EKkXRaqkuHKsl8nZq8NRXOGWo9Ka7TQCeDJTHwnWANRPBYyBTDc3mNjy8V 0r1p2sLTmbIo1.siQslOrLD1vQBdVdtCVWUwLEIMUdp_3Xqheo8XePEfvIZlYK11nqJx2cD31Wgr HjItYFI84YXKpwsM10HuDM3UsjaombwC86LmExpqtUdo9zS_dvAN6nq8wKGpDIiJ0kr..rE3Xzcq zC9VgSYKID49UEz0Y3Si.i_tqQD9sriPJOiVKk2gXPS7hdD7OM66vk7wfFu3AaJYktjgjMBOKMap Fahq9Izk9xEfWIk650wSfTibJ2HFAj00fCO2_6VwMSVZ0Oo7GicIvpGwNl11qDdZxCEVpA9zQZuU ybiWDR6Iy9wQGc0fdq_wNUbnq1dSpWo3sWXFCoDhF2SDyqdX5rcXljqAHGJKaW22a_xSdPnCrFyf zTVTrL.6e5SXCseerxHs4AiIU4.sO_3I35VUjSobYFGp7UNr79dEJQDzeV4pB43TdYPUP9lt.ZK7 tXaz2OFJhfxivOlbLX.HXBTuV8VSpBAkdFYqOW_lcJ4SKBZIRJQyzWD313vCC18r29gv61jezM4T zjblykSw1wIRxkJwL7xPUrUanhLVoIcjRwvCWJPH53PG0ecBCKQvPRXP6rsw03Zre_TTvk7TMEM_ rSyFehqArQXBuL0T4bQyYOB_Iu5t9AZNpV5.fW2ifzgpAELbOi9Em37YIciLkUJe_voiAEE7VdVT FyehCFNJ36G1sz4swgSxy9Dt2b5HODoIdhrNHplUDaJnvgs9xxXRGK3VMomRLxUKby0W5NRklCU0 D10ODjab.QUyjnK2aC4De3EKZTOFUAoO3QD6jDRJ7yveQUNvqJnn1RtnaniCEmd56MuCwomIa42e pJvv4PFh07pANjCL.wfv3hEbfYIEPhfe7pWJZXJ_ONHgrPWwajog1LxYti7gt2KpvK_ffNlAd7fY EIsVv2ZM9f3mZqZXAzsQtjwzdrTypq_UlIRAhI.wEPEfypysb.rhLU3eXiflrUf71ImhMujPfVOs gs.ZbI3oETL0NDgFtOQmCPwVxfEd5iFvpaCL7nAMX0u92nB3sBEBC2pAwuwtj5ny6AcmB_bZaUCn omsSkODNNiPTo2jJK1Zp9Sxe_xxiJVe1MHRPAqzp6lQ1wAzeochDyGL.BvGadJOJd0XafOqrtR7B bWsG9TW.dSAsmm0K6NXtdKtflOEZw_dM8cV9Ez3MaT1ANAzGKcaFAECd2P0QSToGtgDwEzjbf5HL DfzOLgoNGbHtqOnjFePIrFvV29Cg5Si5kHFE0.Bw182uyJUzMz3IxWSH84.1cOCYsKyRfRTk7c2b NuBkuXkHFxD9LkcJ4g2SA1SlRW6zd_de5eY8zdtJshM0.XBSgtLdLCdSFyLBhItWbbEtiGmvp0rR o87WZEa4ueH5k7HnSwyy.nh0KRHu_6bMSHtvZhysfBqlZw3EZ78VJ73FGBBWQKCe64dvI6ix3l1K JgGGUgG6imEm.e_FrMXt_pgNWO5TfluXUzrrZ_flaHbTZBUM.dDcQj94_XzdtiUD7kc0fR.koLc8 - X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic306.consmr.mail.gq1.yahoo.com with HTTP; Mon, 21 Nov 2022 04:24:32 +0000 Received: by hermes--production-ne1-6bcfb7fb87-2hzbf (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID f2efe04f4aa2c047135eaa1a2c6e7c26; Mon, 21 Nov 2022 04:24:27 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.200.110.1.12\)) Subject: Re: 14.0-CURRENT failed to reclaim memory error in RPi 3B build From: Mark Millard In-Reply-To: Date: Sun, 20 Nov 2022 20:24:15 -0800 Cc: Ronald Klop , freebsd-current Content-Transfer-Encoding: quoted-printable Message-Id: <320C43A9-74FF-4848-9035-98BA1B71C44E@yahoo.com> References: <84376CC9-B991-4BF3-AF5F-0AA09CB28339.ref@yahoo.com> <84376CC9-B991-4BF3-AF5F-0AA09CB28339@yahoo.com> <1722758786.127406.1667909706281@localhost> <1E33E6A3-ABB8-4804-B2A2-0E95E853C860@yahoo.com> To: Archimedes Gaviola X-Mailer: Apple Mail (2.3731.200.110.1.12) X-Spamd-Result: default: False [-3.48 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.996]; NEURAL_HAM_MEDIUM(-0.98)[-0.985]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; RCPT_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TAGGED_RCPT(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.84:from]; TO_DN_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[yahoo.com]; RCVD_TLS_LAST(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org] X-Rspamd-Queue-Id: 4NFvRk5m0lz4Cgj X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N On Nov 20, 2022, at 19:48, Archimedes Gaviola = wrote: > On Wed, Nov 9, 2022 at 10:15 AM Archimedes Gaviola = wrote: > On Wed, Nov 9, 2022 at 1:37 AM Mark Millard wrote: > On Nov 8, 2022, at 04:15, Ronald Klop wrote: >=20 > > Van: Warner Losh > > Datum: dinsdag, 8 november 2022 04:28 > > Aan: Archimedes Gaviola > . . . > > ... > > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 256929, size: = 4096 > > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3628, size: = 4096 > > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 255839, size: = 40960 > > pid 46153 (c++), jid 0, uid 0, was killed: a thread waited too long = to allocate a page > > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 255857, size: = 28672 > > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3634, size: = 8192 > > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 256037, size: = 4096 > > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 255320, size: = 8192 > > This means that paging to the swap partition and/or swap file took = too long (> 30 seconds... that's all that indefinite means). It also = means that it can't write to backing store dirty pages to give to = another process... > > Typical reason is that the disk / flash is not responsive to = writes for some reason. You'll need to find why... I'd look at trims. > > Or.... if you can't change the disk... you need to put less memory = pressure on it.. > > Warner > > =20 > . . . >=20 > Hi Mark, >=20 > As a recap on the kernel tunables, the changes are the following, >=20 > root@generic:~ # sysctl -a | grep oom > vm.pageout_oom_seq: 120 > vm.pfault_oom_wait: 10 FYI . . . As long as: vm.pfault_oom_attempts =3D=3D -1=20 vm.pfault_oom_wait is ignored. It also likely does nothing for: vm.pfault_oom_attempts =3D=3D 0 vm.pfault_oom_wait gets involved for: 0 < vm.pfault_oom_attempts . > vm.pfault_oom_attempts: -1 >=20 > With -j1 and -j2 options, both were able to complete the kernel and = buildworld compilation in 103 and 84 hours respectively. Though I still = could see messages on "swap_pager: indefinite wait buffer: bufobj" but = definitely it's ignorable as it survived the compilation process. With = the -j3 option, it failed along the course of compilation, it = encountered the previous error on "failed to reclaim memory" but this = time this error is not that relevant as -j1 and -j2 already works. = Preferably with -j2 as the appropriate choice for my RPi 3B build setup. Glad you got it working in your context. Thanks for the report. My media does not lead to the conditions and, so, does not lead to learning the behavior when "swap_pager: indefinite wait buffer: bufobj" is significantly involved (for the time scale of waits that you got into). The implication of the result is that you would need a larger vm.pageout_oom_seq value in order for -j3 to finish normally. Based on my media, I've never had to use larger values, but, I knew it was a technical possibility to need such. I do not know how to pre-calculate what value would work. (I'm not suggesting any more -j3 experiments.) =3D=3D=3D Mark Millard marklmi at yahoo.com