From nobody Tue Nov 08 03:25:44 2022 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4N5tm669Rdz4hBdL for ; Tue, 8 Nov 2022 03:25:58 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic305-21.consmr.mail.gq1.yahoo.com (sonic305-21.consmr.mail.gq1.yahoo.com [98.137.64.84]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4N5tm53bJjz3jk4 for ; Tue, 8 Nov 2022 03:25:57 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b="OUF/jVsO"; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.84 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1667877955; bh=L49gnqqEmpcaQogZA4W/IRYs1DXgSYwe8zjAc8mjLwQ=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=OUF/jVsOt+oebrKJob/PdZFYQ+17idHO6b3A8uavs7KwxApruliM4RbajiJoRXr1a4zAc0iuVJ/DBOLs5ohCiAhsUgr8NnO/31Mh7fMw+QhGd+FHTvkhNNJ60KM75K2+aWtwWxyyWWVMUHagoDMmQrsZhL+nt5mePcXY3Qp9lGOyOgcfmpHGGP8VoyouE4cMuMPdIOxSatClvIxv0AlxIwDjCOQFr9aHe8sENvzElj/72C/yFwaOu8yrXFkTQlD38sZ7i6wsZA6EUNR25BvJdG6E70ikf9z8wQAMMNR33Y4iB5Wv5OigB6eANeX05zJVlqB6u2KyHO9I9nOBHKLGEQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1667877955; bh=w0h92JhlFiuB9KLd3/KhqDUt40fjVm7vFiW2qcO00AG=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=QYafP+dDoC1gPycubsQM/yraJMCPfgILStvunffV64Fxhki6UMtNg9cCZKDg9y4XGqjf3o3s2qDIpbAIwebZWydkrM/8v8gmD38nE2JGxeoYK6oTWs+jaogznxSJREp+mObB6CDLtu0GV1PSXWkb/2Otg06g7pc0m8lstaVB93HFqxFUddnt+DyFtwZtnhQeQsV2tMCYIpGEhzvwxXcwiJlCIFq4vB8+i9Kg3e1wQRMHebi9cISShu0fhQId5wMd+XxMbgD9quGquACk+rl7KUJm2ZW7Ywq7jVkkXx9Uaxe4SUNxul4k53fUXqCN4XdmOz8yszzXngA75qkt35kjUg== X-YMail-OSG: cAmmOccVM1lp2zaPaDbHA0djE_Do1tSx4OISZclq6Arsa0S3mcvaBzv9u86fx3. SZfHph12t0VyLOSpS2Wx090DvrNHEJJXDYbg21auKx8sYuI4Yzm8Ml9w9lTAm93ZmLsFsrP4Y6J7 BYPx3nsVNqZJW8uahNT7NJLu2DTHEoIGeoxmJsJByJzRg1DUJycH8uHb7pVYevgbOBYynXYC3dSS H0Piv5DJC4BZ1TonDJ9zPRCdnDlibEwVADiIFvg0ZYq84w5nfb57KF3T2na6_0JHH233f6DG1e2. aIZnSrkvSZi_DzGc1BNpZa61ujpcNKJ_fwNzvqL2FkaM1xRIs9HCOCVtAyenDbvHsRbFBSW8RNK8 Ja4ylRRQZWWP5s1awQqdqKbRSFaJlskepM7cxHoJkM4_DBHm8TyG01TpvfQ0rdQzbar0iefs6gTk g__yCr2u2DZldhbQ8XnK4NWQCngJl5ZqFpoi.JKo2zS6J.QMvRmMI43FBvHrXZUozwnoe96D5Hk5 5niYyLPGcGffGTsYcPDm6_4txMgTsfA0_tUWRDE6kj2qa_Q4Y9.Zu4OxDfAXcwW9LaGRYRDuavoo 12ShFsRK_EWC5kA4lHSp31lOWONwIBIHpp9MbF8CCTZr2B4NJfqvu6NSaT.FLRVnUprIeU4G7UOL 7AJZEf.mGE3JA48SaPpYArkLF7v5Kncg0HVNBiqOUq76xIILq0aYR_NQHhW2TvTGW9iyEPmSd9Yy 2RIZjyc4YY9AgxoqE_kBz8MmLnTd1AinZqFlwkDU7iG.JdCNZpA6APT5bwhkyYJRYfsa_5Ww74nF UFJ7qQ4MnuAftqCUe6OKjXIrU.9l1aiIp6xFQFUz.oFWLYP8fWnCO01ImdEonHfy3PD4YPMOXBCg 0tNnogxXVJDvTS4zf9dYoaGrDSVyD72kb4HUPUdLjD7gKWxUuyk89ajwEN_T0Kv3SdavJP_Uq54S oN9sXgF2DxM36ZtQqeI.meKvw3ETHLKMe2tb1gQRigX4nlNTZUs3VwHDZr0aX8Yvyxv2OkIjlqaB oUo8grcyXgTwHEEdKP3VEofUQpRRjSL8pmYNFf6gFEJ0_LXGAkIr6Mpv.88QAZcyQ4_itw3H4f5S lvsf7hB584sfyUNADVdDcDpoiogvftb2MCZNba7AOWoDeXCYNE8N.S1NTXB9OgQNGKRnLCs82KOl J9AFeT_5a8ZMmkjI3.7Prw2O_bzSotspx8mR.gKcvDbSsPMrCNthurpApYCIyti_Bn1fS0tH.V3Y 86CmIGpU8yU4UwQtaNFVCL0jixcPKexX30_uE6u8Jgy5lZNoejjSS9_9XRwZRTOmXNvsEK1bKb2a GAq4ZL8og6n.NH_kkXna9BjTbg.LS0M8sP9AdZs3IaTkPMQjti8ANaqdwuunhlaMxynAXQN2mVGH OmtR4WSOeKwkeKAprlbcONjpTL9.5OlKPtgUGNPIyrqi1lZ04tOObtTOCYYzth9MAzva_PdoZ_A7 ECDvBRNGqZMnm1ADiilYb3Mb_jjjzeBMRs33VS0LJ88ptTiDWXSPSM5Tc7R56ppzqigHt.NSM8Vs rt6.KhN6fV8KoLISnEZTsS3fzJgnVIk4PC65oIcBqvMWQseSdaULoAEyJ446aBOuFMIDa0JIQrZ2 .385BTnHVxOeVTBGny_V1Gbl4UqJ6vY9f4yEg2CY8dP.mtQY8zoJ.FL9AjdOK2iTfRwIowhRf9aP d7LSgEbWsI87XK6DxQliz4FIzfL.zWkmZ3_lkQleVUhr0.VnT.WYp6cwuS8I9_cnvERTNGYHk50h oJg72KLdySzVSY6ku6sR6NsOgedv0.Y2GOZmW482HK7gre6mOr6mbGVUrWnragKs9MT_9OQLqPCL 9H6TzIs_ZveJgvqY0V6uUm1auREnCit6mXQ7eHSNJlRUUIwq0O3vF412_euJD5zXAA37IVsQAmUs vj6pHtKX2cZlzRqQcExuW.uN7_pgkApD2iNyD6kL_VOPTr0NRBjZeK07op64dYfJDdcbRe.Hpfyg a6JWIyb.fWMmDbrbotUtBCtZiYIeUTh2PdBUX_wRLHzllJZv2fJaHSKTn3oT9XiTQWMgBVWFS68Z I2b20zVN7Bq3Rg7Gu3uGBYW0DISwBYrwo6Nd.ImsqnLhvijWrUFEeOe_PElWl0v5YTtcxu3zXYyv Ih0nb6ok8PylxAL5NOQz6c4LQ70vdfpCYLwObqUt7QN9KenJX9IE1CUKsIfIq1bRhIrqFXwpaWwn q9OEzZZgIzCDBAc..SMbk3hff9VO4.Tak4egQCu_S902758q6akQUDqMfpSNp8FmLEE7RKL6sYdG A X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic305.consmr.mail.gq1.yahoo.com with HTTP; Tue, 8 Nov 2022 03:25:55 +0000 Received: by hermes--production-ne1-6bcfb7fb87-5nqxg (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID de4db718e88503ce952a58191c5adf84; Tue, 08 Nov 2022 03:25:50 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.200.110.1.12\)) Subject: Re: 14.0-CURRENT failed to reclaim memory error in RPi 3B build From: Mark Millard In-Reply-To: Date: Mon, 7 Nov 2022 19:25:44 -0800 Cc: freebsd-current Content-Transfer-Encoding: quoted-printable Message-Id: References: <84376CC9-B991-4BF3-AF5F-0AA09CB28339.ref@yahoo.com> <84376CC9-B991-4BF3-AF5F-0AA09CB28339@yahoo.com> To: Archimedes Gaviola X-Mailer: Apple Mail (2.3731.200.110.1.12) X-Rspamd-Queue-Id: 4N5tm53bJjz3jk4 X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TAGGED_RCPT(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.84:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[yahoo.com]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.84:from] X-ThisMailContainsUnwantedMimeParts: N On Nov 7, 2022, at 18:40, Archimedes Gaviola = wrote: > . . . >=20 > Hi Mark, >=20 > With this set of build commands now, >=20 > # cd /usr/src; make -j3 KERNCONF=3DARM TARGET_ARCH=3Daarch64 = buildworld kernel-toolchain buildkernel installworld installkernel = distribution DESTDIR=3D/home/freebsd/rpi3b >=20 > in RPi 3B, I encountered the other OOM error which is the 'thread = waited too long to allocate a page'. This occurred from every build I = conducted. Though the first error on 'failed to reclaim memory' was = never experienced again. Below are the error logs. > ... > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 256929, size: = 4096 > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3628, size: 4096 > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 255839, size: = 40960 > pid 46153 (c++), jid 0, uid 0, was killed: a thread waited too long to = allocate a page > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 255857, size: = 28672 > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 3634, size: 8192 > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 256037, size: = 4096 > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 255320, size: = 8192 >=20 > Perhaps some further tweaks are needed in the system so I set aside my = RPi 3B temporarily and switched over to my RPi 4B using the same microSD = card and USB flash drive (3.5 GB swap partition device) and the build = completed successfully. It took around 30 hours to complete. This RPi 4B = has 2GB RAM capacity while the RPi 3B has 1GB. =46rom here, I'll = continue looking further for system tunables in RPi 3B which has lesser = RAM capacity. Given that you have added enough swap/paging space to avoid needing more: # # For plunty of swap/paging space (will not # run out), avoid pageout delays leading to # Out Of Memory killing of processes: vm.pfault_oom_attempts=3D-1 With the above setting, if you did run out of swap/paging space and needed more, deadlocks would be possible as I understand. The above disables getting that type of OOM kill completely but, effectively, a deadlock is sort of a form of less-controlled kill. There is an alternative, but I've no clue how to find what values to set for any specific context. I just know the names and default values (as of when I last checked such defaults): # # For possibly insufficient swap/paging space # (might run out), increase the pageout delay # that leads to Out Of Memory killing of # processes (showing defaults at the time): #vm.pfault_oom_attempts=3D 3 #vm.pfault_oom_wait=3D 10 # (The multiplication is the total but there # are other potential tradoffs in the factors # multiplied, even for nearly the same total.) (Yes, one of those names is the same as was set to -1 in the earlier suggestion above. -1 disables making attempts and just waits as long as it takes. That makes vm.pfault_oom_wait irrelevant in that kind of context.) As for where the settings can be placed . . . # sysctl -T vm.pfault_oom_attempts vm.pfault_oom_attempts: -1 # sysctl -T vm.pfault_oom_wait vm.pfault_oom_wait: 10 (So /boot/loader.conf is appropriate: loader tunables.) # sysctl -W vm.pfault_oom_attempts vm.pfault_oom_attempts: -1 # sysctl -W vm.pfault_oom_wait vm.pfault_oom_wait: 10 (So /etc/sysctl.conf or the like is an alternative: Also writable.) =3D=3D=3D Mark Millard marklmi at yahoo.com