From nobody Thu Feb 29 16:06:40 2024 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Tlx1W66xzz5CRn5 for ; Thu, 29 Feb 2024 16:06:55 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic310-21.consmr.mail.gq1.yahoo.com (sonic310-21.consmr.mail.gq1.yahoo.com [98.137.69.147]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Tlx1V5Q5Pz4tgM for ; Thu, 29 Feb 2024 16:06:54 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=eAQiknNE; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.147 as permitted sender) smtp.mailfrom=marklmi@yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1709222812; bh=VF9uaQb6lg3t2DMmre1IjQovhgfyZTb/Hj+spZ/+tDs=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=eAQiknNEXPgifMmQD0Q+9iN1ijpSVjuwsIinqOxmtfu8C0Wtj2Jb1+HqgvHJMiom/plbfQerwEgUzD5DU1BocNH8QdEnfl4ZT5OxVD1ZyYgC9/wzOQMzwgFT/lcK96VZsyznTvyLKQMw34wCY9edvitdsInkKsaUJQhg5X4lh58DDWu6UCOonjTOpXAUgwY4oGYtuHWlUij6J8h7P6NIkLMAYI+e0M4DKIW3NqlT1q+IxitDe+TDv5T7JBw3UDiQp6A45WP0swIJLqrgrkknucXov98PjKUMscf0t4dDYwU/XR4JcEGkKiW7rMpNEtk7whC6M575VOLPgnyMbNbyvQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1709222812; bh=bRNRJzznRzbiiG4Sd+2HaLQLknPXWfY6frM7zt2nly7=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=T09TTUhnFEmYaBGlqPKFwcOpI9xlQi5YA6wziDZvgOU+DX5KYiIlZS/C7nT4IicPxRbtid2axnkJ5de229gsnf4vJ6+ns5oWpJtaiNsfqN95gz/tmW4NPH84ppLtcHodKhxxfOCpshhS+JLA/JSoZdQFUkAK1Jn4Fuc/f5wC5+Ny056Vkc5vb8RPoYiEbpgc56JAaozodwtPhPrX8fwd7u8tg6uUlje4ylpQ4TRWCkEa714lKX1UKqOtDwc54FGdd0L3kc6udP5qntmWwv1eWg3jxV5Bt9r6XCy8wOxUV3BCE5ScjymuU4M9/0gFm4aD+yukYBIO7+XQJR2RVUuqeg== X-YMail-OSG: SMG10IIVM1k9uvYUN9Ueu8eDqu0zJs7u4F6DZXvaqIQTcfaiLTL0RK2u51qO5UG X9HDwEve5Q1SFWhr_1_7C6uEbnRBFfZF1AICbqvUrdPMaoAeuhc3pN8Mh7h.uCZSrd0xJu8Gwqj6 i5qt_.85P5fuNKF_VrwYS2u6wnqRLvJ0CI9Qqd9wz3.heUg3yijOYe3iepdL3S1nVAGnFEkiFZK7 HkETdWol4jRMY0zlADq.99huWycVADzSzidFjeFx9XdCaBjhls4Hy21yBPSWJB5c63.fvfmvU7cd z2dzFJUyzL8Wdvd.O98r.UndnGPrjS70Yb86ywPlUnRPZm277C0IUR.mQs8wuALJLLQPgB24IoeR 7C7b6hsfuZIf0PCiDLGJip4UFTVCjcgUhc6As2AR7Y4pH5n0d0QYLToztmNiK_fcxfBiVSf9AUds NULF8X9Q2BN39cO_VPpxL.Xg1GJg2kvHnTWklAxUFLta1gLDBZE_f2Wofe8_MFcU1E2uy6kdgKo0 WdtX.VwPlTQblgOYiGf3T2IejrWU2nqzAosWPXYKytIRLHnu7ZZgGs07fsARelffsLqOKIyD2AuX 4ltA8aVhb5P3149BiRVJJocVVg702y0WrprQl2AyfpY_dFAY6t3YBYi7cmyysDdCJsI3glzk.Rgw bTREZ_LL1.k3bP14tNMG5c0v0dVF4sLfPUDpc0YnLOJBO6IhNK_8dSRWyTPIWRQUhbH1oxuxD2EH 0bzQ73JUTJBlgTCoBmgLw_kX7x.LpXI_5DhMyty4YkNRifstw49i5CxbWGUfbmYhrPat8JWOmK7f r6h4cvgs5XV65FjGJBd6isvhTJ4dbr5ajNL5yuXCDnYm0VD4RI3yI5CJjuvdnDzju9kKPNcXbheL dQO5CSK0_dQhNHyULTUCasPJ4xACt4vx4qoBqYw9SK7U20tHsZMSzvaNQlX5MsvNaFyo1xI8moUg XrxUXGBp6zmP7MQASMvUUzoYSSjPQt2QMvLhFz5pxfVCVzcKJ.3sy3QBwDh5CwWJpMas25ITUsJ. PIZkH2TuRt0z4FarDzI8W8jcXtcdgrW9VGEo3Lbo.bQ.4tOhiMV10WiDr6cCEobOO__jhjQAJO9Q VkbhGrZAoFWE.W1zScAtXAyygqmzxAe2ZyP0M6gMzHvbJ4M0D3BbtnoSd9MXQMkXb85gDsbJg4LD H.VrYnr9q8NvBAzq8E1SkP1OQn4QYL48OPpYSRdztlAHm21JA0fP2Y2X_Ab9Xg0jh32CA1kbqmWd ZnVp4OfnswrGyUULrd3k.cQnr_xGmojLHmf1CY.hTWCVT4ABKcMjHISndgPAR1SrvH8X6aspesiQ _2t6Orm_IgtLpk4xU4v64NYXXumO9d5DMKYdb5EJsWeKV1WoQZrHHuTFLpImH_gYij6ryp3Pkgbk wOJvaLkYEu3SDdMNX51.o.zzDtclP5Q9PHmvB8LbXGc4.ans6mA8qFNW.pHH0ycdG3FLy1O2Ko2c 6z658g_HIA8NcLJFKqFh9Mr_yDxRrVWquoVRwE8cVYmxgyyxSxAu6f12LuqHcgtrH2f5fhmV40fs F8YAKTjIrnNWpR6tW39dO_2UbZcz8oSsU2B1ktRNl90ZFcvLVw9JaJH0uUN7q1R2Sq.NQWtjImos wYPJ91wlbRQ8p.oZFcYJWBMew.igQbRaLgCJyn6rhFBLxqnVKtom6.75O2kQEaA7XjCb5EzLaJav VeEnliI2BSJV6b7vMdFFuzi0Y1j0EIEdfa3arDtDx9co.3A03VqxM2wlrXbQzlhShxAeQ4sCfliZ dJmFhplzoH.H2XTPnPfj0ikWruTUCORNcItzIMtS_HOodkUxF2NYBjW1jIepGI.mKVDd90_mm.SA ACg.yYG_jA_23h499nLlcWQXIINJ5BSJ2vL4Ms_xlR3nzrq3wHrSuiOq.9nuqjl.xNghCNbBP.DL gdDxq4XzYm_iDoi5lIWHgFQQVvPFE_7p3ie5mqCbwc5PaAQ_NNxuF3_dbBdNyHyQyJ_raD4BSfL4 2IBnteXnusfZK4GIXgDOvVNBi5FIhHitpFpLdzcG7GkOFQ9t3cOyOPEU7CGJdxBp9LtAOZ3i8Hkj ArZKMXQ.xoCs7h7_rpSrIX6LH4H7MQGPhHqrTpQnOJNxviFCmumu2TTGGhG_9YZrkpygg3WbmdFR irvB0mO7SI3uFkBh49C_vwHLKFLXYhN2tfI1H9EeS5yjZz8zVdF4v5KVY8P7yyoOgU7o1or8LEq3 U5iMtFUy2cNK7ISa8aOh4v_B8BR3fkxePwEkoN3yXR96hgEAd7tflyIYreDMxXcMOVyojRnTQBaV qUCs- X-Sonic-MF: X-Sonic-ID: b921d162-b21e-415b-adaa-41a2d40342f8 Received: from sonic.gate.mail.ne1.yahoo.com by sonic310.consmr.mail.gq1.yahoo.com with HTTP; Thu, 29 Feb 2024 16:06:52 +0000 Received: by hermes--production-gq1-5c57879fdf-hrd4s (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 3e2775b79f056de3cfc17447de35ab13; Thu, 29 Feb 2024 16:06:51 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.400.31\)) Subject: Re: 13-STABLE high idprio load gives poor responsiveness and excessive CPU time per task From: Mark Millard In-Reply-To: <426089C7-A15C-4B04-BC47-D1F77089C492@yahoo.com> Date: Thu, 29 Feb 2024 08:06:40 -0800 Cc: "Edward Sanford Sutton, III" Content-Transfer-Encoding: 7bit Message-Id: <46C1C5BA-924D-451E-8799-223F1A70413B@yahoo.com> References: <426089C7-A15C-4B04-BC47-D1F77089C492@yahoo.com> To: Peter , FreeBSD-STABLE Mailing List X-Mailer: Apple Mail (2.3774.400.31) X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_CC(0.00)[hotmail.com]; TO_DN_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; DKIM_TRACE(0.00)[yahoo.com:+]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; APPLE_MAILER_COMMON(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.147:from]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.147:from] X-Rspamd-Queue-Id: 4Tlx1V5Q5Pz4tgM [I grabbed locally modify text for one of those messages.] On Feb 29, 2024, at 08:02, Mark Millard wrote: > Peter 'PMc' Much wrote on > Date: Thu, 29 Feb 2024 13:40:05 UTC : > >> On 2024-02-27, Edward Sanford Sutton, III wrote: >>> More recently looked and see top showing threads+system processes >>> shows I have one core getting 100% cpu for kernel{arc_prune} which has >>> 21.2 hours over a 2 hour 23 minute uptime. >> >> Ack. >> >>> I started looking to see if >>> https://www.freebsd.org/security/advisories/FreeBSD-EN-23:18.openzfs.asc >>> was available as a fix for 13 but it is not (and doesn't quite sound >>> like it was supposed to apply to this issue). Would a kernel thread time >>> at 100% cpu for only 1 core explain the system becoming unusually >>> unresponsive? >> >> That depends. This arc_prune issue does usually go alongside with some >> other kernel thread (vm-whatever) also blocking, so you have two cores >> busy. How many remain? >> >> There is an updated patch in the PR 275594 (5 pieces), that works for >> 13.3; I have it installed, and only with that I am able to build gcc12 >> - otherwise the system would just OOM-crash (vm.pageout_oom_seq=5120 >> does not help with this). > > The kernel has multiple, distinct OOM messages. Which type are you > seeing? : > > "failed to reclaim memory" > "a thread waited too long to allocate a page" Local text: > "swblk or swpctrie zone exhausted" Should have been: "out of swap space" > "unknown OOM reason %d" > > Also, but only for boot verbose: > > "proc %d (%s) failed to alloc page on fault, starting OOM\n" > > > > vm.pageout_oom_seq is specific to delaying just: > "failed to reclaim memory" > === Mark Millard marklmi at yahoo.com