From nobody Sat Jun 11 20:50:50 2022 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5C1A584469E for ; Sat, 11 Jun 2022 21:02:06 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic306-21.consmr.mail.gq1.yahoo.com (sonic306-21.consmr.mail.gq1.yahoo.com [98.137.68.84]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4LL9Hx2hZgz58ft for ; Sat, 11 Jun 2022 21:02:05 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1654981318; bh=sLgKvcdjJqYKOlHZJGuJI7WSsFxPMclg6E92QN6TeMU=; h=From:Subject:Date:References:To:In-Reply-To:From:Subject:Reply-To; b=AOveNrKoRJxVsTgv0Fp0pbg6vEqbUFzXyTdlLZHS1IyUe6XTzdBbucwUArJNCbPEH6yNmMuqZEzVO3gtRMDpDjwgqgCF99gBvtWRgfPA7Amqvx+L6v8lpPPuK4deS+FwZd+7gFFMYYn3a2wQisdd9oYyJM8/CtoHcYcO/Xbg+aro9qKqo1VKjJtr0+tpJ1OXgdBnxdKyemxKnepKFycIhFEZv4Y3rCHyC90riNXpCJnKIzkHEddVpMM1mN+6KO4vibtPIgqOaM/mkWSWoFscodv5QEzbnh1gq5fWKa/yadjlMcArTZhpPfkpkwCZ1JJQwFDLTNUI5QQSD5CUEKhatg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1654981318; bh=mlVPX7D4XMl+dWiFFHMaPCq7e6FY9vbvwUzFMbYQwy2=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=kB9EkwevSwUOn6v+M9e/awwbFhIm3wBH61wR8zUwVAdazjpLw2ILx8Axx9EnnuyF6JDt4tpueePBwkO5pGyW21FRVQguflDJ3m3gsAwYjREVzCJ7/xpMuNY6lqd09j68ajlCNef0c70YdwwJPu17nA0qH3cCrJ7ZwxgQQrYN5MneIw/eMahzTsIrnd64oHW1NYN99wQQ/mSXFawsh46fMJzv53kQ3//bf7iEqr0HpqeT/UUh+A8gdLfhQqOEn1r0f0mqo/hacp+mBSMuK+lqXD2aQKjxtFl2Qqxqt3XeNKghmMERAS3IDNoQORhE0W4I22wMsx8PoAJSyccpjvYd3A== X-YMail-OSG: roaru7oVM1n7ccCjCsYRZrB9EM4CfcNw4BJJubA2o1G_lyfBGzVQjhvSvTRUFM4 v8mB.EMfL93hZrEBa6LEGnGa1_LudvRuXx6ALsEPJn3NlgIVY7uT.GFTegeB0An1S.8_gOls6xxu T0r4ub9dnawju7V70Qv.o0yDS0hhsjWzSrdqNtYcyblqrr7yJhL8w27WravENyyiGhxFsgKlLVjV A6j4mNoLPdsxW8MFrszMSRc9qcrfTwPiai1oIiwglL1osuC3PG0zHVgXF3_EgFq_OI.IwBBsaxPb MPVh.j._ofOthI6fpksxndlCAHJyDHSI0T3B.glSwK.RloaXaKL8M08mkYp19PbtuZ88AQpBDu_K 1AfRgf6_kA0zZ5a8nOavUlE9l8wBuuSJm5QQyL2UGBLTeKONFhF4y2fMlitzSvPvgLDUbhtqrsx6 2uf3GKIhA08_A6HE5_OLzw00fVn6KvqnptMH7Et_SnUmXugOXoqEGbRmMrm2Qqzoe.N2gR4vk8nt 2jrvC4Z8.4DM6YqOle1cSAxdqjdf0.QSoFAwoAiIG4056cgBH0Gr9i37cRwh12c8c6cn6W7N7gYW rK_GYLmRh0WaGDY5YTOPY1SX_VEeX7aTFvQ0zf11B0VlU3DDURlaHgbleXH1VRa1vCz5_ickbyZw _HnyIWhUNLjSJiGiBXa04B0V7LlbnWJj3gqmqeJgmygouyb1AyiIWx4jPXt.5BGauZG23RQ_ZzOt 5cj99qMxsDBDdJW1qeDzc1zD6xUGCU6ulZsLhC8NcjPKWVSoEvDIKtFUi8lxvCmqPlJ3WJ2M5T0H KVQqOOrmKO4u6wCfL1FwLalK_H11_tRS8cBFRkU_wH.RLZB0H4pwXEd_eJVL23QdrI35zgC5WtqP 83VuiHUapxuktvacr9KBps8xoGOpflPY17Nag4j5JqFmdogOOtBpcLIXw8esnwxAgoWj7gQdA4l. Za4fX.AN0HqY2CtfTnKdY_6hacVkfubxxBzP0gHiwft6Feo_Kd1EdhKs_aJAaSkl34I6j0I67.d0 .GxPRp0v2Tn44ldtyWTzOTcpRympSv7NaIkQRsI0Z_4gEtCEaH5J6STDKIF7w68iSME27Cc.HxvZ w0C4beClbhSkiu1EaTm1oF2ul36K9RiEWcfvcdEV55VaWSlRl04f4_1CtJrwUY8yiZTOipAC2ad0 TIpZa.jqBXzgzBbBE36AwlLMtmAPmsviDIbnyKB09G.xAqsL4f38WJ2sfBFQxQx_9S7zSvSbWx0p PnFSg.2wyrcFMSW0rFBs75pwWmpvDf4bWAqgNjiWWubdHWx51RfPLQjBK._BP0mmA9pmA0JX6rLA k5y84S3bA35lovpSRvEtHX8B65frEfCzqOax_Dmv0YnW2dmdz0mA4i3aGKyQbs8r6pjug1pgFMaS w6GV0vk9HRXqOP1HsiSvROLLK83B6_ulDuIjEduwTXz.0QDRQFUrxF4HFi110ACbWhJSKFiZ1gf_ puR.gNhMJ4.d0VRhb7tJmfORfgXZZo0..KtbtWUAprWUm8e3FYMZFdtE8xte0IEhdLmXnjPOqrXM 7HJnqZdY086MV5hsuzC.oELvqoPo98ULIJwMbFDal_.JBI_X52RH9hyhFodaJnqlIrGhaLbIRf7L Kijo3cMqgW0PNlOEAxW.E7hgK0hnuwZ7ibb1Cu97F1z7O0nRm48wHaD7hd9piSKivy0yuFI0wqwJ Hhz6HAXD_osmJHUevhPjCnV3YB_rvdQQWAkmCaVzzpakvJMYe00u7bFt72RAH89WLy8mWPDhoe1n 0Z.5SJ.J7V3aDvZvzb_MZJlSW1vFuORPO_o0qudhj2ptJCAu_QLX6WnHeNGsR4KVHMBvDA9fkbcJ zI5uXr0MVBZrSY6xcWHCOn_sJU2TD78UNONxrjiOvxUCSs1kX7MiWVSpBIZWUwH3ONl9ifl13yBP LSOvPu.tv7TesQW.DHjDFayk5ndioY8lnUIqcq0sgyDul2Kz8QgeqAAzzrEfGrMfQBRxMWK14uhd CA1xN1yxETVpkr5aaKeLfZc1.itS3YKBh2az7CnwnFJ9xThvrJoR5mv.GLK.7ID8INTs81mzNdnY lHoOFvkasLB305A4khH0J2GJsQ9hG8ltXWbOVH_o7utWburzzMn5dDy4rF2IPpmLNEEMh.hk9At6 fmHBj9hjdM38pL4aFI6FAxDGJsY6TWI9BDAT8fWMBniPdorRGStgUUDtXOF2Pkv03SHbaP1.2LtI CgPl2nKftW4vhtetGOdXU.0OVpCPw8.CA8A2jtW_W9RdTbAhqSDl.NYUPyeu1xy4loAjE1aKOpCn tyNmJZ5w1eDSwhw-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic306.consmr.mail.gq1.yahoo.com with HTTP; Sat, 11 Jun 2022 21:01:58 +0000 Received: by hermes--canary-production-bf1-856dbf94db-ld7kl (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID a5c9608f4c757d9064632a83eabd0cdb; Sat, 11 Jun 2022 20:50:53 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: Re: Any clue why "df -m" vs. "du -xsAm" get such different results for the tmpfs in question (403 MiBytes vs. 101 MiBytes)? Date: Sat, 11 Jun 2022 13:50:50 -0700 References: <4997AB05-8CD4-4A2C-AAB3-34F6DB2CE325.ref@yahoo.com> <4997AB05-8CD4-4A2C-AAB3-34F6DB2CE325@yahoo.com> <82ffa6bb-5826-62b6-2b82-a735b183272f@grosbein.net> <2F1A9EE0-FB9E-4BBF-AF76-4E5AD372FCC1@yahoo.com> To: Eugene Grosbein , Stefan Esser , Robert Clausecker , Bryan Drewery , FreeBSD Hackers In-Reply-To: <2F1A9EE0-FB9E-4BBF-AF76-4E5AD372FCC1@yahoo.com> Message-Id: <69FDC72E-F1DB-449F-A9C1-25827895E6B3@yahoo.com> X-Mailer: Apple Mail (2.3654.120.0.1.13) X-Rspamd-Queue-Id: 4LL9Hx2hZgz58ft X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=AOveNrKo; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.68.84 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-2.35 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; RCPT_COUNT_FIVE(0.00)[5]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-0.999]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; SUBJECT_ENDS_QUESTION(1.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-0.86)[-0.856]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.999]; MIME_GOOD(-0.10)[text/plain]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.84:from]; MLMMJ_DEST(0.00)[freebsd-hackers]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N [I've deleted prior parts of the exchange.] I finally have a hypothesis with some evidence about what primarily contributes to the 400 or so "1M-blocks Used" in: # df -mi /usr/local/poudriere/data/.m/main-CA7-bulk_a-default/ref/.p/ Filesystem 1M-blocks Used Avail Capacity iused ifree %iused Mounted = on tmpfs 1024 400 623 39% 103659 3828501 3% = /usr/local/poudriere/data/.m/main-CA7-bulk_a-default/ref/.p --where the poudriere-devel is using USE_TMPFS=3D"data" for a "bulk -a -c" (that has been running for a little over 2 weeks now and is past 1/3 done). Taking a quick estimate of the file count in . . ./ref/.p/var/cache/ I get: # ls -Tla = /usr/local/poudriere/data/.m/main-CA7-bulk_a-default/ref/.p/var/cache/ | = wc 82146 821452 7942485 Taking 82146*4096 I get: 336,470,016 Taking 336,470,016 / 1024 / 1024 I get around: 320 Mi By contrast: # du -xsAm = /usr/local/poudriere/data/.m/main-CA7-bulk_a-default/ref/.p/var/cache/ 46 = /usr/local/poudriere/data/.m/main-CA7-bulk_a-default/ref/.p/var/cache/ But: # du -xsm = /usr/local/poudriere/data/.m/main-CA7-bulk_a-default/ref/.p/var/cache/ 295 = /usr/local/poudriere/data/.m/main-CA7-bulk_a-default/ref/.p/var/cache/ and: # du -xsm /usr/local/poudriere/data/.m/main-CA7-bulk_a-default/ref/.p/ 319 /usr/local/poudriere/data/.m/main-CA7-bulk_a-default/ref/.p/ This is all after having done a swapoff for the 2 swap partitions and a swap on for both and then waiting a while with the "bulk -a -c" still running throughout and after. (So under 82 MiBytes is in use in swap space at this point.) poudriere's tmpfs usage reporting does not seem to cover this area's tmpfs usage. But, at least for "bulk -a -c" kinds of activity, it ends up being the majority of the tmpfs usage for USE_TMPFS=3D"data" types of configuration. For reference: # ls -Tla = /usr/local/poudriere/data/.m/main-CA7-bulk_a-default/ref/.p/var/cache/ | = more total 301234 drwxr-xr-x 2 root wheel 5257152 May 28 02:31:26 2022 . drwxr-xr-x 4 root wheel 128 May 28 01:56:42 2022 .. -rw-r--r-- 1 root wheel 2 May 28 02:26:40 2022 = builder_active%01 -rw-r--r-- 1 root wheel 2 May 28 02:31:24 2022 = builder_active%02 -rw-r--r-- 1 root wheel 2 May 28 02:31:26 2022 = builder_active%03 -rw-r--r-- 1 root wheel 2 May 28 02:31:26 2022 = builder_active%04 -rw-r--r-- 1 root wheel 18 May 28 01:56:51 2022 = originspec-pkgname%accessibility_accerciser -rw-r--r-- 1 root wheel 19 May 28 01:56:51 2022 = originspec-pkgname%accessibility_at-spi2-atk -rw-r--r-- 1 root wheel 20 May 28 01:56:51 2022 = originspec-pkgname%accessibility_at-spi2-core -rw-r--r-- 1 root wheel 11 May 28 01:56:51 2022 = originspec-pkgname%accessibility_atk -rw-r--r-- 1 root wheel 13 May 28 01:56:51 2022 = originspec-pkgname%accessibility_atkmm -rw-r--r-- 1 root wheel 17 May 28 01:56:51 2022 = originspec-pkgname%accessibility_caribou . . . -rw-r--r-- 1 root wheel 17 May 28 01:56:55 2022 = pkgname-originspec%zutils-1.11 -rw-r--r-- 1 root wheel 15 May 28 02:03:32 2022 = pkgname-originspec%zxfer-1.1.7 -rw-r--r-- 1 root wheel 14 May 28 02:03:00 2022 = pkgname-originspec%zxid-1.42_1 -rw-r--r-- 1 root wheel 19 May 28 02:04:03 2022 = pkgname-originspec%zxing-cpp-1.3.0 -rw-r--r-- 1 root wheel 12 May 28 01:59:41 2022 = pkgname-originspec%zydis-3.1.0 -rw-r--r-- 1 root wheel 18 May 28 01:57:13 2022 = pkgname-originspec%zynaddsubfx-3.0.6,2 -rw-r--r-- 1 root wheel 9 May 28 02:02:07 2022 = pkgname-originspec%zyre-2.0.1 -rw-r--r-- 1 root wheel 14 May 28 01:59:41 2022 = pkgname-originspec%zziplib-0.13.72_1 -rw-r--r-- 1 root wheel 14 May 28 02:03:00 2022 = pkgname-originspec%zzuf-0.13_1 -rw-r--r-- 1 root wheel 13 May 28 01:56:45 2022 = ports_metadata%top_git_hash -rw-r--r-- 1 root wheel 4 May 28 01:56:49 2022 = ports_metadata%top_unclean =3D=3D=3D Mark Millard marklmi at yahoo.com