From nobody Tue Nov 26 02:05:12 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Xy5WX23yPz5db9y for ; Tue, 26 Nov 2024 02:05:28 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic306-21.consmr.mail.gq1.yahoo.com (sonic306-21.consmr.mail.gq1.yahoo.com [98.137.68.84]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Xy5WW02Drz3wtK for ; Tue, 26 Nov 2024 02:05:26 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=bakeiUTm; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.68.84 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1732586724; bh=8sJfliBR6dtrYZF1TA/cgxCMZ71Vz2+0NmqB4mslM0c=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=bakeiUTmsWOqdWYIeUW1ol0DEsrCQk3ZAej0sCnthhu1akKGTDk/D4yHRkp7a1AfvNwlCXm4BxrZ5axL7yAPHJN4F2YugIE648HLRNhG4pApEa4y32Dj44knjdrd18SqgEwnhqhQYmiRRNMPl04RxWNMDqfO5WbswH2VDlRrAt+2CQEGR3wGJIvxw9p58Q8mYdA+rmq/+qeVb/qYNG1ZNYyni/f6I7ENNe+PLnIKFkcjCaiY11ST2cY6hRPPacCz5ZgkcOjOan0g7LyaYL3XeFktVm9MU3OaX0z80KQ/n9+oADcoemQtmLh42yfCDhyuBBmH9EJO06G4RP4N79a7SQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1732586724; bh=zAtLuFB3uJEy0+yLcdD2koeO0MyT67/PBVck9r0wRiw=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=pKLhqlEX9ZqTURprTzGUvszKIgNWo8voV4+q2YxBTb3Ue6X5l610J7pTfeXIdYZAZMbHCbUQndKNjI7HBXJUWVB3hLt3guwpK9p+K1fuJWAifKYb6akR959CWLtrSFQb3chJdnFXQgaVjISwHcNcjut6MrNny61ucbZHk25AE4Qmd3gB05SFf5+V9vlBo8xuK24OfySg9etpJ4JHy3NgtXcYK2H2l0uEtYd2epRO6Y1h0nU8kjB3HQ5BKe5gqeidlXD+UGKC2XMxjJTxvKQ0kaRpOisjwb1q/sic8PnEGhcox7tEyi0592GQcI+GIhqHqKkp93CghOhuEtfAShEo+Q== X-YMail-OSG: f2d36S0VM1kig0bn1C5OztVM1rG7fw.Lwktigve2lApyygQYQgzDnMugEosOCiF XZ8onTLeNz9jzQet.UsAdCJNtgpb5ECuRWTiFvb1EBt1b9lN.DhkDUwM7CgozLsziPzKhwEh.5Vu U9DN6JCUVktvDsV6KRfCAC_CC6_NzmzOUCPVYvZHifN_ct8YlPa9gN0RXinIGD4G2PBhlxWMaFjg 3UC0CBaBtiggN.AskXHOX5fLuhAsXaq8.MtINPB.NsL6BvylNluoO41L2X4dWrNDqUP7UANRjLx5 fhG7u8V9ftWZpYXJt7tGZNSC1XXO.oKkYKjhvsvJv.DRH8yRWnpOX5C64N_IwTAgTdluFBmN9eaL RqWndPjgBp8arDCPoSj5K9mdnPnGhKqbAJ0ciwpzO9lJGK6s0uYZsHjdgF3mzWcD0UHgy.pSnQlw aXDl0YATguTQYpkRr7Ot.tz5djuGwht5GzfbwHAKOTHDe0IT0x5JyQdfLIBtJuMv7KLYa3D.v9h4 qXTzaU6Epokihh2O7M7h8QbtYCUluKrMLtC1gt1TnFkRpW_f4tK5M5yM2zCMuopSZs7SpsgubX9r ysm_YZY2oNeKZXFFU7A5Gw8QcqK_TqUQVPFUArEQen1orxHlGbkUIip1uA7LB3.dNEyErBLAkUra 0YYACXb6rXK84wgpner4GpU93dWY7_.1JRIRSo4yYAxdPsihp6gq9KGkpcwTprlD4CZ5ePLt20Ua Q3JHqX0PgNh40MZ8FJR3CMUsXqzdvhtiivDEPFXIo55aq0f2fQrKSd4jByLKp682nM6_QC8RTJHx IEsXcOLVU_inuQ11zvHZwVeZRg4lYMuhG1b3Z8_smD4IghAVRo.weNJRSiJU51e..wgXZZPP.mhN KPHtxhjIxLeeS80Ti7AVyVM0KEX8Oe3__ysia61VPRTc_Dbr0gvZD.b_Cq_.RbSfgXSrXwHOW8NE 5NzVhu0Brgu.b8TJPj6O1uhBWrjkMxnM0JWAJNz7Y0Kt7Salecqjh2_..Vla_wAQlqkaSuIOMMN7 rC_oIkV_y.wU5rmxVVqPqi5TfwMifRIfF_Mh2_scyrssTyomGCaEddGdKkV4gTWpHItcBsn5lb6o JfpK5BbFZekxody6GjWJc07Swu2F2PNV7wOSb3o_Uypp4kIIQYzZ1pjalDI.r9SI0..XiCIWpMet pXpu2UypjwG3tOrixPkOmacDIYr5GFcR.G6PojdFtec_GFCWgkIO3qvSp1RMYIW9yslzc6NQJZpF i53.Y.ck.JvBH9NLSVUk2R9SByn6hgjT57adaX93Vr5K7TxZlZNSfGB3gZU21fLGjUqAvb1PzGfI ZKjRrdg2QccpJ2vVyQy7dFx07OYOWiuxhjRjQqMiThxLB9js0TKD9UD5SbGyAYqApOcoB_9SJcTW 6i5aEywNf7qEV2rDXSAnqQhYhQxwaUYGfCgYwb8xylcHQF_qvn6eZ9A9vv9.6l_8lxzfFtyQlg7e Ro9I.DYQNLXH6zRG4sD6_RfC.0VzVVc8A.MqUlZGOZqzZj7e7jbi6DdTSsXaAh7LXkKpzMn1Rv.4 7trngds0Qu4ISaLoLSVSAJs4tboxuYXmMHi4d.M0u7LpCgJJFljdaUh4_wF1tDeDbfnziNkcg45Z tPQWbIMed08oiJu5J5W.GuWj7GM_DbmVS5kEfyPond7xdlVEbCt6cU_IHyak2qdIDtParDNl0FXQ Ox0oQvfm8bgr2pSLYTfpFbORG29vuZcB3FyEyug7sglMOIRvqrPcO8_80IHMZKw1BV7unjPXzzMz rrzhIEbZzqLKAvfA4GQ6ZI_agin4sQ6AaTjNRlLq9KLERLCEd4yzw5CPtqRp1gx0GjBNTH5Cir0A s_V1tWsXHPgQvMb.DYfyVKeDUod8TLG5jj5.PXoGdC_hKnszeiErrnjbS1Kp4SQdVa6OHPXoGCK6 UQtLK3YlbNbl5dnmrvQHKlMZFgyzMjXs6NyrU0vEqeedjISkO6S075dPAI1KcjmT5nhxxk3qHrkm daDHU29OKgBeEnLQFPr7.VDFMNi3T09lktDSkpr4v5Guzlct0b.Li3f68SMNDQFLsTT4b_sHP5jV xh.7u7ewHd3otZMfwJnF2QKh2NEBhY9VJsqQ18q6f9X1PtIJn.MwVH0V2ISuPKsnmIx6VBs0EzNT tePigwEzCNmsm3L9jmDO9aqs8kUYLPgQEvOVflunwW49QYx2p_5wC2VF.SbNOcigixn1T00HiMgT 3fJWoydKnTZoQJzJRjeQ7z.nnS7O_tKybp83vDI9v5CwbGQR2iPeULpejXXN3LHx_dizoXxERZeS Z8aAQvCGW6__IpOLL X-Sonic-MF: X-Sonic-ID: b3d737c3-4961-4965-aacd-456482b901e9 Received: from sonic.gate.mail.ne1.yahoo.com by sonic306.consmr.mail.gq1.yahoo.com with HTTP; Tue, 26 Nov 2024 02:05:24 +0000 Received: by hermes--production-gq1-5dd4b47f46-n48bg (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 1b1fcf937bee5059b4da103627d27a30; Tue, 26 Nov 2024 02:05:22 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3776.700.51.11.1\)) Subject: Re: port binary dumping core on recent head in poudriere From: Mark Millard In-Reply-To: Date: Mon, 25 Nov 2024 18:05:12 -0800 Cc: ports@freebsd.org, FreeBSD Current Content-Transfer-Encoding: quoted-printable Message-Id: References: <46E3A370-A3E0-4BAF-B707-87F94F98E248@FreeBSD.org> <5ee47c3d-f80e-4d50-9b6a-acb3c98e80e0@madpilot.net> <7c9c3cf5-bbd1-4642-8d04-33aa07a4db02@madpilot.net> <9df256a8-c6ed-46d9-b955-fc2657c12d36@madpilot.net> <5c502054-7353-4a1e-8350-c403482e9c0d@madpilot.net> <3127C3BA-FC93-4636-ADDB-89518DE9C60D@FreeBSD.org> <86ed2zsp6l.fsf@ltc.des.dev> <5f24a570-26e0-4c0a-817f-591a234fd07b@madpilot.net> <5918C6A1-8FDB-40CA-8C86-EB7B7BE75A2E@yahoo.com> <86ed2zc8r5.fsf@ltc.des.dev> <45098ccf-4dc6-426c-849a-c923805d6723@madpilot.net> <38658C0D-CA33-4010-BBE1-E68D253A3DF7@FreeBSD.org> <1004a753-9a3c-4aa2-bfa8-4a0c471fe3ea@madpilot.net> To: Guido Falsi , Dimitry Andric , =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= , Yasuhiro Kimura X-Mailer: Apple Mail (2.3776.700.51.11.1) X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.84:from]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; FROM_HAS_DN(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCPT_COUNT_FIVE(0.00)[6]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.84:from]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim] X-Rspamd-Queue-Id: 4Xy5WW02Drz3wtK X-Spamd-Bar: --- Top posting going in a different direction that established a way to control the behavior in my context . . . I changed USE_TMPFS=3Dall to USE_TMPFS=3Dno : USE_TMPFS=3Dall gets the failure vs. USE_TMPFS=3Dno works just fine So it is a FreeBSD system error associated with use of tmpfs . Now back to what I looked at before trying the above . . . On Nov 25, 2024, at 17:05, Mark Millard wrote: > On Nov 25, 2024, at 15:21, Mark Millard wrote: >=20 >> On Nov 25, 2024, at 14:23, Guido Falsi wrote: >>=20 >>> On 25/11/24 23:15, Dimitry Andric wrote: >>>> On 25 Nov 2024, at 23:12, Mark Millard wrote: >>>>>=20 >>>>> On Nov 25, 2024, at 13:27, Guido Falsi wrote: >>>>>=20 >>>>>> On 25/11/24 22:18, Dag-Erling Sm=C3=B8rgrav wrote: >>>>>>> Mark Millard writes: >>>>>>>> Guido Falsi writes: >>>>>>>>> On 25/11/24 09:17, Dag-Erling Sm=C3=B8rgrav wrote: >>>>>>>>>> Dimitry Andric writes: >>>>>>>>>>> Probably best to create a bugzilla ticket, but as I said = before, I >>>>>>>>>>> cannot reproduce this. >>>>>>>>>> I can. My builder is running 15 and sees segfaults while = building >>>>>>>>>> packages for 14 and 15 but not for 13. >>>>>>>>> BTW removing optimizations (CPUTYPE) for only the affected = ports made >>>>>>>>> guile2 work again. Did not solve the issue with sassc though. = [...] >>>>>>>>> I'm also using ccache, but that does not look relevant. >>>>>>>> I've never used ccache or analogous and get the = libsass.so.1.0.0 >>>>>>>> .got.plt corruption that I've reported on the lists anyway. >>>>>>> I don't use ccache or optimizations. Here's an example of sassc >>>>>>> segfaulting in a 14.1-RELEASE-p6 jail: >>>>>>> = https://pkg.des.dev/logs/data/14amd64-default/2024-11-24_19h29m04s/logs/er= rors/plasma5-breeze-gtk-5.27.11.log >>>>>>> which matches the following entry from `/var/log/messages`: >>>>>>> Nov 24 21:23:06 pkg kernel: pid 71277 (sassc), jid 253, uid = 65534: exited on signal 11 (core dumped) >>>>>>> The poudriere host is a bhyve VM with 48 cores and 192 GB RAM on = a >>>>>>> 32c/64t AMD EPYC 7502P with 256 GB RAM. >>>>>>=20 >>>>>> I sincerely hope this is not relevant but my CPU is also AMD: AMD = Ryzen 5 5600G >>>>>=20 >>>>> The amd64 system type that I have access to and used >>>>> for my testing: >>>>>=20 >>>>> AMD 7950X3D (16 core, 32 thread, so 32 FreeBSD-cpus) with 192 = GiBytes of RAM >>>> I'm on Intel, and I don't see any crashes at all. So, are we = looking at some CPU specific issue here? >>>=20 >>> We can't say for sure, but we definitely have all people reporting = the issue on the same CPU brand, so it's some indication I guess. >>>=20 >>> I was hoping it would not come to this because I suspect such issues = are quite difficult to diagnose. >>=20 >> Unfortunately, for amd64 I only have access to: >>=20 >> ) An old ThreadRipper 1950X system (untested so far) >> ) The 7950X3D system >>=20 >> No Intel systems. >>=20 >> If someone had both AMD and Intel and could have >> boot&operate media that should work for both, say >> USB that can be simply moved between machines, >> running test on both would be appropriate. >> (Implication: the media not being tailored to the >> cpu specifics so the same system software is >> tested in both places.) >>=20 >> I'll note that the media in my context is PCIe Optane, >> ZFS based. I could try a U.2 Optane in a PCIe adaptor >> that has UFS instead for building textproc/libsass . >> (The U.2 content is an basically a rsync of the ZFS >> Optane media's live directory tree, with node naming >> and such adjusted afterwards.) >>=20 >> What do other folks have for the file system(s) >> involved? >=20 > I get the sassc failure from a a pure UFS live-context as > well. >=20 > Interestingly, there is variation in the .got.plt oddity. >=20 > Earlier: >=20 > Bad .got.plt: >=20 > Contents of section .got.plt: > 2bed60 00000000 00000000 00000000 00000000 ................ > . . . > 2befc0 00000000 00000000 00000000 00000000 ................ > 2befd0 00000000 00000000 00000000 00000000 ................ > 2befe0 00000000 00000000 00000000 00000000 ................ > 2beff0 00000000 00000000 00000000 00000000 ................ > 2bf000 96ab2a00 00000000 a6ab2a00 00000000 ..*.......*..... > 2bf010 b6ab2a00 00000000 c6ab2a00 00000000 ..*.......*..... > 2bf020 d6ab2a00 00000000 e6ab2a00 00000000 ..*.......*..... > 2bf030 f6ab2a00 00000000 06ac2a00 00000000 ..*.......*..... > . . . Interestingly, a later retest of the ZFS context did not get the above. Instead it ended up like the below bad case. I'll also note that scrubbing reports: # zpool status pool: zoptb state: ONLINE scan: scrub repaired 0B in 00:00:47 with 0 errors on Mon Nov 25 = 17:50:44 2024 config: NAME STATE READ WRITE CKSUM zoptb ONLINE 0 0 0 gpt/OptBzfs ONLINE 0 0 0 errors: No known data errors This should mean that the unexpected zeros were present before zfs did its checksum prior to writing the data. > The new bad .got.plt ended up with a bigger zero area, > the nonzero area again being nicely aligned for where > it starts. (The .got.plt starts at the same address > as above.) >=20 > Contents of section .got.plt: > 2bed60 00000000 00000000 00000000 00000000 ................ > . . . > 2befc0 00000000 00000000 00000000 00000000 ................ > 2befd0 00000000 00000000 00000000 00000000 ................ > 2befe0 00000000 00000000 00000000 00000000 ................ > 2beff0 00000000 00000000 00000000 00000000 ................ > 2bf000 00000000 00000000 00000000 00000000 ................ > 2bf010 00000000 00000000 00000000 00000000 ................ > 2bf020 00000000 00000000 00000000 00000000 ................ > 2bf030 00000000 00000000 00000000 00000000 ................ > . . . > 2bffc0 00000000 00000000 00000000 00000000 ................ > 2bffd0 00000000 00000000 00000000 00000000 ................ > 2bffe0 00000000 00000000 00000000 00000000 ................ > 2bfff0 00000000 00000000 00000000 00000000 ................ > 2c0000 96cb2a00 00000000 a6cb2a00 00000000 ..*.......*..... > 2c0010 b6cb2a00 00000000 c6cb2a00 00000000 ..*.......*..... > 2c0020 d6cb2a00 00000000 e6cb2a00 00000000 ..*.......*..... > 2c0030 f6cb2a00 00000000 06cc2a00 00000000 ..*.......*..... > . . . >=20 Adding the comparison of the good .got.plt from the PkgBase based chroot with the official packages installed: Contents of section .got.plt: 2bed60 78ba2b00 00000000 00000000 00000000 x.+............. 2bed70 00000000 00000000 86a62a00 00000000 ..........*..... 2bed80 96a62a00 00000000 a6a62a00 00000000 ..*.......*..... 2bed90 b6a62a00 00000000 c6a62a00 00000000 ..*.......*..... . . . 2befc0 16ab2a00 00000000 26ab2a00 00000000 ..*.....&.*..... 2befd0 36ab2a00 00000000 46ab2a00 00000000 6.*.....F.*..... 2befe0 56ab2a00 00000000 66ab2a00 00000000 V.*.....f.*..... 2beff0 76ab2a00 00000000 86ab2a00 00000000 v.*.......*..... 2bf000 96ab2a00 00000000 a6ab2a00 00000000 ..*.......*..... 2bf010 b6ab2a00 00000000 c6ab2a00 00000000 ..*.......*..... 2bf020 d6ab2a00 00000000 e6ab2a00 00000000 ..*.......*..... 2bf030 f6ab2a00 00000000 06ac2a00 00000000 ..*.......*..... . . . 2bffc0 16cb2a00 00000000 26cb2a00 00000000 ..*.....&.*..... 2bffd0 36cb2a00 00000000 46cb2a00 00000000 6.*.....F.*..... 2bffe0 56cb2a00 00000000 66cb2a00 00000000 V.*.....f.*..... 2bfff0 76cb2a00 00000000 86cb2a00 00000000 v.*.......*..... 2c0000 96cb2a00 00000000 a6cb2a00 00000000 ..*.......*..... 2c0010 b6cb2a00 00000000 c6cb2a00 00000000 ..*.......*..... 2c0020 d6cb2a00 00000000 e6cb2a00 00000000 ..*.......*..... 2c0030 f6cb2a00 00000000 06cc2a00 00000000 ..*.......*..... . . . The contents of the non-zero parts of any pair of the examples agree. =3D=3D=3D Mark Millard marklmi at yahoo.com