From nobody Sat Jul 03 18:25:46 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 77DEF11D9FD0; Sat, 3 Jul 2021 18:25:46 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (www.zefox.net [50.1.20.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "www.zefox.com", Issuer "www.zefox.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4GHL3t1TBNz4Vp1; Sat, 3 Jul 2021 18:25:45 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (localhost [127.0.0.1]) by www.zefox.net (8.16.1/8.15.2) with ESMTPS id 163IPlLj018148 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sat, 3 Jul 2021 11:25:47 -0700 (PDT) (envelope-from fbsd@www.zefox.net) Received: (from fbsd@localhost) by www.zefox.net (8.16.1/8.15.2/Submit) id 163IPlpF018147; Sat, 3 Jul 2021 11:25:47 -0700 (PDT) (envelope-from fbsd) Date: Sat, 3 Jul 2021 11:25:46 -0700 From: bob prohaska To: Mark Millard Cc: FreeBSD ports , freebsd-arm , FreeBSD Toolchain Subject: Re: llvm10 build failure on Rpi3 Message-ID: <20210703182546.GA17871@www.zefox.net> References: <5A26965D-2DFD-4A46-A171-A382A61E3CFB@yahoo.com> <20210626035234.GA18893@www.zefox.net> <43513842-6FC0-4A89-8F0C-9EB2B328A5ED@yahoo.com> <9CFE71E2-23C3-4072-A8AD-74EDB339A146@yahoo.com> <60EEFD09-97DE-4B4F-BAFD-61B96EF60E27@yahoo.com> <77A35ACF-275F-44C8-AEEE-4EFE5B5CBEA4@yahoo.com> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <77A35ACF-275F-44C8-AEEE-4EFE5B5CBEA4@yahoo.com> X-Rspamd-Queue-Id: 4GHL3t1TBNz4Vp1 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N > >> On 2021-Jul-2, at 19:23, Mark Millard wrote: > > > >>> Side note: > >>> > >>> It llooks like http://www.zefox.org/~bob/swaplogs/poudrierellvm10.log > >>> shows that you tried with: > >>> > >>> Device 1K-blocks Used Avail Capacity > >>> /dev/da0s2b 1048576 25784 1022792 2% > >>> /dev/mmcsd0s2b 1048576 25124 1023452 2% > >>> Total 2097152 50908 2046244 2% > >>> [hope the quotes are right!] That's correct. The sequence of experiments ran something like this: The Pi3 was configured with a a pair of ~3 GB swap partitions, one on microSD, the other on the 1 TB mechanical hard disk. Make was not limited in the number of jobs it could parallel. OOMA was restrained by putting vm.pageout_oom_seq="4096" vm.pfault_oom_attempts="20" in /boot/loader.conf The usual "excessive swap" warnings were presented during boot and ignored by me. Worlds and kernels built wtihout trouble, so I tried building www/chromium using poudriere. It stopped in /devel/llvm10 with the "expected expression" error and continued to stop there despite updating /usr/ports several times. At no time were there any hints of swap problems. Resorting to a GENERIC self-hosted kernel made no difference. /usr/src was not tampered with. Eventually I resorted to running make in devel/llvm10, to my surprise it ran to completion. It also ran make package successfully. Again I tried to build just devel/llvm10 using poudriere, again getting "expected expression". At that point I resized the swap partitions to 1 GB each and tried poudriere on devel/llvm10. That got rid of the excessive swap warnings, but didn't help. Finally I placed MAKE_JOBS_NUMBER=2 in /usr/local/etc/poudriere.d/make.conf and tried again. That still failed, still with "expected expression". Since devel/llvm10 had created a package successfully, I tried slipping a copy into poudriere's package directory, hoping it would find and use the package to make further progress. Unfortunately, poudriere seems to remember the failure and won't use the proffered package. It's still running, on lang/spidermoneky78. There were no reboots between experiments. My first suspicion is that I've somehow screwed up the poudriere setup, perhaps by a fumbled execution of poudriere jail -u, which I mistakenly thought was needed after updating /usr/ports. The fact that the stoppage reported looks like a syntax error specific to devel/llmv10 which is unaffected by swap pressure makes it seem unrelated to kernel or swap constraints. AIUI, the hardware of the Pi4 is considerably different from the Pi3 in terms of memory management, noted from an interview with Eben Upton on YouTube. He didn't go into any detail. Whether that's relevant is unclear to me, but it does suggest the Pi4, even with restricted memory, won't behave like a Pi3. Is there any sort of sanity test for the poudriere system? If I delete and re-create the existing jail can the existing package library be preserved and re-used? If not, that's OK, I'd just like to know beforehand. Thanks for reading, and all your help! bob prohaska