From nobody Wed May 15 00:18:39 2024 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VfDNZ5Nqsz5LGBS for ; Wed, 15 May 2024 00:18:54 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: from mail-pg1-x52a.google.com (mail-pg1-x52a.google.com [IPv6:2607:f8b0:4864:20::52a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VfDNZ207sz4lDN; Wed, 15 May 2024 00:18:54 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=FnDKU4Mz; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of yaneurabeya@gmail.com designates 2607:f8b0:4864:20::52a as permitted sender) smtp.mailfrom=yaneurabeya@gmail.com Received: by mail-pg1-x52a.google.com with SMTP id 41be03b00d2f7-6123726725eso5020677a12.3; Tue, 14 May 2024 17:18:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1715732332; x=1716337132; darn=freebsd.org; h=to:references:message-id:cc:date:in-reply-to:from:subject :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=+3lUVVIua06rEXB8UojGKTFU3hEcLdYanGOGbCFw5S0=; b=FnDKU4MzilKipX/AUNHQjk+qQlUVNsiTdVwNh3fgAKAuvpGpkmgIq1L8bx2JnPGLq9 Mp1K9ZpiFYcSFXcej0TOrHtyT8LTa8Kh1+2wjxUI0GdJ4spfsSbZN/GG+LIK2W0mQKFg 5sjfVvhwNw+4YUqOJp5T9wGTjbQrNyIybP2hs9SIvkDCy2wAAmfZmJGbdCbpDb0JeiQl 61TAOOpPJ/mLwtuszDJuxbt3NSM/8kg9hkDUmZDHUQroxUtsCeJ5ujL7BEAGprffrhvO WJfr5y3h+3p+LABi1CFy0WK4K0BsGM+w4iXUcZYLrfRWrqNSVgmy+1OYHAl6jfJE3TcD NzxQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1715732332; x=1716337132; h=to:references:message-id:cc:date:in-reply-to:from:subject :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=+3lUVVIua06rEXB8UojGKTFU3hEcLdYanGOGbCFw5S0=; b=TCUtsogY/zT4porzKqtuTPSbPSy5Yp++M2R7XGtJaUSjvqJeYmc74K9XtdzTssEwl1 WthZ26EuISfNIyr1fdw1VgRFj0JH2oS4BOgMdiTjRyJdBVZhZmpsd5yHea/Bur2lSs/C qFx7do9t5Q9f9vuVhocFvKVHG9Xp1bnLDwjBWHUcnF6ga6ZE8Fm2gjSH0VrNIU8ZPaot pKIpMnpRHxh0MEYLHBSUYii0OSL0wEExrLOlN66p+h7WFBU5hKZXiGWTK+OXD1hIpaQ5 2H7OV1s4UOe24CPB52gGIwPtjKvcWhs5T1ce8QZilDjMueia6WUIIpYkkE5joFrtHE8R do4Q== X-Forwarded-Encrypted: i=1; AJvYcCWhwIoSZYvpyxsoK+OtVuoH43vrIyX1EWUocyJbmXiQCyi52P3s8Y4q0r+OZshBgq+vXtBQZ2BQcZJTayuEOhLUhqFd8J0P4HQFPIM= X-Gm-Message-State: AOJu0YyLBwTFTN+trsZjq55ukdBvfrrd/jDsfpODtV84uNaBUlltYHPH okNkLDpD4CLhYzlJPcfY5XpEztp2svytk9yTiYxBVCMzMWXggKKvhvtNXw== X-Google-Smtp-Source: AGHT+IHDJTBslozwbCuWNaZIhhTW2+I8JGx9E9YLvk7+QW3uVwOYwTVJa9qjppocYc0nDfWqSik7LA== X-Received: by 2002:a17:90a:eb07:b0:2b4:3659:b3f5 with SMTP id 98e67ed59e1d1-2b6ccd886efmr9783635a91.47.1715732331669; Tue, 14 May 2024 17:18:51 -0700 (PDT) Received: from smtpclient.apple ([162.118.1.182]) by smtp.gmail.com with ESMTPSA id 98e67ed59e1d1-2b62886b5cesm12271032a91.26.2024.05.14.17.18.50 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 14 May 2024 17:18:50 -0700 (PDT) Content-Type: multipart/signed; boundary="Apple-Mail=_02171A0C-E809-4575-8036-FCE18037610D"; protocol="application/pgp-signature"; micalg=pgp-sha256 List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.500.171.1.1\)) Subject: Re: How to run tests without installing? From: Enji Cooper In-Reply-To: Date: Tue, 14 May 2024 17:18:39 -0700 Cc: Christian Weisgerber , freebsd-hackers@freebsd.org Message-Id: References: To: Brooks Davis X-Mailer: Apple Mail (2.3774.500.171.1.1) X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.01 / 15.00]; SIGNED_PGP(-2.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.41)[-0.414]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; TO_DN_SOME(0.00)[]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FREEMAIL_FROM(0.00)[gmail.com]; DKIM_TRACE(0.00)[gmail.com:+]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCPT_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; HAS_ATTACHMENT(0.00)[]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::52a:from]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-Rspamd-Queue-Id: 4VfDNZ207sz4lDN --Apple-Mail=_02171A0C-E809-4575-8036-FCE18037610D Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On Apr 29, 2024, at 1:47=E2=80=AFPM, Brooks Davis = wrote: >=20 > On Mon, Apr 29, 2024 at 12:34:51PM +0200, Christian Weisgerber wrote: >> How can I run the regression tests on my work-in-progress without >> installing it first? >>=20 >> Say I'm changing something in sh. Can I run the tests on the >> compiled sh in /usr/obj, without having to install my potentially >> broken work into the system? Running "make tests" in src/bin/sh >> doesn't seem to actually test anything. >=20 > Generally speaking you can't. This is one of the problematic things > about the current test framework. The best you can do for something > like sh where you really don't want to install a broken one is = probably > installing in a jail and running tests there. Try =E2=80=9Cmake check MK_MAKE_CHECK_USE_SANDBOX=3Dyes -DNO_ROOT=E2=80=9D= . It=E2=80=99s not perfect, but it might do what you want without = breaking your system. Cheers, -Enji= --Apple-Mail=_02171A0C-E809-4575-8036-FCE18037610D Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEkHfexGRJ3gYRdA2gGpE5DjPsNJgFAmZD/18ACgkQGpE5DjPs NJi0LBAAis1MzHG1LoKi+9iN73r/uiU3QS1OyWq0qBt3Ygbb8GmUHhJRakWFEBIZ n1ckcga0rPyjAlmTAO4rZ+2+nH/clHRT/p5Irq+b9YmqehTX3TY7BSNguzzopUF6 e510MwD2RUtIVNLkSkEgWCZ8gksH2GCHOqhDL7ZGDPSkQuE56DX76h+KSkctPI6z DdV7jnQGLGqv4eRd/Z9WF6IjhieqtPr9KJmMZ7If7WjOJanazWc2GiWFJGsyFTqW JVQXjPwLaW2yUPh19iuG2GziyZxDjpaz8dM5e5gT+2VVS6Uv4VPypp4FBp1ToJTL WSZ+TudyRGHscRi4luMybalEyRYCx2Bb3JUKNdyJpJruqKytvAIHvfHifvxdIYJy wfKqODSF2v9Fw6O1z2h7lSsxtjWdQfRc6gsChoNLTOUgVDDkvQJ7NKl2XS7FLKAH RKjyQSaMhBVyTAnAsboT+mbZO7xkyLdm4D1ahSgqMVdqT1rrXbBwBMOr6HtdgLoP xWNDi+fd0Bhhh5XJLBT3OtXo3hX57H6tkB5gm6qG3haO5v30gHUaA3tCf9lqTIPk sZ180xTAcBrRoLXMoFOTR+yeYIkbbIFpezE+Ko8Qb6Vq+PeW+uLBw/FClS1fSm8x Qzem56b22d8RoP2aRaxrPUGpzvbetGESiRTVVAe0dppvkFdobTY= =7mX7 -----END PGP SIGNATURE----- --Apple-Mail=_02171A0C-E809-4575-8036-FCE18037610D--