From nobody Fri Apr 21 21:37:08 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Q37DB6HxYz46wLb; Fri, 21 Apr 2023 21:37:46 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-yb1-xb33.google.com (mail-yb1-xb33.google.com [IPv6:2607:f8b0:4864:20::b33]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Q37D94l2Mz45kR; Fri, 21 Apr 2023 21:37:45 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b="FSYY/Vkp"; spf=pass (mx1.freebsd.org: domain of marietto2008@gmail.com designates 2607:f8b0:4864:20::b33 as permitted sender) smtp.mailfrom=marietto2008@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-yb1-xb33.google.com with SMTP id 3f1490d57ef6-b92284f69ebso2893865276.3; Fri, 21 Apr 2023 14:37:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1682113064; x=1684705064; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=ghVmaqj7PTYJVEgmfrths/ch0MdNroWIQKDqup+a4jM=; b=FSYY/VkpKHZcOaIHaQDNKkwk25gpqMNp25Z7ECFpUyj5aPdcU4kiFzNEtVhVMd8r/o eaUDMN/lASDJ9w8Spdxy2iwBuU7Y/OBVYezzoS1jr/M9r4yJjYKiH/0qyO9sEyCiByuL mRJ/GMrC3ZwT1Bf2xWskrLGQBiEZ/GnL+Bd77JRlLT9vBIsiM+LwcbTLHW13UWZ0Kcdn iLGMSAZ7FqB0xwPKnVmq8O67sFi+MJYPCv7VgpjabCrniINv2tuZJwo9JWJvLKrWokKn DGzmUyyocHmnL++LPCPK55d0bRM1bck2dMLKlSz1n3mM5cpnuNQXTEuQ8nD73fjjBzpv 9voQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1682113064; x=1684705064; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=ghVmaqj7PTYJVEgmfrths/ch0MdNroWIQKDqup+a4jM=; b=hl3d7bBJRT9IC/cXudSHB7WeCnt03K8/dkHeNOZe/cMUFFzF/C7VRaITNE9/c7mXWO tStMXQscr9P/QdfWcxw9d4Nvka2p5O1Im/elC7YWRNlqqGP2B/dOuW86T0AHeIaSeZ2U OFxUY7/nWHswTYreHmGab/HDXVFqajgm8dPzidilVAES3GfSmUmsv8sPPrbsoQMtjSHq vwi+WEA+4mUMgr4zQA4aFq313FlVxwSHgVMuJ0T0q48ATSkm78+YGB+MDgax90a2aXkr ho2/awDyhlDZkpH4vejMByVQE4ri5F6I+Hk1q2rDDie592b+DXoXUroib5SYhDhmmFQX PWqg== X-Gm-Message-State: AAQBX9eGk5/ywPWUGd87uh8rTTxLhVl3xpc3Yfm+UV0HbJsQ81xnHJ2f 5p5iy1AE3iaRAzVtJ/GyTjtOVg5qNOrZOZyhAv4= X-Google-Smtp-Source: AKy350b7Z0tKp5vEkuNQrGFjUFI23bJLkvpvoEWswNJNr4AdzufyGe9M8garQKnFTi9ieIm1g5kEl8IwihtgDYFGdRY= X-Received: by 2002:a25:3252:0:b0:b8f:60cf:18cc with SMTP id y79-20020a253252000000b00b8f60cf18ccmr3863564yby.23.1682113064469; Fri, 21 Apr 2023 14:37:44 -0700 (PDT) List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 References: <20230421134120.GA12251@darkbeer.org> In-Reply-To: From: Mario Marietto Date: Fri, 21 Apr 2023 23:37:08 +0200 Message-ID: Subject: Re: Installing openAI's GPT-2 Ada AI Language Model To: Aryeh Friedman Cc: questions@freebsd.org, FreeBSD Mailing List Content-Type: multipart/alternative; boundary="000000000000ae0bba05f9df7784" X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.997]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TAGGED_RCPT(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::b33:from]; ARC_NA(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MLMMJ_DEST(0.00)[questions@freebsd.org,freebsd-hackers@freebsd.org]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4Q37D94l2Mz45kR X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N --000000000000ae0bba05f9df7784 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable 1) try to use the linuxulator instead of bhyve (try to remember what Albert Einstein tells about those people that want to solve a problem without changing their perspective : he does not spend nice words for those people) 2) actually an nvidia gpu can be passed-thru within linux (and within windows 11 if the gpu is amd) 3) the tutorial that we are suggesting may work even if you don't want to use your gpu 4) probably you should find the exact version of pytorch that it wants On Fri, Apr 21, 2023 at 10:34=E2=80=AFPM Aryeh Friedman wrote: > On Fri, Apr 21, 2023 at 9:41=E2=80=AFAM Amar Takhar w= rote: > > > > I have a tutorial I wrote on how to setup PyTorch on FreeBSD with Stabl= e > > Diffusion. > > > > https://github.com/verm/freebsd-stable-diffusion > > Thanks for the pointer but it assumes I have a (nvidia) GPU available. > Since this is a VM on bhyve there is no currently working GPU > passthrough for it. (I do use a nVidia Geforce GT 1030 with > nvidia-modeselect but it is not passable to the VM and due to hardware > resources don't have a physical machine I can assign to the task). > > I have gotten as far as the part in the blog as installing pyTorch and > keep getting "no compatible versions found" out of pip and when I > search for any suitable ones it seems to not be there. Thus I have > to revert to building pytorch from scratch and it blows up because the > host/guest CPU is not Intel. > > > > > There are some issues with getting PyTorch working on FreeBSD and it's > kind of a > > moving target I had it working once but it quickly broke this was years > ago > > using the Linuxlator it's been rock solid for years. > > > > Another thing to note is the miniconda-installer script is hardcoded to > an old > > version of Python you'll have to edit line 56 in the script and change > it to 3.9 > > or 3.10. Not sure what to do about this yet I haven't had a chance to > email the > > maintainer. > > > > I'd recommend going this route. > > > > > > Amar. > > > > > -- > Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org > > --=20 Mario. --000000000000ae0bba05f9df7784 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
1) try to use the linuxulator instead of bhyve (try t= o remember what Albert Einstein tells about those people that want to solve= a problem without changing their perspective : he does not spend nice word= s for those people)

2) actually an nvidia gpu = can be passed-thru within linux (and within windows 11 if the gpu is amd)

3) the tutorial that we are suggesting may work eve= n if you don't want to use your gpu

4) probabl= y you should find the exact version of pytorch that it wants
=

On Fri, Apr 21, 2023 at 10:34=E2=80=AFPM Aryeh Friedman <aryeh.friedman@gmail.com> wro= te:
On Fri, Apr = 21, 2023 at 9:41=E2=80=AFAM Amar Takhar <verm@darkbeer.org> wrote:
>
> I have a tutorial I wrote on how to setup PyTorch on FreeBSD with Stab= le
> Diffusion.
>
>=C2=A0 =C2=A0https://github.com/verm/freebsd-sta= ble-diffusion

Thanks for the pointer but it assumes I have a (nvidia) GPU available.
=C2=A0 Since this is a VM on bhyve there is no currently working GPU
passthrough for it.=C2=A0 (I do use a nVidia Geforce GT 1030 with
nvidia-modeselect but it is not passable to the VM and due to hardware
resources don't have a physical machine I can assign to the task).

I have gotten as far as the part in the blog as installing pyTorch and
keep getting "no compatible versions found" out of pip and when I=
search for any suitable ones it seems to not be there.=C2=A0 =C2=A0Thus I h= ave
to revert to building pytorch from scratch and it blows up because the
host/guest CPU is not Intel.

>
> There are some issues with getting PyTorch working on FreeBSD and it&#= 39;s kind of a
> moving target I had it working once but it quickly broke this was year= s ago
> using the Linuxlator it's been rock solid for years.
>
> Another thing to note is the miniconda-installer script is hardcoded t= o an old
> version of Python you'll have to edit line 56 in the script and ch= ange it to 3.9
> or 3.10.=C2=A0 Not sure what to do about this yet I haven't had a = chance to email the
> maintainer.
>
> I'd recommend going this route.
>
>
> Amar.
>


--
Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org



--
Mario.
--000000000000ae0bba05f9df7784--