From nobody Thu Apr 20 10:48:10 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Q2Dss3Vbvz46f8g; Thu, 20 Apr 2023 10:48:49 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-yw1-x1132.google.com (mail-yw1-x1132.google.com [IPv6:2607:f8b0:4864:20::1132]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Q2Dsq6p1dz4ksc; Thu, 20 Apr 2023 10:48:47 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b=NOLlJYEw; spf=pass (mx1.freebsd.org: domain of marietto2008@gmail.com designates 2607:f8b0:4864:20::1132 as permitted sender) smtp.mailfrom=marietto2008@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-yw1-x1132.google.com with SMTP id 00721157ae682-54fa9da5e5bso35442087b3.1; Thu, 20 Apr 2023 03:48:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1681987727; x=1684579727; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=xjYTZxVKpXifYUodVCs4kGCQnq7SZlGuaiY3sDQIyw0=; b=NOLlJYEwWH5xlU0XNKMop5Rt/P5CTyUGVMsHet6BByMmh3QLHJdyWO+loPUYzqoTv2 t1mWmgcps6tnnhvSrVtHe8uKAeMo6g0AL9/vggij8W15/3gw1LmWmlQSiM1aBhxFBxTW JdKe0Fa0UWM/r2FEtzZo1Pu0lacOmT0b7ztk35++zXn4MuV+h3x2MuhHOcxptxw1pZXv u+H8ljA5XeBTq6x5dzwpLmx+v5gQIGzdR3MHURAzOAx5bOvtXqqMRp2svypKaoVo8bZw mQRcLOX4m7IJXQgJ2loXCHSbMpH0zCG61t+YnbHwt77+r6Gmv0WSuF6KwbEJf9kXopno Adnw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1681987727; x=1684579727; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=xjYTZxVKpXifYUodVCs4kGCQnq7SZlGuaiY3sDQIyw0=; b=Fl5fxC0V2tiyXb6JdetGVubR6RVIT5dwy0hjhaTU65gEnUKAd+ESl/o8sXcOKN1Tfu Gssn0upWrEEA46FC+9TBXlI9dRj4uvP1dDSRbkwsjd0LsVLa1KcBO7qCUwbHCuzK1N8o pvFK+gxx5sOZpkPufNaHJRAGlINxYMir8lOIi/DnWbAXUxFibLa9uk7YIupPIhE/uRGC oGYI7QR8KPnjw5nR/56ha6jnS+Zi4F5QNu9LbO+9OSS0EZLG9bjW0KCo69UwIC9IUbpY dJ+Ds0UZ+roKCdzpqMxSlDJEByBP+REMIVqKvU6oTqck67wQpGHuLndUiblqIS217khu 1TWQ== X-Gm-Message-State: AAQBX9elbbO8RvTtSDilRxu0qKFGEVekvwv/MDNB3QcWyB61eNwYXLp1 O2jzG1Gi0PR1v4fOG6QuZDAybWfVVQ/wK6OxGI3fL8cX/oDS8w== X-Google-Smtp-Source: AKy350ZjFnGrfKgoVtkxBRimhlIJP1KUj7kmlZZWA87eCr9xvMXQroWKAcjXeZbUl4c4XVkVobsuT5mOXvdSLoXkAgs= X-Received: by 2002:a0d:f245:0:b0:54c:272b:ee42 with SMTP id b66-20020a0df245000000b0054c272bee42mr387878ywf.48.1681987726647; Thu, 20 Apr 2023 03:48:46 -0700 (PDT) List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Mario Marietto Date: Thu, 20 Apr 2023 12:48:10 +0200 Message-ID: Subject: Re: Installing openAI's GPT-2 Ada AI Language Model To: Aryeh Friedman Cc: FreeBSD Mailing List , FreeBSD Mailing List Content-Type: multipart/alternative; boundary="000000000000f6a6df05f9c24884" X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TAGGED_RCPT(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::1132:from]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org,freebsd-questions@freebsd.org]; DKIM_TRACE(0.00)[gmail.com:+]; TO_DN_ALL(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; FREEMAIL_TO(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4Q2Dsq6p1dz4ksc X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N --000000000000f6a6df05f9c24884 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable This is a tutorial that I've written some time ago and that can help you to achieve your goal with some tinkering : https://www.reddit.com/r/freebsd/comments/1118eae/how_to_install_the_nvidia= _driver_5257801_cuda_12/ On Thu, Apr 20, 2023 at 12:23=E2=80=AFPM Aryeh Friedman wrote: > On Thu, Apr 20, 2023 at 6:14=E2=80=AFAM Mario Marietto > wrote: > > > > I'm interested in installing fastGPT / vicuna on FreeBSD. Is the Ada > Language model good ? Can you provide the instructions for installing it = on > Linux ? I need them to try to install it on FreeBSD. > > I have not been able to try it yet because I am still attempting to > get *ANY* model to work in anyway shape or form on FreeBSD. Do you > have any pointers on this (I don't care what language it is in).... > everything comes to screeching halt when I try to get pytorch to run > (doesn't build on freebsd or on alpine linux, ubuntu, centos, all > don't work on byhve it seems)... then I tried to get tensor flow to > run with no luck... so the question remains how the do I get > any ANN model to run?!?!? > > > > > On Thu, Apr 20, 2023 at 1:06=E2=80=AFAM Aryeh Friedman > wrote: > >> > >> I am attempting get the "Ada language model" that is available via > >> their API to run locally (chatGPT says all the packages needed > >> packages will run but as soon I finish installing pytorch it fails to > >> import torch)... this is a on 13.2 VM designed specifically for this > >> purpose and I have deinstalled all non-base system stuff from it. So > >> what are the right steps? > >> > >> -- > >> Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org > >> > > > > > > -- > > Mario. > > > > -- > Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org > --=20 Mario. --000000000000f6a6df05f9c24884 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
This is a tutorial that I've written some time ag= o and that can help you to achieve your goal with some tinkering :


On Thu, Apr 20, 2023 at 12:23=E2=80=AFPM Aryeh Friedman <aryeh.friedman@gmail.com> = wrote:
On Thu, A= pr 20, 2023 at 6:14=E2=80=AFAM Mario Marietto <marietto2008@gmail.com> wrote: >
> I'm interested in installing fastGPT / vicuna on FreeBSD. Is the A= da Language model good ? Can you provide the instructions for installing it= on Linux ? I need them to try to install it on FreeBSD.

I have not been able to try it yet because I am still attempting to
get *ANY* model to work in anyway shape or form on FreeBSD.=C2=A0 Do you have any pointers on this (I don't care what language it is in)....
everything comes to screeching halt when I try to get pytorch to run
(doesn't build on freebsd or on alpine linux, ubuntu, centos, all
don't work on byhve it seems)... then I tried to get tensor flow to
run with no luck... so the question remains how the <bleep> do I get<= br> any ANN model to run?!?!?

>
> On Thu, Apr 20, 2023 at 1:06=E2=80=AFAM Aryeh Friedman <aryeh.friedman@gmail.com= > wrote:
>>
>> I am attempting get the "Ada language model" that is ava= ilable via
>> their API to run locally (chatGPT says all the packages needed
>> packages will run but as soon I finish installing pytorch it fails= to
>> import torch)... this is a on 13.2 VM designed specifically for th= is
>> purpose and I have deinstalled all non-base system stuff from it.= =C2=A0 So
>> what are the right steps?
>>
>> --
>> Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org=
>>
>
>
> --
> Mario.



--
Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org


--
Mario.
--000000000000f6a6df05f9c24884--