From nobody Fri Apr 21 20:33:58 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Q35ps3Jljz46rg0; Fri, 21 Apr 2023 20:34:13 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: from mail-ed1-x529.google.com (mail-ed1-x529.google.com [IPv6:2a00:1450:4864:20::529]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Q35pq4hlBz4SP6; Fri, 21 Apr 2023 20:34:11 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b=NQ03rj3f; spf=pass (mx1.freebsd.org: domain of aryeh.friedman@gmail.com designates 2a00:1450:4864:20::529 as permitted sender) smtp.mailfrom=aryeh.friedman@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-ed1-x529.google.com with SMTP id 4fb4d7f45d1cf-504eac2f0b2so3547453a12.3; Fri, 21 Apr 2023 13:34:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1682109250; x=1684701250; h=content-transfer-encoding:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=YkDas9gqXYEflyNNKJCQyinCuEWwOugo2fZYapa9u6c=; b=NQ03rj3fmdeXV0Y3+v4gCmNIRtLb3rgAGFevlTYA7Sb9VBbP+707xfFmnKU9uHz+C/ NTFSLFCsCz0zLYHFkRaI2INt1u4GzgPIaYpIGn6GC8tcDUxVrMT7i/fM4+Azf9uFyWUE DajTJoofVwBjUWUE4kwPxITulDk/1SxtQRkhH1yLE4HjK/qO1mUPrRQH89RaZKEiWp4H 6+ocZ3oydeOW3t0qFvUOl6NFJRtI460dje0Wph/lxvsG52C9WCBqFLdl6SH3/OroLB63 aR0+H7LRgh0W28eRiPCh/HU6o4o6ASjuml9aN0733/hxQ/+8yc0/BZX4VDxKpFYYZWWo WY2g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1682109250; x=1684701250; h=content-transfer-encoding:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=YkDas9gqXYEflyNNKJCQyinCuEWwOugo2fZYapa9u6c=; b=KraI7cYO80cJGpWfaQ8DRqTLrP92IMPL2yTHQUA1QceQIoXn8S/vDatuOIg0j68yKI xr85AlRUp9aCy64/kQW8RfePoxl7Suyn+nYRjknSeFzkiV/Wa4+6lrvYTxrLZFkwwaiR sQ828Xws8XwJjnNmPGLQZJtFloFe4EgYaWu7Fb+otWBTIsseiQz7L20G9cFMLbcMMm7g O+9sXenImzIKq6X7sUZMF0//mCzqhVhcQj5+12dojb3CrSzlWWf0ihEN7YE1yjtaTOhF 90IjhqmAolXbzhaGpTqwFmszBralgUr5NdqT5np5tYhd+isR219B/sKjHwuLxnUPsn/2 jd/A== X-Gm-Message-State: AAQBX9cOCml4J9pw+ftq7x5yT3f8/agA08PAn9XOC6xolkQ1amDe4nSO n0kmLbUwyIJVFo1y83yntFvcZdXO0aod5CNFJ+2s1NIm X-Google-Smtp-Source: AKy350bTrwbE9ByfS0ufXYxQzFsyxoyNaQVVEvbe3dw1FIgCtk7qYCe1HPRX8QK4JeUXclFbd098A6y19G/BEjGdrck= X-Received: by 2002:a05:6402:1849:b0:504:b313:5898 with SMTP id v9-20020a056402184900b00504b3135898mr6304528edy.27.1682109249852; Fri, 21 Apr 2023 13:34:09 -0700 (PDT) List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 References: <20230421134120.GA12251@darkbeer.org> In-Reply-To: <20230421134120.GA12251@darkbeer.org> From: Aryeh Friedman Date: Fri, 21 Apr 2023 16:33:58 -0400 Message-ID: Subject: Re: Installing openAI's GPT-2 Ada AI Language Model To: questions@freebsd.org, FreeBSD Mailing List Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spamd-Result: default: False [-3.99 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.993]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_SOME(0.00)[]; BLOCKLISTDE_FAIL(0.00)[2a00:1450:4864:20::529:server fail]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::529:from]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MLMMJ_DEST(0.00)[questions@freebsd.org,freebsd-hackers@freebsd.org]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; TAGGED_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4Q35pq4hlBz4SP6 X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N On Fri, Apr 21, 2023 at 9:41=E2=80=AFAM Amar Takhar wro= te: > > I have a tutorial I wrote on how to setup PyTorch on FreeBSD with Stable > Diffusion. > > https://github.com/verm/freebsd-stable-diffusion Thanks for the pointer but it assumes I have a (nvidia) GPU available. Since this is a VM on bhyve there is no currently working GPU passthrough for it. (I do use a nVidia Geforce GT 1030 with nvidia-modeselect but it is not passable to the VM and due to hardware resources don't have a physical machine I can assign to the task). I have gotten as far as the part in the blog as installing pyTorch and keep getting "no compatible versions found" out of pip and when I search for any suitable ones it seems to not be there. Thus I have to revert to building pytorch from scratch and it blows up because the host/guest CPU is not Intel. > > There are some issues with getting PyTorch working on FreeBSD and it's ki= nd of a > moving target I had it working once but it quickly broke this was years a= go > using the Linuxlator it's been rock solid for years. > > Another thing to note is the miniconda-installer script is hardcoded to a= n old > version of Python you'll have to edit line 56 in the script and change it= to 3.9 > or 3.10. Not sure what to do about this yet I haven't had a chance to em= ail the > maintainer. > > I'd recommend going this route. > > > Amar. > --=20 Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org