From nobody Fri Apr 21 22:01:45 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Q37m64JRDz1HCGv; Fri, 21 Apr 2023 22:01:58 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Received: from mail-ed1-x536.google.com (mail-ed1-x536.google.com [IPv6:2a00:1450:4864:20::536]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Q37m61nfNz3rDk; Fri, 21 Apr 2023 22:01:58 +0000 (UTC) (envelope-from aryeh.friedman@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ed1-x536.google.com with SMTP id 4fb4d7f45d1cf-5066ce4f725so3136858a12.1; Fri, 21 Apr 2023 15:01:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1682114517; x=1684706517; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=bZT/Va21BIY8o5+GdxM4gnxD60n4/0cirj/bbJulO44=; b=Lg5HLXxj9S1+qJkmDuCvpWg3YM0WoNkby8yP8HtwO2Or9wHqD3uAr8KImDhNwy0SBC mpyEHaDfbiE1vSfojR1iKasINkPdGvvDAI3qnxjgNxB6pRuKiZgVut9g0HqYR4wEhrpg zPVoxFR18rDv1YirVENCf3P587ROaITJmsoL3dT4DBiQKMlL1hMw2YQcOOeUcC3SV1dG 7VGNAx4HejOEw4h8cO7TCVbHKjF8Sc69sePXHt9fWBY6LkoP6pUZod2D/jklDPRaWA22 df3IVP4Q2peZ54bCi+Hg3JotTkonuZZG1MwbqNQu68Nq24OCce0FT5xJNtnUECyjpBvK 5H6w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1682114517; x=1684706517; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=bZT/Va21BIY8o5+GdxM4gnxD60n4/0cirj/bbJulO44=; b=AAjZy9Ck/eip0UlMUbqQL53WQabx5R/8aMuhHfBwUJhXOJpffp9RFjpHClJxc/ybZO jUnbbjJL8bY9laW0iY2Vn7A1v6NfnAgaJa+5JEe027kvxLSLfRv+xP3X4wV2C3kEWHCo mPQYbEFHwcpxyoQ6LLAlHRw0YN8c39ItJ3JwOzBphATUBHvscAeKGJawfbYQOsDt4oL2 Gsm+NJPKBYKqN6Fvo+Z/3/VmrLlHti6eb2ojlPqorl6Xh/u+ntkMn0M3mQCRFMJxPhmm dna8793LMSJqNRijrlCcocLTnKdtVv+9gJcjS5tkN3PpAhuJFtEoaD8/5YCZSCyeUQv+ gXzg== X-Gm-Message-State: AAQBX9cZwSqYI2rVqKEPl9wqqrEQLazt86GGpBXwGQhajiuQUJ6sxdsd fhsei4CyYdaD7mWwfIllxxb2gYqDbhsrpwxVTamCoav2 X-Google-Smtp-Source: AKy350ZrWnvI8vNqA8g3MlkrRAayo3DkwrUGkTezH45ODIlcquF4UM1KJvZe25Wed8lMaNsc2ANalO6LF0d7Gw6+KdI= X-Received: by 2002:aa7:c592:0:b0:504:b228:878d with SMTP id g18-20020aa7c592000000b00504b228878dmr6414039edq.25.1682114516857; Fri, 21 Apr 2023 15:01:56 -0700 (PDT) List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 References: <20230421134120.GA12251@darkbeer.org> In-Reply-To: From: Aryeh Friedman Date: Fri, 21 Apr 2023 18:01:45 -0400 Message-ID: Subject: Re: Installing openAI's GPT-2 Ada AI Language Model To: Mario Marietto Cc: questions@freebsd.org, FreeBSD Mailing List Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4Q37m61nfNz3rDk X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; TAGGED_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Fri, Apr 21, 2023 at 5:37=E2=80=AFPM Mario Marietto wrote: > > 1) try to use the linuxulator instead of bhyve (try to remember what Albe= rt Einstein tells about those people that want to solve a problem without c= hanging their perspective : he does not spend nice words for those people) For long term deployment options (eventually I want a VM image people can just download and run) running it on the host in the long term is not a good idea and due to lack of hardware resources (and budget) the only non-production/development platform that I can use is a VM on my production VM host (has 3 other production machines on it). Thus *ANY* solution that does not involve VM's is a non-go. > > 2) actually an nvidia gpu can be passed-thru within linux (and within win= dows 11 if the gpu is amd) See above we don't want to force people to have specific hardware. If I remember right, weren't you the person I was helping late last year to setup pass-thru on bhyve for your nvidia and it turned out to need a bhyve patch (I assume from what you have said this was for the 2 os's you mentioned). If I remember right this was specifically so you could set up GPT-2. > > 3) the tutorial that we are suggesting may work even if you don't want to= use your gpu I was pointed to another tutorial privately that explains how to do it on a VM (I hope ;-)) > > 4) probably you should find the exact version of pytorch that it wants According to chatGPT (and other sources) it will work on anything newer than 1.13 but does not specify anything beyond that.