From nobody Sat Apr 22 18:13:44 2023 X-Original-To: freebsd-questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Q3fg25cvHz465Vx; Sat, 22 Apr 2023 18:14:22 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-yw1-x1133.google.com (mail-yw1-x1133.google.com [IPv6:2607:f8b0:4864:20::1133]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Q3fg21Bn7z4RGk; Sat, 22 Apr 2023 18:14:22 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b=ZAFyOvby; spf=pass (mx1.freebsd.org: domain of marietto2008@gmail.com designates 2607:f8b0:4864:20::1133 as permitted sender) smtp.mailfrom=marietto2008@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-yw1-x1133.google.com with SMTP id 00721157ae682-54fb8a8a597so33338207b3.0; Sat, 22 Apr 2023 11:14:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1682187261; x=1684779261; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=2EjtGGnE5kBU7aLe3zl1AdaCRY4OfKfT3ozLNogRVnQ=; b=ZAFyOvbyR4GGwW6bTfZfVQBrfxCc/f6NZT1BG3XbZiRcIwc44LA8eu7cUn0FNOrEzj 1K7oyfvhIYfwQ5Vi+/doMfyGMuULZguf5cVnwEYz0rae1mdCRqgiXvIdXS1PUIgYgYp8 3+TkT5q4PC/C7nQ/m5R2KfmkRJZJ9UwvUcx/Yg8pgLJeQX7t8ZgKdYE/fOdMRXVPgJUo WuFm37aku8QWNQGHRAH5doSOzLaXnm8zmhYbJZC6AhVjHr6/Dj61b1o+28En+bc3O8e4 4/f8CFvePudjYsuZydOEjLIqjc33yW1GU4woC37yeyOoHQsbYTju3JgnmbRkfwjeHTLR Somw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1682187261; x=1684779261; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=2EjtGGnE5kBU7aLe3zl1AdaCRY4OfKfT3ozLNogRVnQ=; b=YIkeRz0dmDm7egvE4RV+EKqWTbaH9tnGuk2gvNWbDI/A3JBArkHhRL4EDz+wIor1Xc yDcEAbHxgTtst44yj12aS31hVb7qmq6XG9HfwxJ4bkSrcoHDJBhEvDnARjFmdutp9NjH GalLP5/dNH7RMq7kZS47wR9YmJ1AwHorw0UIoCj8/+8GFBK6sokRP4dZdEThcr5a8Uey oF1HFHxnN/EoEy+WoYQdQe/XUxkpUY4etB1Tecv+miuiVPYzAPQdKleCrD8h47PNSR/I YlQ3MM8eh7ZU4OjUPvJ/phGdQQu/tR2HK5evj40x4FPx7BfMudPusxZOohT7t8VxT1mv 0WfA== X-Gm-Message-State: AAQBX9cfJy+v+zJ57Xjh/J9rdAlwElEWJUBW/l/csMcVlrR7q6DD3nzh re5eESoQc4lUxiElDUkvK/OfuOszwmG2IW9hsNwB+EV8SLmTVw== X-Google-Smtp-Source: AKy350aSoDH0Ebx+FpjQf6gAeAT79V3ctZ5bHvztwP/t+Co/PHvHZ3FY1fkWNAHzdMr+K5AKQrzZXhNZ+QZ/MBYvZx8= X-Received: by 2002:a81:5201:0:b0:538:4ae4:2d2f with SMTP id g1-20020a815201000000b005384ae42d2fmr4347026ywb.52.1682187260482; Sat, 22 Apr 2023 11:14:20 -0700 (PDT) List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Mario Marietto Date: Sat, 22 Apr 2023 20:13:44 +0200 Message-ID: Subject: Re: Installing openAI's GPT-2 Ada AI Language Model To: Aryeh Friedman , freebsd-hackers , Yuri Victorovich , FreeBSD Mailing List Cc: Odhiambo Washington Content-Type: multipart/alternative; boundary="0000000000001b5a4f05f9f0bedd" X-Spamd-Result: default: False [-2.50 / 15.00]; SUSPICIOUS_RECIPS(1.50)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; FROM_HAS_DN(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::1133:from]; TAGGED_RCPT(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org,freebsd-questions@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FREEMAIL_CC(0.00)[gmail.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; RCPT_COUNT_FIVE(0.00)[5]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; FREEMAIL_TO(0.00)[gmail.com,freebsd.org]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_FROM(0.00)[gmail.com] X-Rspamd-Queue-Id: 4Q3fg21Bn7z4RGk X-Spamd-Bar: -- X-ThisMailContainsUnwantedMimeParts: N --0000000000001b5a4f05f9f0bedd Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable I don't know. This should be evaluated by you. I'm not involved so much in the technicalities : https://github.com/lm-sys/FastChat Let me understand what the Ada (117M) model is,if you want. I want to learn. On Sat, Apr 22, 2023 at 8:10=E2=80=AFPM Aryeh Friedman wrote: > Does GPT-3/3.5 come with a Ada (117M) model? > > On Sat, Apr 22, 2023 at 2:09=E2=80=AFPM Mario Marietto > wrote: > > > > And I'm even more sure that using a linux bhyve VM you can configure > chatgpt 3.5 / 4 even faster than using the linuxulator. > > > > On Sat, Apr 22, 2023 at 8:06=E2=80=AFPM Mario Marietto > wrote: > >> > >> Why are you insisting on chat gpt 2 when you can have chatgpt 3.5 / 4 > installed on your local FreeBSD machine through the linuxulator ? This wi= ll > be my next project. > >> > >> On Sat, Apr 22, 2023 at 8:00=E2=80=AFPM Aryeh Friedman < > aryeh.friedman@gmail.com> wrote: > >>> > >>> My next step is to wipe the vm and try again (this time making it > >>> scripted so I can do repeated test runs and very stuff systematically= ) > >>> > >>> On Sat, Apr 22, 2023 at 6:53=E2=80=AFAM Odhiambo Washington < > odhiambo@gmail.com> wrote: > >>> > > >>> > If you find a suitable, working version, please let me know. > >>> > > >>> > > >>> > On Sat, Apr 22, 2023 at 1:05=E2=80=AFPM Aryeh Friedman < > aryeh.friedman@gmail.com> wrote: > >>> >> > >>> >> Seems like 2 steps forward and one backwards I had it kind of > working > >>> >> under the wrong version of python going to wipe the machine and tr= y > >>> >> again with 3.7 I think I screwed something up.... and according to > >>> >> what I can ting the no tensorflow.contrib has to deal with version > of > >>> >> tensor flow... gpt-2 wants <2.0.0 it appears (preference for 1.15) > >>> >> > >>> >> On Sat, Apr 22, 2023 at 5:26=E2=80=AFAM Odhiambo Washington < > odhiambo@gmail.com> wrote: > >>> >> > > >>> >> > @Mario Marietto are you by any chance trying to address the issu= e > raised by Aryeh? > >>> >> > > >>> >> > ``` > >>> >> > ModuleNotFoundError: No module named 'tensorflow.contrib' > >>> >> > ``` > >>> >> > The problem is NOT about installing tensorflow, but rather > getting the correct version that will not lead to the above error. > >>> >> > > >>> >> > > >>> >> > > >>> >> > On Sat, Apr 22, 2023 at 12:19=E2=80=AFPM Mario Marietto < > marietto2008@gmail.com> wrote: > >>> >> >> > >>> >> >> marietto@marietto-nano:~$ python3 > >>> >> >> Python 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] on lin= ux > >>> >> >> Type "help", "copyright", "credits" or "license" for more > information. > >>> >> >> >>> import tensorflow as tf > >>> >> >> >>> tf.__version__ > >>> >> >> '2.12.0' > >>> >> >> >>> print(tf.reduce_sum(tf.random.normal([1000, 1000]))) > >>> >> >> tf.Tensor(51.500687, shape=3D(), dtype=3Dfloat32) > >>> >> >> > >>> >> >> > https://qengineering.eu/install-tensorflow-2.4.0-on-jetson-nano.html > >>> >> >> > >>> >> >> On Sat, Apr 22, 2023 at 10:47=E2=80=AFAM Odhiambo Washington < > odhiambo@gmail.com> wrote: > >>> >> >>> > >>> >> >>> > >>> >> >>> > >>> >> >>> On Sat, Apr 22, 2023 at 11:20=E2=80=AFAM Aryeh Friedman < > aryeh.friedman@gmail.com> wrote: > >>> >> >>>> > >>> >> >>>> On Fri, Apr 21, 2023 at 8:31=E2=80=AFAM Mario Marietto < > marietto2008@gmail.com> wrote: > >>> >> >>>> > > >>> >> >>>> > If you don't want to use the GPU,the commands should be mor= e > or less the following : > >>> >> >>>> > > >>> >> >>>> > > >>> >> >>>> > sudo touch /usr/local/etc/rc.d/ubuntu && chmod +x > /usr/local/etc/rc.d/ubuntu > >>> >> >>>> > > >>> >> >>>> > # Make it have this content: > >>> >> >>>> > > >>> >> >>>> > #!/bin/sh > >>> >> >>>> > # > >>> >> >>>> > # PROVIDE: ubuntu > >>> >> >>>> > # REQUIRE: archdep mountlate > >>> >> >>>> > # KEYWORD: nojail > >>> >> >>>> > # > >>> >> >>>> > # This is a modified version of /etc/rc.d/linux > >>> >> >>>> > # Based on the script by mrclksr: > >>> >> >>>> > # > https://github.com/mrclksr/linux-browser-installer/blob/main/rc.d/ubuntu.= in > >>> >> >>>> > # > >>> >> >>>> > . /etc/rc.subr > >>> >> >>>> > > >>> >> >>>> > name=3D"ubuntu" > >>> >> >>>> > desc=3D"Enable Ubuntu chroot, and Linux ABI" > >>> >> >>>> > rcvar=3D"ubuntu_enable" > >>> >> >>>> > start_cmd=3D"${name}_start" > >>> >> >>>> > stop_cmd=3D":" > >>> >> >>>> > > >>> >> >>>> > unmounted() > >>> >> >>>> > { > >>> >> >>>> > [ `stat -f "%d" "$1"` =3D=3D `stat -f "%d" "$1/.."` -a = \ > >>> >> >>>> > `stat -f "%i" "$1"` !=3D `stat -f "%i" "$1/.."` ] > >>> >> >>>> > } > >>> >> >>>> > > >>> >> >>>> > ubuntu_start() > >>> >> >>>> > { > >>> >> >>>> > local _emul_path _tmpdir > >>> >> >>>> > > >>> >> >>>> > load_kld -e 'linux(aout|elf)' linux > >>> >> >>>> > case `sysctl -n hw.machine_arch` in > >>> >> >>>> > amd64) > >>> >> >>>> > load_kld -e 'linux64elf' linux64 > >>> >> >>>> > ;; > >>> >> >>>> > esac > >>> >> >>>> > if [ -x /compat/ubuntu/sbin/ldconfigDisabled ]; then > >>> >> >>>> > _tmpdir=3D`mktemp -d -t linux-ldconfig` > >>> >> >>>> > /compat/ubuntu/sbin/ldconfig -C > ${_tmpdir}/ld.so.cache > >>> >> >>>> > if ! cmp -s ${_tmpdir}/ld.so.cache > /compat/ubuntu/etc/ld.so.cache; then > >>> >> >>>> > cat ${_tmpdir}/ld.so.cache > > /compat/ubuntu/etc/ld.so.cache > >>> >> >>>> > fi > >>> >> >>>> > rm -rf ${_tmpdir} > >>> >> >>>> > fi > >>> >> >>>> > > >>> >> >>>> > # Linux uses the pre-pts(4) tty naming scheme. > >>> >> >>>> > load_kld pty > >>> >> >>>> > > >>> >> >>>> > # Handle unbranded ELF executables by defaulting to > ELFOSABI_LINUX. > >>> >> >>>> > if [ `sysctl -ni kern.elf64.fallback_brand` -eq "-1" ]; > then > >>> >> >>>> > sysctl kern.elf64.fallback_brand=3D3 > /dev/null > >>> >> >>>> > fi > >>> >> >>>> > > >>> >> >>>> > if [ `sysctl -ni kern.elf32.fallback_brand` -eq "-1" ]; > then > >>> >> >>>> > sysctl kern.elf32.fallback_brand=3D3 > /dev/null > >>> >> >>>> > fi > >>> >> >>>> > sysctl compat.linux.emul_path=3D/compat/ubuntu > >>> >> >>>> > > >>> >> >>>> > _emul_path=3D"/compat/ubuntu" > >>> >> >>>> > unmounted "${_emul_path}/dev" && (mount -o nocover -t > devfs devfs "${_emul_path}/dev" || exit 1) > >>> >> >>>> > unmounted "${_emul_path}/dev/fd" && (mount -o > nocover,linrdlnk -t fdescfs fdescfs "${_emul_path}/dev/fd" || exit 1) > >>> >> >>>> > unmounted "${_emul_path}/dev/shm" && (mount -o > nocover,mode=3D1777 -t tmpfs tmpfs "${_emul_path}/dev/shm" || exit 1) > >>> >> >>>> > unmounted "${_emul_path}/home" && (mount -t nullfs /hom= e > "${_emul_path}/home" || exit 1) > >>> >> >>>> > unmounted "${_emul_path}/proc" && (mount -o nocover -t > linprocfs linprocfs "${_emul_path}/proc" || exit 1) > >>> >> >>>> > unmounted "${_emul_path}/sys" && (mount -o nocover -t > linsysfs linsysfs "${_emul_path}/sys" || exit 1) > >>> >> >>>> > unmounted "${_emul_path}/tmp" && (mount -t nullfs /tmp > "${_emul_path}/tmp" || exit 1) > >>> >> >>>> > unmounted /dev/fd && (mount -o nocover -t fdescfs > fdescfs /dev/fd || exit 1) > >>> >> >>>> > unmounted /proc && (mount -o nocover -t procfs procfs > /proc || exit 1) > >>> >> >>>> > true > >>> >> >>>> > } > >>> >> >>>> > > >>> >> >>>> > load_rc_config $name > >>> >> >>>> > run_rc_command "$1" > >>> >> >>>> > > >>> >> >>>> > sysrc ubuntu_enable=3DYES > >>> >> >>>> > > >>> >> >>>> > # Create necessary mount points for a working Linuxulator: > >>> >> >>>> > mkdir -p > {/compat/ubuntu/dev/fd,/compat/ubuntu/dev/shm,/compat/ubuntu/home,/compat= /ubuntu/tmp,/compat/ubuntu/proc,/compat/ubuntu/sys} > >>> >> >>>> > > >>> >> >>>> > # Start Ubuntu service: > >>> >> >>>> > service ubuntu start > >>> >> >>>> > > >>> >> >>>> > # Install needed packages: > >>> >> >>>> > pkg install debootstrap pulseaudio > >>> >> >>>> > > >>> >> >>>> > # Install Ubuntu 20.04 into /compat/ubuntu: > >>> >> >>>> > debootstrap --arch=3Damd64 --no-check-gpg focal /compat/ubu= ntu > >>> >> >>>> > > >>> >> >>>> > # Restart Ubuntu service to make sure everything is properl= y > mounted: > >>> >> >>>> > service ubuntu restart > >>> >> >>>> > > >>> >> >>>> > # Fix broken symlink: > >>> >> >>>> > cd /compat/ubuntu/lib64/ && rm ./ld-linux-x86-64.so.2 ; ln > -s ../lib/x86_64-linux-gnu/ld-2.31.so ld-linux-x86-64.so.2 > >>> >> >>>> > > >>> >> >>>> > # Chroot into your Linux environment: > >>> >> >>>> > chroot /compat/ubuntu /bin/bash > >>> >> >>>> > > >>> >> >>>> > # Set correct timezone inside your chroot: > >>> >> >>>> > printf "%b\n" "0.0 0 0.0\n0\nUTC" > /etc/adjtime > >>> >> >>>> > sudo dpkg-reconfigure tzdata # For some reason sudo is > necessary here, otherwise it fails. > >>> >> >>>> > > >>> >> >>>> > # Fix APT package manager: > >>> >> >>>> > printf "APT::Cache-Start 251658240;" > > /etc/apt/apt.conf.d/00aptitude > >>> >> >>>> > > >>> >> >>>> > # Enable more repositories: > >>> >> >>>> > printf "deb http://archive.ubuntu.com/ubuntu/ focal main > restricted universe multiverse" > /etc/apt/sources.list > >>> >> >>>> > > >>> >> >>>> > # Install required programs: > >>> >> >>>> > > >>> >> >>>> > apt update ; apt install -y apt-transport-https curl > fonts-symbola gnupg pulseaudio build-essential gcc gfortran > >>> >> >>>> > > >>> >> >>>> > # Exit out of chroot > >>> >> >>>> > exit > >>> >> >>>> > > >>> >> >>>> > # Fix x86_64-linux-gnu libraries path between ubuntu and > freebsd > >>> >> >>>> > cp -r /compat/ubuntu/usr/lib/x86_64-linux-gnu /lib > >>> >> >>>> > > >>> >> >>>> > > >>> >> >>>> > --> Installing PyTorch and your chatgpt github fork on > FreeBSD > >>> >> >>>> > > >>> >> >>>> > > >>> >> >>>> > # fetch > https://gist.githubusercontent.com/shkhln/40ef290463e78fb2b0000c60f4ad797= e/raw/f640983249607e38af405c95c457ce4afc85c608/uvm_ioctl_override.c > >>> >> >>>> > > >>> >> >>>> > # /compat/ubuntu/bin/gcc --sysroot=3D/compat/ubuntu -m64 > -std=3Dc99 -Wall -ldl -fPIC -shared -o dummy-uvm.so uvm_ioctl_override.c > >>> >> >>>> > > >>> >> >>>> > # pkg install linux-miniconda-installer > >>> >> >>>> > # miniconda-installer > >>> >> >>>> > # bash > >>> >> >>>> > # source /home/marietto/miniconda3/etc/profile.d/conda.sh > >>> >> >>>> > # conda activate > >>> >> >>>> > > >>> >> >>>> > (base) # conda activate pytorch > >>> >> >>>> > > >>> >> >>>> > (pytorch) # conda activate > >>> >> >>>> > > >>> >> >>>> > (base) # conda activate > >>> >> >>>> > > >>> >> >>>> > (base) # git clone your chatgpt github fork > >>> >> >>>> > >>> >> >>>> > >>> >> >>>> I have done that I think and get: > >>> >> >>>> > >>> >> >>>> (base) [babyspock@babyspock ~]$ python > >>> >> >>>> src/generate_unconditional_samples.py --model_name 117M > --nsamples 5 > >>> >> >>>> --length 512 > >>> >> >>>> python: can't open file > >>> >> >>>> '/usr/opt/babySpock/src/generate_unconditional_samples.py': > [Errno 2] > >>> >> >>>> No such file or directory > >>> >> >>>> (base) [babyspock@babyspock ~]$ cd gpt-2/ > >>> >> >>>> (base) [babyspock@babyspock ~/gpt-2]$ python > >>> >> >>>> src/generate_unconditional_samples.py --model_name 117M > --nsamples 5 > >>> >> >>>> --length 512 > >>> >> >>>> 2023-04-22 00:17:18.661083: I > tensorflow/tsl/cuda/cudart_stub.cc:28] > >>> >> >>>> Could not find cuda drivers on your machine, GPU will not be > used. > >>> >> >>>> 2023-04-22 00:17:18.710468: I > tensorflow/tsl/cuda/cudart_stub.cc:28] > >>> >> >>>> Could not find cuda drivers on your machine, GPU will not be > used. > >>> >> >>>> 2023-04-22 00:17:18.710951: I > >>> >> >>>> tensorflow/core/platform/cpu_feature_guard.cc:182] This > TensorFlow > >>> >> >>>> binary is optimized to use available CPU instructions in > >>> >> >>>> performance-critical operations. > >>> >> >>>> To enable the following instructions: AVX2 FMA, in other > operations, > >>> >> >>>> rebuild TensorFlow with the appropriate compiler flags. > >>> >> >>>> 2023-04-22 00:17:19.429409: W > >>> >> >>>> tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT > Warning: > >>> >> >>>> Could not find TensorRT > >>> >> >>>> Traceback (most recent call last): > >>> >> >>>> File > "/usr/opt/babySpock/gpt-2/src/generate_unconditional_samples.py", > >>> >> >>>> line 9, in > >>> >> >>>> import model, sample, encoder > >>> >> >>>> File "/usr/opt/babySpock/gpt-2/src/model.py", line 3, in > > >>> >> >>>> from tensorflow.contrib.training import HParams > >>> >> >>>> ModuleNotFoundError: No module named 'tensorflow.contrib' > >>> >> >>> > >>> >> >>> > >>> >> >>> Use Python3.7 or earlier. > >>> >> >>> > >>> >> >>> -- > >>> >> >>> Best regards, > >>> >> >>> Odhiambo WASHINGTON, > >>> >> >>> Nairobi,KE > >>> >> >>> +254 7 3200 0004/+254 7 2274 3223 > >>> >> >>> "Oh, the cruft.", egrep -v '^$|^.*#' =C2=AF\_(=E3=83=84)_/=C2= =AF :-) > >>> >> >>> [How to ask smart questions: > http://www.catb.org/~esr/faqs/smart-questions.html] > >>> >> >> > >>> >> >> > >>> >> >> > >>> >> >> -- > >>> >> >> Mario. > >>> >> > > >>> >> > > >>> >> > > >>> >> > -- > >>> >> > Best regards, > >>> >> > Odhiambo WASHINGTON, > >>> >> > Nairobi,KE > >>> >> > +254 7 3200 0004/+254 7 2274 3223 > >>> >> > "Oh, the cruft.", egrep -v '^$|^.*#' =C2=AF\_(=E3=83=84)_/=C2=AF= :-) > >>> >> > [How to ask smart questions: > http://www.catb.org/~esr/faqs/smart-questions.html] > >>> >> > >>> >> > >>> >> > >>> >> -- > >>> >> Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org > >>> > > >>> > > >>> > > >>> > -- > >>> > Best regards, > >>> > Odhiambo WASHINGTON, > >>> > Nairobi,KE > >>> > +254 7 3200 0004/+254 7 2274 3223 > >>> > "Oh, the cruft.", egrep -v '^$|^.*#' =C2=AF\_(=E3=83=84)_/=C2=AF :-= ) > >>> > [How to ask smart questions: > http://www.catb.org/~esr/faqs/smart-questions.html] > >>> > >>> > >>> > >>> -- > >>> Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org > >> > >> > >> > >> -- > >> Mario. > > > > > > > > -- > > Mario. > > > > -- > Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org > --=20 Mario. --0000000000001b5a4f05f9f0bedd Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
I don't know. This should be evaluated by you. I&= #39;m not involved so much in the technicalities :


Let me understand what the Ada (1= 17M) model is,if you want. I want to learn.=C2=A0

On Sat, Apr 22,= 2023 at 8:10=E2=80=AFPM Aryeh Friedman <aryeh.friedman@gmail.com> wrote:
Does GPT-3/3.5 come with a Ada (117M) = model?

On Sat, Apr 22, 2023 at 2:09=E2=80=AFPM Mario Marietto <marietto2008@gmail.com> = wrote:
>
> And I'm even more sure that using a linux bhyve VM you can configu= re chatgpt 3.5 / 4 even faster than using the linuxulator.
>
> On Sat, Apr 22, 2023 at 8:06=E2=80=AFPM Mario Marietto <marietto2008@gmail.com= > wrote:
>>
>> Why are you insisting on chat gpt 2 when you can have chatgpt 3.5 = / 4 installed on your local FreeBSD machine through the linuxulator ? This = will be my next project.
>>
>> On Sat, Apr 22, 2023 at 8:00=E2=80=AFPM Aryeh Friedman <aryeh.friedman@gmail= .com> wrote:
>>>
>>> My next step is to wipe the vm and try again (this time making= it
>>> scripted so I can do repeated test runs and very stuff systema= tically)
>>>
>>> On Sat, Apr 22, 2023 at 6:53=E2=80=AFAM Odhiambo Washington &l= t;odhiambo@gmail.co= m> wrote:
>>> >
>>> > If you find a suitable, working version, please let me kn= ow.
>>> >
>>> >
>>> > On Sat, Apr 22, 2023 at 1:05=E2=80=AFPM Aryeh Friedman &l= t;aryeh.fried= man@gmail.com> wrote:
>>> >>
>>> >> Seems like 2 steps forward and one backwards I had it= kind of working
>>> >> under the wrong version of python going to wipe the m= achine and try
>>> >> again with 3.7 I think I screwed something up.... and= according to
>>> >> what I can ting the no tensorflow.contrib has to deal= with version of
>>> >> tensor flow... gpt-2 wants <2.0.0 it appears (pref= erence for 1.15)
>>> >>
>>> >> On Sat, Apr 22, 2023 at 5:26=E2=80=AFAM Odhiambo Wash= ington <odhiambo= @gmail.com> wrote:
>>> >> >
>>> >> > @Mario Marietto are you by any chance trying to = address the issue raised by Aryeh?
>>> >> >
>>> >> > ```
>>> >> > ModuleNotFoundError: No module named 'tensor= flow.contrib'
>>> >> > ```
>>> >> > The problem is NOT about installing tensorflow, = but rather getting the correct version that will not lead to the above erro= r.
>>> >> >
>>> >> >
>>> >> >
>>> >> > On Sat, Apr 22, 2023 at 12:19=E2=80=AFPM Mario M= arietto <mar= ietto2008@gmail.com> wrote:
>>> >> >>
>>> >> >> marietto@marietto-nano:~$ python3
>>> >> >> Python 3.10.6 (main, Mar 10 2023, 10:55:28) = [GCC 11.3.0] on linux
>>> >> >> Type "help", "copyright"= , "credits" or "license" for more information.
>>> >> >> >>> import tensorflow as tf
>>> >> >> >>> tf.__version__
>>> >> >> '2.12.0'
>>> >> >> >>> print(tf.reduce_sum(tf.random.n= ormal([1000, 1000])))
>>> >> >> tf.Tensor(51.500687, shape=3D(), dtype=3Dflo= at32)
>>> >> >>
>>> >> >> h= ttps://qengineering.eu/install-tensorflow-2.4.0-on-jetson-nano.html
>>> >> >>
>>> >> >> On Sat, Apr 22, 2023 at 10:47=E2=80=AFAM Odh= iambo Washington <odhiambo@gmail.com> wrote:
>>> >> >>>
>>> >> >>>
>>> >> >>>
>>> >> >>> On Sat, Apr 22, 2023 at 11:20=E2=80=AFAM= Aryeh Friedman <aryeh.friedman@gmail.com> wrote:
>>> >> >>>>
>>> >> >>>> On Fri, Apr 21, 2023 at 8:31=E2=80= =AFAM Mario Marietto <marietto2008@gmail.com> wrote:
>>> >> >>>> >
>>> >> >>>> > If you don't want to use th= e GPU,the commands should be more or less the following :
>>> >> >>>> >
>>> >> >>>> >
>>> >> >>>> > sudo touch /usr/local/etc/rc.d/= ubuntu && chmod +x /usr/local/etc/rc.d/ubuntu
>>> >> >>>> >
>>> >> >>>> > # Make it have this content: >>> >> >>>> >
>>> >> >>>> > #!/bin/sh
>>> >> >>>> > #
>>> >> >>>> > # PROVIDE: ubuntu
>>> >> >>>> > # REQUIRE: archdep mountlate >>> >> >>>> > # KEYWORD: nojail
>>> >> >>>> > #
>>> >> >>>> > # This is a modified version of= /etc/rc.d/linux
>>> >> >>>> > # Based on the script by mrclks= r:
>>> >> >>>> > # https://github.com/mrclksr/linux-browser-installer/blo= b/main/rc.d/ubuntu.in
>>> >> >>>> > #
>>> >> >>>> > . /etc/rc.subr
>>> >> >>>> >
>>> >> >>>> > name=3D"ubuntu"
>>> >> >>>> > desc=3D"Enable Ubuntu chro= ot, and Linux ABI"
>>> >> >>>> > rcvar=3D"ubuntu_enable&quo= t;
>>> >> >>>> > start_cmd=3D"${name}_start= "
>>> >> >>>> > stop_cmd=3D":"
>>> >> >>>> >
>>> >> >>>> > unmounted()
>>> >> >>>> > {
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0[ `stat -f &= quot;%d" "$1"` =3D=3D `stat -f "%d" "$1/..&qu= ot;` -a \
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0 =C2=A0`stat= -f "%i" "$1"` !=3D `stat -f "%i" "$1/..= "` ]
>>> >> >>>> > }
>>> >> >>>> >
>>> >> >>>> > ubuntu_start()
>>> >> >>>> > {
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0local _emul_= path _tmpdir
>>> >> >>>> >
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0load_kld -e = 'linux(aout|elf)' linux
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0case `sysctl= -n hw.machine_arch` in
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0amd64)
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0load_kld -e 'linux64elf' linux64
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0;;
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0esac
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0if [ -x /com= pat/ubuntu/sbin/ldconfigDisabled ]; then
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0_tmpdir=3D`mktemp -d -t linux-ldconfig`
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0/compat/ubuntu/sbin/ldconfig -C ${_tmpdir}/ld.so.cache
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0if ! cmp -s ${_tmpdir}/ld.so.cache /compat/ubuntu/etc/ld.so.cache; then<= br> >>> >> >>>> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0cat ${_tmpdir}/ld.so.cache > /compat/ubuntu/etc/ld.so.c= ache
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0fi
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0rm -rf ${_tmpdir}
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0fi
>>> >> >>>> >
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0# Linux uses= the pre-pts(4) tty naming scheme.
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0load_kld pty=
>>> >> >>>> >
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0# Handle unb= randed ELF executables by defaulting to ELFOSABI_LINUX.
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0if [ `sysctl= -ni kern.elf64.fallback_brand` -eq "-1" ]; then
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0sysctl kern.elf64.fallback_brand=3D3 > /dev/null
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0fi
>>> >> >>>> >
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0if [ `sysctl= -ni kern.elf32.fallback_brand` -eq "-1" ]; then
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0sysctl kern.elf32.fallback_brand=3D3 > /dev/null
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0fi
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0sysctl compa= t.linux.emul_path=3D/compat/ubuntu
>>> >> >>>> >
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0_emul_path= =3D"/compat/ubuntu"
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0unmounted &q= uot;${_emul_path}/dev" && (mount -o nocover -t devfs devfs &qu= ot;${_emul_path}/dev" || exit 1)
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0unmounted &q= uot;${_emul_path}/dev/fd" && (mount -o nocover,linrdlnk -t fde= scfs fdescfs "${_emul_path}/dev/fd" || exit 1)
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0unmounted &q= uot;${_emul_path}/dev/shm" && (mount -o nocover,mode=3D1777 -t= tmpfs tmpfs "${_emul_path}/dev/shm" || exit 1)
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0unmounted &q= uot;${_emul_path}/home" && (mount -t nullfs /home "${_emu= l_path}/home" || exit 1)
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0unmounted &q= uot;${_emul_path}/proc" && (mount -o nocover -t linprocfs linp= rocfs "${_emul_path}/proc" || exit 1)
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0unmounted &q= uot;${_emul_path}/sys" && (mount -o nocover -t linsysfs linsys= fs "${_emul_path}/sys" || exit 1)
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0unmounted &q= uot;${_emul_path}/tmp" && (mount -t nullfs /tmp "${_emul_= path}/tmp" || exit 1)
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0unmounted /d= ev/fd && (mount -o nocover -t fdescfs fdescfs /dev/fd || exit 1) >>> >> >>>> >=C2=A0 =C2=A0 =C2=A0unmounted /p= roc && (mount -o nocover -t procfs procfs /proc || exit 1)
>>> >> >>>> >=C2=A0 =C2=A0 =C2=A0true
>>> >> >>>> > }
>>> >> >>>> >
>>> >> >>>> > load_rc_config $name
>>> >> >>>> > run_rc_command "$1" >>> >> >>>> >
>>> >> >>>> > sysrc ubuntu_enable=3DYES
>>> >> >>>> >
>>> >> >>>> > # Create necessary mount points= for a working Linuxulator:
>>> >> >>>> > mkdir -p {/compat/ubuntu/dev/fd= ,/compat/ubuntu/dev/shm,/compat/ubuntu/home,/compat/ubuntu/tmp,/compat/ubun= tu/proc,/compat/ubuntu/sys}
>>> >> >>>> >
>>> >> >>>> > # Start Ubuntu service:
>>> >> >>>> > service ubuntu start
>>> >> >>>> >
>>> >> >>>> > # Install needed packages:
>>> >> >>>> > pkg install debootstrap pulseau= dio
>>> >> >>>> >
>>> >> >>>> > # Install Ubuntu 20.04 into /co= mpat/ubuntu:
>>> >> >>>> > debootstrap --arch=3Damd64 --no= -check-gpg focal /compat/ubuntu
>>> >> >>>> >
>>> >> >>>> > # Restart Ubuntu service to mak= e sure everything is properly mounted:
>>> >> >>>> > service ubuntu restart
>>> >> >>>> >
>>> >> >>>> > # Fix broken symlink:
>>> >> >>>> > cd /compat/ubuntu/lib64/ &&= amp; rm ./ld-linux-x86-64.so.2 ; ln -s ../lib/x86_64-linux-gnu/ld-2.31.so ld-li= nux-x86-64.so.2
>>> >> >>>> >
>>> >> >>>> > # Chroot into your Linux enviro= nment:
>>> >> >>>> > chroot /compat/ubuntu /bin/bash=
>>> >> >>>> >
>>> >> >>>> > # Set correct timezone inside y= our chroot:
>>> >> >>>> > printf "%b\n" "0= .0 0 0.0\n0\nUTC" > /etc/adjtime
>>> >> >>>> > sudo dpkg-reconfigure tzdata # = For some reason sudo is necessary here, otherwise it fails.
>>> >> >>>> >
>>> >> >>>> > # Fix APT package manager:
>>> >> >>>> > printf "APT::Cache-Start 2= 51658240;" > /etc/apt/apt.conf.d/00aptitude
>>> >> >>>> >
>>> >> >>>> > # Enable more repositories:
>>> >> >>>> > printf "deb http:/= /archive.ubuntu.com/ubuntu/ focal main restricted universe multiverse&q= uot; > /etc/apt/sources.list
>>> >> >>>> >
>>> >> >>>> > # Install required programs: >>> >> >>>> >
>>> >> >>>> > apt update ; apt install -y apt= -transport-https curl fonts-symbola gnupg pulseaudio build-essential gcc gf= ortran
>>> >> >>>> >
>>> >> >>>> > # Exit out of chroot
>>> >> >>>> > exit
>>> >> >>>> >
>>> >> >>>> > # Fix x86_64-linux-gnu librarie= s path between ubuntu and freebsd
>>> >> >>>> > cp -r /compat/ubuntu/usr/lib/x8= 6_64-linux-gnu /lib
>>> >> >>>> >
>>> >> >>>> >
>>> >> >>>> > --> Installing PyTorch and y= our chatgpt github fork on FreeBSD
>>> >> >>>> >
>>> >> >>>> >
>>> >> >>>> > # fetch https://gist.githubusercontent.com/shkhln/40ef290463e78fb2= b0000c60f4ad797e/raw/f640983249607e38af405c95c457ce4afc85c608/uvm_ioctl_ove= rride.c
>>> >> >>>> >
>>> >> >>>> > # /compat/ubuntu/bin/gcc --sysr= oot=3D/compat/ubuntu -m64 -std=3Dc99 -Wall -ldl -fPIC -shared -o dummy-uvm.= so uvm_ioctl_override.c
>>> >> >>>> >
>>> >> >>>> > # pkg install linux-miniconda-i= nstaller
>>> >> >>>> > # miniconda-installer
>>> >> >>>> > # bash
>>> >> >>>> > # source /home/marietto/minicon= da3/etc/profile.d/conda.sh
>>> >> >>>> > # conda activate
>>> >> >>>> >
>>> >> >>>> > (base) # conda activate pytorch=
>>> >> >>>> >
>>> >> >>>> > (pytorch) # conda activate
>>> >> >>>> >
>>> >> >>>> > (base) # conda activate
>>> >> >>>> >
>>> >> >>>> > (base) # git clone your chatgpt= github fork
>>> >> >>>>
>>> >> >>>>
>>> >> >>>> I have done that I think and get: >>> >> >>>>
>>> >> >>>> (base) [babyspock@babyspock ~]$ pyth= on
>>> >> >>>> src/generate_unconditional_samples.p= y --model_name 117M --nsamples 5
>>> >> >>>> --length 512
>>> >> >>>> python: can't open file
>>> >> >>>> '/usr/opt/babySpock/src/generate= _unconditional_samples.py': [Errno 2]
>>> >> >>>> No such file or directory
>>> >> >>>> (base) [babyspock@babyspock ~]$ cd g= pt-2/
>>> >> >>>> (base) [babyspock@babyspock ~/gpt-2]= $ python
>>> >> >>>> src/generate_unconditional_samples.p= y --model_name 117M --nsamples 5
>>> >> >>>> --length 512
>>> >> >>>> 2023-04-22 00:17:18.661083: I tensor= flow/tsl/cuda/cudart_stub.cc:28]
>>> >> >>>> Could not find cuda drivers on your = machine, GPU will not be used.
>>> >> >>>> 2023-04-22 00:17:18.710468: I tensor= flow/tsl/cuda/cudart_stub.cc:28]
>>> >> >>>> Could not find cuda drivers on your = machine, GPU will not be used.
>>> >> >>>> 2023-04-22 00:17:18.710951: I
>>> >> >>>> tensorflow/core/platform/cpu_feature= _guard.cc:182] This TensorFlow
>>> >> >>>> binary is optimized to use available= CPU instructions in
>>> >> >>>> performance-critical operations.
>>> >> >>>> To enable the following instructions= : AVX2 FMA, in other operations,
>>> >> >>>> rebuild TensorFlow with the appropri= ate compiler flags.
>>> >> >>>> 2023-04-22 00:17:19.429409: W
>>> >> >>>> tensorflow/compiler/tf2tensorrt/util= s/py_utils.cc:38] TF-TRT Warning:
>>> >> >>>> Could not find TensorRT
>>> >> >>>> Traceback (most recent call last): >>> >> >>>>=C2=A0 =C2=A0File "/usr/opt/baby= Spock/gpt-2/src/generate_unconditional_samples.py",
>>> >> >>>> line 9, in <module>
>>> >> >>>>=C2=A0 =C2=A0 =C2=A0import model, sam= ple, encoder
>>> >> >>>>=C2=A0 =C2=A0File "/usr/opt/baby= Spock/gpt-2/src/model.py", line 3, in <module>
>>> >> >>>>=C2=A0 =C2=A0 =C2=A0from tensorflow.c= ontrib.training import HParams
>>> >> >>>> ModuleNotFoundError: No module named= 'tensorflow.contrib'
>>> >> >>>
>>> >> >>>
>>> >> >>> Use Python3.7 or earlier.
>>> >> >>>
>>> >> >>> --
>>> >> >>> Best regards,
>>> >> >>> Odhiambo WASHINGTON,
>>> >> >>> Nairobi,KE
>>> >> >>> +254 7 3200 0004/+254 7 2274 3223
>>> >> >>> "Oh, the cruft.", egrep -v = 9;^$|^.*#' =C2=AF\_(=E3=83=84)_/=C2=AF :-)
>>> >> >>> [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html]
>>> >> >>
>>> >> >>
>>> >> >>
>>> >> >> --
>>> >> >> Mario.
>>> >> >
>>> >> >
>>> >> >
>>> >> > --
>>> >> > Best regards,
>>> >> > Odhiambo WASHINGTON,
>>> >> > Nairobi,KE
>>> >> > +254 7 3200 0004/+254 7 2274 3223
>>> >> > "Oh, the cruft.", egrep -v '^$|^.*= #' =C2=AF\_(=E3=83=84)_/=C2=AF :-)
>>> >> > [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html]
>>> >>
>>> >>
>>> >>
>>> >> --
>>> >> Aryeh M. Friedman, Lead Developer, http://www.Petite= Cloud.org
>>> >
>>> >
>>> >
>>> > --
>>> > Best regards,
>>> > Odhiambo WASHINGTON,
>>> > Nairobi,KE
>>> > +254 7 3200 0004/+254 7 2274 3223
>>> > "Oh, the cruft.", egrep -v '^$|^.*#' = =C2=AF\_(=E3=83=84)_/=C2=AF :-)
>>> > [How to ask smart questions: htt= p://www.catb.org/~esr/faqs/smart-questions.html]
>>>
>>>
>>>
>>> --
>>> Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org=
>>
>>
>>
>> --
>> Mario.
>
>
>
> --
> Mario.



--
Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org


--
Mario.
--0000000000001b5a4f05f9f0bedd--