Re: Installing openAI's GPT-2 Ada AI Language Model

On Fri, Apr 21, 2023 at 5:37 PM Mario Marietto <marietto2008@gmail.com> wrote:
>
> 1) try to use the linuxulator instead of bhyve (try to remember what Albert Einstein tells about those people that want to solve a problem without changing their perspective : he does not spend nice words for those people)

For long term deployment options (eventually I want a VM image people
can just download and run) running it on the host in the long term is
not a good idea and due to lack of hardware resources (and budget) the
only non-production/development platform that I can use is a VM on my
production VM host (has 3 other production machines on it).   Thus
*ANY* solution that does not involve VM's is a non-go.

>
> 2) actually an nvidia gpu can be passed-thru within linux (and within windows 11 if the gpu is amd)

See above we don't want to force people to have specific hardware.
If I remember right, weren't you the person I was helping late last
year to setup pass-thru on bhyve for your nvidia and it turned out to
need a bhyve patch (I assume from what you have said this was for the
2 os's you mentioned).   If I remember right this was specifically so
you could set up GPT-2.

>
> 3) the tutorial that we are suggesting may work even if you don't want to use your gpu

I was pointed to another tutorial privately that explains how to do it
on a VM (I hope ;-))

>
> 4) probably you should find the exact version of pytorch that it wants

According to chatGPT (and other sources) it will work on anything
newer than 1.13 but does not specify anything beyond that.