FreedomGPT
FreedomGPT copied to clipboard
Linux Version of the Application
I have suggestion to make an linux version of the app as it is based on electron so it should be eassy to provide an linux version .
If you're on Linux why not just use the Docker version?
It is already working on Linux
@eric-hansen @aktiwers How did you do it? I ran into the same problems as @Postconceptlab described in this issue https://github.com/ohmplatform/FreedomGPT/issues/89 except that I did not even come past the "loading model" page.
Then I tried installing the Docker version. (First time docker for me on Ubuntu 22.04.2, I ran into the same exact issues as described & solved here before I could run docker properly.)
Anyway: The result when I try to start FreedomGPT:
$ docker run -d -p 8889:8889 freedomgpt/freedomgpt
WARNING: The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64) and no specific platform was requested
03bccb2a63dd985c069f4569496ccfb28d9e81debb64cb0837d39af9ff42a971
Then it exits.
Yes sure I don't have ARM architecture, it's amd64 (Intel i5). How to solve this?
--platform arg. Not at computer to give full syntax
On Sun, Jul 2, 2023, 6:14 PM w-sky @.***> wrote:
@eric-hansen https://github.com/eric-hansen @aktiwers https://github.com/aktiwers How did you do it? I ran into the same problems as @Postconceptlab https://github.com/Postconceptlab described in this issue #89 https://github.com/ohmplatform/FreedomGPT/issues/89 except that I did not even come past the "loading model" page.
Then I tried installing the Docker version. (First time docker for me on Ubuntu 22.04.2, I ran into the same exact issues as described & solved here https://askubuntu.com/questions/941816/permission-denied-when-running-docker-after-installing-it-as-a-snap before I could run docker properly.)
Anyway: The result when I try to start FreedomGPT:
$ docker run -d -p 8889:8889 freedomgpt/freedomgpt WARNING: The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64) and no specific platform was requested 03bccb2a63dd985c069f4569496ccfb28d9e81debb64cb0837d39af9ff42a971
Then it exits.
Yes sure I don't have ARM architecture, it's amd64 (Intel i5). How to solve this?
— Reply to this email directly, view it on GitHub https://github.com/ohmplatform/FreedomGPT/issues/100#issuecomment-1616861464, or unsubscribe https://github.com/notifications/unsubscribe-auth/AB7DKZY2GQPPQ2NIMLVAB2TXOHXCTANCNFSM6AAAAAAZXAZYMA . You are receiving this because you were mentioned.Message ID: @.***>
@eric-hansen @aktiwers How did you do it? I ran into the same problems as @Postconceptlab described in this issue #89 except that I did not even come past the "loading model" page.
Then I tried installing the Docker version. (First time docker for me on Ubuntu 22.04.2, I ran into the same exact issues as described & solved here before I could run docker properly.)
Anyway: The result when I try to start FreedomGPT:
$ docker run -d -p 8889:8889 freedomgpt/freedomgpt WARNING: The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64) and no specific platform was requested 03bccb2a63dd985c069f4569496ccfb28d9e81debb64cb0837d39af9ff42a971
Then it exits.
Yes sure I don't have ARM architecture, it's amd64 (Intel i5). How to solve this?
A chroot or proot within the docker might be
Rebuilding the docker image on my system and then explicitly specifying the platform when running the container worked for me:
git clone https://github.com/ohmplatform/FreedomGPT.git
cd FreedomGPT/docker-app
docker build -t freedomgpt/freedomgpt .
docker run -p 8889:8889 --platform amd64 freedomgpt/freedomgpt
I'm not using the docker version - but I found the "Loading model" screen takes some time to load - but eventually it will load and work.
I Just followed the yarn install instructions in the README and re-build llama.cpp from source.
@w-sky I have uploaded llama.cpp build on Linux here: https://github.com/aktiwers/llama.cpp-linux-build
If you don't want to build it yourself.