FreedomGPT icon indicating copy to clipboard operation
FreedomGPT copied to clipboard

Linux Version of the Application

Open Nktech-Official opened this issue 1 year ago • 8 comments

I have suggestion to make an linux version of the app as it is based on electron so it should be eassy to provide an linux version .

Nktech-Official avatar Jun 28 '23 12:06 Nktech-Official

If you're on Linux why not just use the Docker version?

eric-hansen avatar Jun 29 '23 12:06 eric-hansen

It is already working on Linux

aktiwers avatar Jun 29 '23 14:06 aktiwers

@eric-hansen @aktiwers How did you do it? I ran into the same problems as @Postconceptlab described in this issue https://github.com/ohmplatform/FreedomGPT/issues/89 except that I did not even come past the "loading model" page.

Then I tried installing the Docker version. (First time docker for me on Ubuntu 22.04.2, I ran into the same exact issues as described & solved here before I could run docker properly.)

Anyway: The result when I try to start FreedomGPT:

$ docker run -d -p 8889:8889 freedomgpt/freedomgpt
WARNING: The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64) and no specific platform was requested
03bccb2a63dd985c069f4569496ccfb28d9e81debb64cb0837d39af9ff42a971

Then it exits.

Yes sure I don't have ARM architecture, it's amd64 (Intel i5). How to solve this?

w-sky avatar Jul 02 '23 22:07 w-sky

--platform arg. Not at computer to give full syntax

On Sun, Jul 2, 2023, 6:14 PM w-sky @.***> wrote:

@eric-hansen https://github.com/eric-hansen @aktiwers https://github.com/aktiwers How did you do it? I ran into the same problems as @Postconceptlab https://github.com/Postconceptlab described in this issue #89 https://github.com/ohmplatform/FreedomGPT/issues/89 except that I did not even come past the "loading model" page.

Then I tried installing the Docker version. (First time docker for me on Ubuntu 22.04.2, I ran into the same exact issues as described & solved here https://askubuntu.com/questions/941816/permission-denied-when-running-docker-after-installing-it-as-a-snap before I could run docker properly.)

Anyway: The result when I try to start FreedomGPT:

$ docker run -d -p 8889:8889 freedomgpt/freedomgpt WARNING: The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64) and no specific platform was requested 03bccb2a63dd985c069f4569496ccfb28d9e81debb64cb0837d39af9ff42a971

Then it exits.

Yes sure I don't have ARM architecture, it's amd64 (Intel i5). How to solve this?

— Reply to this email directly, view it on GitHub https://github.com/ohmplatform/FreedomGPT/issues/100#issuecomment-1616861464, or unsubscribe https://github.com/notifications/unsubscribe-auth/AB7DKZY2GQPPQ2NIMLVAB2TXOHXCTANCNFSM6AAAAAAZXAZYMA . You are receiving this because you were mentioned.Message ID: @.***>

eric-hansen avatar Jul 02 '23 22:07 eric-hansen

@eric-hansen @aktiwers How did you do it? I ran into the same problems as @Postconceptlab described in this issue #89 except that I did not even come past the "loading model" page.

Then I tried installing the Docker version. (First time docker for me on Ubuntu 22.04.2, I ran into the same exact issues as described & solved here before I could run docker properly.)

Anyway: The result when I try to start FreedomGPT:

$ docker run -d -p 8889:8889 freedomgpt/freedomgpt
WARNING: The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64) and no specific platform was requested
03bccb2a63dd985c069f4569496ccfb28d9e81debb64cb0837d39af9ff42a971

Then it exits.

Yes sure I don't have ARM architecture, it's amd64 (Intel i5). How to solve this?

A chroot or proot within the docker might be

nacho00112 avatar Jul 04 '23 13:07 nacho00112

Rebuilding the docker image on my system and then explicitly specifying the platform when running the container worked for me:

git clone https://github.com/ohmplatform/FreedomGPT.git cd FreedomGPT/docker-app docker build -t freedomgpt/freedomgpt . docker run -p 8889:8889 --platform amd64 freedomgpt/freedomgpt

scubbx avatar Jul 07 '23 12:07 scubbx

I'm not using the docker version - but I found the "Loading model" screen takes some time to load - but eventually it will load and work.

image

I Just followed the yarn install instructions in the README and re-build llama.cpp from source.

aktiwers avatar Jul 07 '23 12:07 aktiwers

@w-sky I have uploaded llama.cpp build on Linux here: https://github.com/aktiwers/llama.cpp-linux-build

If you don't want to build it yourself.

aktiwers avatar Jul 07 '23 13:07 aktiwers