SrVill

> There's no such flag named `--trust-remote-code` > > edit: I was wrong. But even when enabled I get the same message still. Same problem. After setting the flag (which...

> It looks like people have managed to get the full versions of the model running... How did they do it? So far I'm stuck on a bug: Traceback (most...

The same mistake. Maybe I'm doing something wrong? C:\llama.cpp>convert.py 4bit.safetensors --outtype q4_1 --outfile 4ggml.bin Loading model file 4bit.safetensors Traceback (most recent call last): File "C:\llama.cpp\convert.py", line 1145, in main() File...

I had something else in mind. It does not matter on what to run the model locally (GPU or CPU), it is important that the plugin can work with a...