Mr. AGI

If I create an unofficial server, will that be OK? (Provided I explicitly state that it is an unofficial server)

For the 8B in Q8 it is about 9GB RAM minus Your GPU's VRAM For the 70B in Q8 it's about 85GB RAM minus VRAM If you use smaller quantizations,...

I looked through the source code, and I can assure you that this is not malware. It might be a different app, or you might have downloaded it from somewhere...

I looked through the source code, and I can assure you that this is not malware.

Llama-cpp has dropped support for GGML models. You sould use GGUF files instead.

Try Axolotl, It'll make everything simpler. Jan should just generate a config file and start the finetuning.

Using LLMs for maths is always a bad idea. They are just not meant for that. Being able to do maths is a sign of super intelligence in AI, which...

No, I suppose then. Guess we are not gonna get a good open-source video generation model anytime soon.

Please help!

Running it as administrator fixed it in my case