Jiff Slater
Jiff Slater
After reading through some of the [spec](https://matrix.org/docs/spec/identity_service/r0.3.0#id24), I got this example to work by appending the serial in the keys file in place of the '0'. From the example above,...
I'd bring this up in the Matrix chatroom for a faster response.
Hey, here's what I've captured so far. I have the model stored at `~/meta-llama-3.1-8b-instruct`. ``` vector jiff ~/repo $ git clone [email protected]:meta-llama/llama-recipes.git vector jiff ~/repo $ git clone [email protected]:huggingface/transformers.git vector...
I tried again by downloading the model directly from HF and it quantised fine using the `convert_hf_to_gguf.py` script.