VirtualSpectre

Any support for OpenBLAS?

2

Hi RWKV team, as original GGML has support for OpenBlas, is there any directives we could set to enable the compilation for it ?

python3 finetune.py --base_model='TheBloke/Dolphin-Llama2-7B-GPTQ' --data_path='data/codeup_19k.json' --num_epochs=10 --cutoff_len=512 --group_by_length --output_dir='./test-llama-2/7b' --lora_target_modules='[q_proj,k_proj,v_proj,o_proj]' --lora_r=16 --micro_batch_size ===================================BUG REPORT=================================== Welcome to bitsandbytes. For bug reports, please run python -m bitsandbytes and submit this information together with...

# Prerequisites Before submitting your issue, please ensure the following: - [ ] I am running the latest version of PowerInfer. Development is rapid, and as of now, there are...

Feature Request: support embedding stella_en_400M and stella_en_400M.gguf conversion

4

### Prerequisites - [X] I am running the latest code. Mention the version if possible as well. - [X] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.md). - [X] I searched using keywords...