Jan Badertscher

I wonder if you Finn @Chishikii could compile a Version with fixed NV/Thermal as saliro is on vacation? :)

> does the same happen in latest dev build? https://gyroflow.xyz/devbuild/?autodownload You can try the workaround from #412 Definitely the same root cause as #412 Solved by downloading latest dev build...

To use this with facebook-research/LLaMA-7b within [text-generation-webui](https://github.com/oobabooga/text-generation-webui) on windows 11: 1. git pull oobabooga/text-generation-webui 2. follow the installation instructions for conda 3. download HuggingFace converted model weights for LLaMA, or...

People should really support LAION's open-assistant.io project, because every person helping there, will improve a fully curated, crowd sourced, open sourced instruction fine tuning dataset, which in turn can be...

Is this Open-Source? This awesome list focuses on OSS.

Interesting project, but please add it to: ``` ## Libraries and Wrappers ### Model agnostic - here ``` then i can merge your PR

development seems to be stale. not adding it

vLLM just recently merged embedding support [here](https://github.com/vllm-project/vllm/pull/3734). But what I see is they basically just support LLM based embedding generation. Which are basically fine-tuned regular LLMs that use an instruction,...

Not sure if it helps and if it's related, but it works for me for gguf local: `docker run --gpus all -v C:\Users\xxx\.cache\lm-studio\models\bartowski\Meta-Llama-3.1-8B-Instruct-GGUF:/model ghcr.io/ericlbuehler/mistral.rs:cuda-90-sha-8a84d05 gguf -m /model -f Meta-Llama-3.1-8B-Instruct-Q6_K_L.gguf` Defining...

same for me on ubuntu WSL2: ``` sudo apt-key del 7fa2af80 wget https://developer.download.nvidia.com/compute/cuda/repos/wsl-ubuntu/x86_64/cuda-wsl-ubuntu.pin sudo mv cuda-wsl-ubuntu.pin /etc/apt/preferences.d/cuda-repository-pin-600 wget https://developer.download.nvidia.com/compute/cuda/11.7.0/local_installers/cuda-repo-wsl-ubuntu-11-7-local_11.7.0-1_amd64.deb sudo dpkg -i cuda-repo-wsl-ubuntu-11-7-local_11.7.0-1_amd64.deb sudo cp /var/cuda-repo-wsl-ubuntu-11-7-local/cuda-*-keyring.gpg /usr/share/keyrings/ sudo apt-get update...