tabby
tabby copied to clipboard
Windows tabby.exe crashed
Version:
v0.21.2-rc.2 https://tabby_x86_64-windows-msvc-cuda117.zip/
Machine
PC with windows 11 and RTX 2070
I run this command:
.\tabby.exe serve --model StarCoder-1B --chat-model Qwen2-1.5B-Instruct --device cuda
First 2 or 3 models get downloaded and then a crash happen:
Failed to read directory: 0s {code: 3, kind: NotFound, message: "The system cannot find the path specified."}
Location: crates\llama-cpp-server\src\supervisor.rs:158
Backtrace omitted. Run with RUST_BACKTRACE=1 environment variable to display it.
Run with RUST_BACKTRACE=full to include source snippets.
GOAL:
What i want to do is create a tabby server on windows to be used in my visual studio code on mac.