Yagil Burowski
Yagil Burowski
Seeing this too. Oddly, starts at exactly `-c 1720` for me (M1 MBP, 16GB) with https://huggingface.co/TheBloke/Nous-Hermes-13B-GGML/resolve/main/nous-hermes-13b.ggmlv3.q4_K_M.bin. Full incantation: ``` ./main -m /path/to/TheBloke/Nous-Hermes-13B-GGML/nous-hermes-13b.ggmlv3.q4_K_M.bin -p "The meaning of life is:" -n 500...
Agree, it would be great to have this
Hard to tell what it is without more info: you can try to build + run from source to see what the error is. Given that 404 is "not found"...
It's pretty simple, added instructions: https://github.com/yagil/ChatIDE#build-and-run-from-source
@tribbloid I added support for newer claude here: https://github.com/yagil/ChatIDE/commit/b66f91ba8a19a20c899eb7d51bfd5d1467e3234c You will need to build and install from source, did not yet push this to the extension marketplace
CI fails unexpectedly which prevents publishing to the store at the moment: https://github.com/yagil/ChatIDE/issues/21
> same Hi @Friman04 what's the exact issue you're running into? Please share logs and the version of LM Studio / `lms` you're running
Thanks. Does it do it even after quitting / relaunching LM Studio?
This is really awesome @obeone !
@motin thanks for the bug report. Does it work with vanilla tokmon (without the beam UI)? `OPENAI_API_KEY="..." tokmon jupyter-notebook`