Jonathan Yankovich

FWIW, and i may be repeating you here, i'm not sure - it appears that Flexgen can support fine-tuned OPT models, like Erebrus (sp); here's a link to a fellow...

See https://gist.github.com/whjms/2505ef082a656e7a80a3f663c16f4277

KoboldAI isn't RAM/VRAM intensive because of the web server. A TUI mode would be cute, but is certainly not going to be a performance win. A TUI mode would also...

This is great - I am attempting to stand up `docker-ChatRWKV.git`. I have a request: ## Add ability to use local model path I have several RWKV models already downloaded,...

I think you are right. Thank you, I'll give it a try.

I think this will be a issue for many, as the specifics of running an LLM are changing so fast that Guidance will have a hard time keeping up (see...

Found this thread while looking for a replacement for cursor.ai, which uses a fork of VS Code and adds some additional integration to allow you to "accept" suggestions (no commit,...

Not sure if this has been discussed, or if perhaps i missed it; I have a few cameras with Wyze Spotlights attached, and it would be jim-dandy to be able...

I'm encountering the same; I was encountering this on an earlier version of interpreter, but after updating, same error.

Sounds good - this issue is in our current sprint, so look forward to an update one way or the other in the next week or so. Thanks for the...