James Coleman

icon indicating a website link http://mrgeckosmedia.com icon indicating an email [email protected]

icon company Mr. Gecko's Media icon location Huntsville, AL icon location I write code as a hobby mainly, and I enjoy doing so to learn and help people.

Results 24 comments of James Coleman

[Feature] Support Chatbot to use other LLM models such as ChatGLM-6B

I have a 3080 12GB in my gaming PC, but the UI eats a lot of the VRAM and I wouldn't want it to be my primary server for this....

[Feature] Support Chatbot to use other LLM models such as ChatGLM-6B

Playing with my 3080 12GB, WIS is working fine however I had to swap out the 13B model for a 7B model, `TheBloke/wizardLM-7B-GPTQ` in my case. I also had to...

[Feature] Support Chatbot to use other LLM models such as ChatGLM-6B

Do you want someone to revamp your chatbot ui demo to act more like a standard conversation UI some people expect to see? I'm asking before I work on it...

[Feature] Support Chatbot to use other LLM models such as ChatGLM-6B

Do you have plans on having history on the chatbot so you can ask it followup questions? Maybe we can use a UUID (similar to idea in https://github.com/toverainc/willow/issues/74) to keep...