strikeoncmputrz

Results 9 comments of strikeoncmputrz

> > fail2ban-client get sshd actions > > The jail sshd has the following actions: > > iptables-multiport > > Hmm... This said that only one action (run-time values) is...

@orlyandico did you just guess on the number of layers to offload after seeing 81 total in Ollama logs, or is there some algorithm one can apply to estimate? I've...

[LLM_Web_search](https://github.com/mamei16/LLM_Web_search) is a similar capability implemented in Text Generation WebUI that uses Langchain for RAG. It's worked very well for me and with a good system or character prompt I...

@cmsax Do you need to include `https://` and what endpoint do you add after the port? `/v1`? If you could provide an example base url I'd really appreciate it! Didn't...

> @cmsax Do you need to include `https://` and what endpoint do you add after the port? `/v1`? > > If you could provide an example base url I'd really...

Adding a note in case folks find this issue while searching for tips on configuring fabric to connect to a local inference server. Confirmed Servers - https://github.com/theroyallab/tabbyAPI - https://github.com/oobabooga/text-generation-webui Both...

This would be an excellent feature. I'd rather not have to run my openai compatible inference server in http mode but I'm using a private public key infrastructure

This would be an outstanding feature!