Christopher Harrison

icon indicating an email [email protected]

icon company Great Lakes SAN icon location Madison icon location Just a geek working on a PhD in large scale analysis, trying to run a company while developing HPC/HTC resources within a compliance environment.

Results 7 comments of Christopher Harrison

Local LLM could not connect

where you able to get the model running? Were you able to run the model outside the frameware with the ollama command?

Could you please showcase one end-to-end example to run a model over Kubernetes cluster (AKS, etc) with one RAG implementation please?

@ajmal-yazdani This is a great suggestion. I have been working on a websocket chat agent already. While its not ready for checkin and/or demo yet it will be coming soon....

Could you please showcase one end-to-end example to run a model over Kubernetes cluster (AKS, etc) with one RAG implementation please?

I just updated the docker image which can run llmware examples in a aks cluster or local cluster. There is a docker-compose file which provides the extra database infrastructure. You...

Could you please showcase one end-to-end example to run a model over Kubernetes cluster (AKS, etc) with one RAG implementation please?

I have a pull request outstanding which will allow you to play with a full docker-compose full service infrastructure. Please see my pull request for the update.

Could you please showcase one end-to-end example to run a model over Kubernetes cluster (AKS, etc) with one RAG implementation please?

with docker-compose from the devcontainer folder you can run the following command and then all the infrastructure will be up. Docker exec -it into the llmware container and run the...

array out of bounds error in retrieval

I am able to reproduce the issue if I have an extra space or double space in the the query text.

array out of bounds error in retrieval

This does not fix the bug. I have submitted the fix already with PR#471