Daiki Ueno comments

Repositories
Issues
Comments

Results 122 comments of


                                            Daiki Ueno

rag: ramalama run --rag tries to connect to port 8080 even if a different port is chosen

A slightly better approach might be to communicate through a Unix domain socket, given the latest llama.cpp [got](https://github.com/ggml-org/llama.cpp/pull/12613) support for it in llama-server. Then rag_framework can be modified as below,...

rag: ramalama run --rag tries to connect to port 8080 even if a different port is chosen

@rhatdan yes, the latest container [image](https://quay.io/repository/ramalama/ramalama/manifest/sha256:51892a55dbbf6b9c117e26ef8e234b5db331edcc99e10095f00084112f1bdf95) seems to include the feature.