NanoLLM icon indicating copy to clipboard operation
NanoLLM copied to clipboard

Server/Client architecture

Open WikiLucas00 opened this issue 5 months ago • 3 comments

Hello @dusty-nv ! I think the nanoLLM project could benefit from offering a server-client architecture, a little like what ollama does with ollama serve and the ollama client API. This way, the client for nanoLLM could easily be run outside of the docker container, and even on another device. I know you already worked on a web GUI, but it's not exactly the same use case IMHO.

WikiLucas00 avatar Sep 09 '24 19:09 WikiLucas00