ollama-python icon indicating copy to clipboard operation
ollama-python copied to clipboard

Command Line Interface

Open p-vdp opened this issue 1 year ago • 1 comments

I'm running ollama on a remote server and would like to interact with it from another machine via CLI and the REST API.

This should be pretty straightforward to do with a custom Client object in __main__.py. Usage from a terminal would be something like this:

python -m ollama --endpoint http://remotehost:11434 --model llama3 --message "Why is the sky blue?"

I'm interested in implementing this. Do folks have a preference for CLI parameter handling? I prefer absl.

p-vdp avatar Jun 07 '24 19:06 p-vdp

I prefer Cyclopts

synacktraa avatar Jul 26 '24 12:07 synacktraa

As mentioned in #185, a CLI is be out of scope of this repo. You are however free to implement your a CLI in your own repo

mxyng avatar Aug 27 '24 23:08 mxyng