Simon Willison
Simon Willison
I got a version of this working, see draft PR: - #1185 I need to decide if tools added using `add_tool()` should be regular function tools or if they should...
The original need for this is MCP. As such, dynamically added tools still need access to information passed to the class constructor so that they can see the URL to...
... though I could leave that to the developer of the plugin - they could have a custom `__init__` method that binds `self` to the functions being added using `add_tool()`....
One more consideration: the output of `llm tools` will only show the class methods, since it cannot show stuff added to an instance by `add_tool()` or by dynamic code in...
I'm going to write docs for the `add_tool()` method and see if that clarifies how it should best work.
(For context to other readers, we talked about this briefly in person at PyCon US - this proposal is a continuation of that conversation.) I created the https://github.com/simonw/llm-prices repo with...
For price prediction, I'd really like LLM to grow a token counting features. For both Claude and Gemini you can send a prompt (with attachments and system prompts and tools...
> I think a schema that is compatible with yours but covers more ground is something like `provider`/`family`/`model`, but when the provider and the family are the same, they may...
Some random ideas for `llm-llama-server`: - As far as I can tell, it can only serve one model of time, but you can run multiple instances on different ports. It...
I'm working on this feature over here now: #898