manubot-ai-editor icon indicating copy to clipboard operation
manubot-ai-editor copied to clipboard

Ability to use Python LLM package plugins

Open castedo opened this issue 5 months ago • 2 comments

This is a feature idea which I might add to copyaid.it. Might be something manubot-ai-editor wants to do too.

The llm Python package has a large number of plugins that can be used to easily (I assume) switch between different LLM APIs and local LLM models:

https://llm.datasette.io/en/stable/plugins/directory.html#plugin-directory

I imagine this plugin API interface is simple enough that it's a quick way to expand out into many different LLM implementations.

castedo avatar Sep 06 '24 15:09 castedo