llm
llm copied to clipboard
Add llm-bedrock-converse to plugin directory
Hi! I've published a new LLM plugin for AWS Bedrock Converse API:
Plugin: llm-bedrock-converse PyPI: https://pypi.org/project/llm-bedrock-converse/ GitHub: https://github.com/geehexx/llm-bedrock-converse
Features
- Full Converse API integration with tool/function calling support
- Streaming and non-streaming responses
- All Claude 3, 3.5, and 4 model variants
- Cross-region and global inference profiles
- Multi-modal support (images, PDFs, videos)
- Amazon Titan embedding models (v1 and v2)
- Automatic retry logic with exponential backoff
- 83% test coverage with comprehensive test suite
Installation
llm install llm-bedrock-converse
Usage
# Basic usage
llm -m bc-haiku "Hello"
# With tool calling
llm -m bc-sonnet-3.5 -T llm_time "What time is it?"
# Embeddings
llm embed -m titan-v2 -c "Hello world"
Would you be willing to add this to the plugin directory under the "Remote APIs" section? It provides comprehensive Bedrock Converse API support with tool calling, which complements the existing llm-bedrock plugins.
Thanks!
Created PR #1304 to add the plugin to the directory.