instructor icon indicating copy to clipboard operation
instructor copied to clipboard

Published 20 hours ago • verified publisher icon jxnl

Amazon Bedrock support

Open austinmw opened this issue 10 months ago • 6 comments

Please add support for Amazon Bedrock 🤩

austinmw avatar Mar 28 '24 22:03 austinmw

I don't have any clients right now that are needing it so it's gonna have to wait unless someone contributes 😶

jxnl avatar Mar 28 '24 22:03 jxnl

now that we have

instructor.from_*, anyone is welcome to add a instructor.from_bedrock

jxnl avatar Apr 01 '24 15:04 jxnl

Would it be possible to implement it for Claude as I anticipate this is the primary model most of us are using via Bedrock right now? I have almost zero experience but I believe it comes down to allowing AnthropicBedrock client to be passed to the from_anthropic method:

image

Seems to be working for with this fix:

image

jarrod-dexter avatar Apr 01 '24 20:04 jarrod-dexter

sweet! ill take a PR for this

jxnl avatar Apr 01 '24 21:04 jxnl

any updates regarding its support ?

salahaz avatar Apr 05 '24 12:04 salahaz

Would be great to have something that works with boto3 too. I am happy to make a PR.

shabie avatar Apr 25 '24 22:04 shabie

+1 need this, since Anthropic announced tools feature on Bedrock.

fer-git avatar May 30 '24 23:05 fer-git

this is done, you can either do bedrock anthropic client, or use litellms's bedrock/* models

jxnl avatar May 31 '24 01:05 jxnl