litellm icon indicating copy to clipboard operation
litellm copied to clipboard

bedrock: add apac claude support for cross region inferencing

Open wallies opened this issue 1 year ago • 6 comments

Title

bedrock: add apac claude support

Type

🐛 Bug Fix

Changes

Claude is now supported in APAC for cross inference profiles

wallies avatar Nov 07 '24 07:11 wallies

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
litellm ✅ Ready (Inspect) Visit Preview 💬 Add feedback Nov 7, 2024 8:38pm

vercel[bot] avatar Nov 07 '24 07:11 vercel[bot]

hi @wallies can you please add apac here - https://github.com/BerriAI/litellm/blob/48c6cdcd25f59b05307e6a5672690e40cf65d554/litellm/llms/bedrock/chat/converse_transformation.py#L457

so it's filtered correctly (assuming this is for cross region inferencing)

krrishdholakia avatar Nov 07 '24 18:11 krrishdholakia

@krrishdholakia what else do i need to do to get this merged?

wallies avatar Nov 11 '24 13:11 wallies

@krrishdholakia Could you take a look at this PR again. apac cross region inference with litellm is something I'm in need of.

joshackland avatar Nov 20 '24 02:11 joshackland

@ishaan-jaff is it possible to get this reviewed please?

wallies avatar Nov 24 '24 21:11 wallies

@krrishdholakia did this work get added as part of https://github.com/BerriAI/litellm/pull/6943?

wallies avatar Dec 03 '24 10:12 wallies

Why was this closed?

krrishdholakia avatar Mar 08 '25 15:03 krrishdholakia

Why was this closed?

It wasn't reviewed in a long time and most of the functionality is in main now

wallies avatar Mar 08 '25 21:03 wallies