generative-ai-cdk-constructs icon indicating copy to clipboard operation
generative-ai-cdk-constructs copied to clipboard

Knowledge base: support to invoke LLM on other region

Open statefb opened this issue 8 months ago • 0 comments

Describe the feature

The current implementation library does not support invoking AI models from a different region than the one where the Knowledge Base (KB) and other resources are deployed.

Use Case

claude3 only supports limited regions.

Proposed Solution

No response

Other Information

I may be able to implement this feature request, but I have other preoritized tasks, so I cannot promise the timeline to develop it.

Acknowledgements

  • [X] I may be able to implement this feature request
  • [ ] This feature might incur a breaking change

statefb avatar Jun 18 '24 23:06 statefb