LLMstudio icon indicating copy to clipboard operation
LLMstudio copied to clipboard

[Feat] AWS Bedrock Provider

Open diogoazevedo15 opened this issue 5 months ago • 0 comments

WIP

Summary

  1. Creat 06_explore_aws_bedrock.ipynb to test Boto3 streaming and non-streaming calls, as well as raw Python (without Boto3) streaming and non-streaming code.
  2. Test Converse-stream api in 06_explore_aws_bedrock.ipynb.
  3. Parse response from Converse api in notebook.
  4. Start creating bedrock.py provider.
  5. Create payload to send to aws.
  6. Create headers to send with the post request.
  7. Add parsing of the binary chunks into manageable headers and payloads.
  8. Add logic to handle different event_types.
  9. Add chunk generators.
  10. Add chunk yielding.

Notes:

  • I believe raw Python calls without boto3 require more code and a higher level of effort to maintain, as AWS can always change things and potentially break our code.
  • Do not forget to add the supported models to config.yaml

diogoazevedo15 avatar Sep 17 '24 15:09 diogoazevedo15