LLMstudio
LLMstudio copied to clipboard
[Feat] AWS Bedrock Provider
WIP
Summary
- Creat
06_explore_aws_bedrock.ipynb
to test Boto3 streaming and non-streaming calls, as well as raw Python (without Boto3) streaming and non-streaming code. - Test Converse-stream api in
06_explore_aws_bedrock.ipynb
. - Parse response from Converse api in notebook.
- Start creating
bedrock.py
provider. - Create payload to send to aws.
- Create headers to send with the post request.
- Add parsing of the binary chunks into manageable headers and payloads.
- Add logic to handle different event_types.
- Add chunk generators.
- Add chunk yielding.
Notes:
- I believe raw Python calls without boto3 require more code and a higher level of effort to maintain, as AWS can always change things and potentially break our code.
- Do not forget to add the supported models to
config.yaml