Aiden Dai comments

Results 39 comments of


                                            Aiden Dai

作者你好，我来提一个需求：是否可以考虑使用aiobotocore来做比boto3更好的异步调用

当前已经优化了异步调用，不需要使用aioboto，可以测试下，有问题再提。这个比较老了，先关掉。

feat: Enable Imported models

Thanks for the contribution. I am afraid I can't merge the code for now. The repo is using converse API to access Bedrock Models. But right now, there are very...

feat: prompt caching

Prompt caching in Bedrock is still in preview. May consider adding the support once it's GA.

Add configurable port

Code Merged. Thanks for contribution.

Reasoning should use <think></think> tags

Thanks for the issue and PR, sorry to get back late. I have thought about this too at the beginning, there are some advantages of using separate field for the...

Fix the bedrock inference profile missing issue for sonnet 3.7

Thanks for the contribution. But I don't see any bugs so far using sonnet 3.7. Can you please describe what issue (bug) you faced and why we need this fix?

Fix the bedrock inference profile missing issue for sonnet 3.7

You can try to redeploy this solution and you should be able to use the Sonnet 3.7. If you just deployed recently, try run `curl -s $OPENAI_BASE_URL/models -H "Authorization: Bearer...

AWS partition is hard coded. Can't deploy the stack in other paritions.

Sorry, there is no plan to support other partitions for now. For other partitions that Bedrock supported, please manually change the ARNs in the CloudFormation template in the deployment folder...

Claude 3.7 Thinking Mode Fails After Tool Use with Error "response type must be thinking/redacted_thinking"

Thanks for the issue. I have noticed the `redacted_thinking` design in the offical documents, but I have trouble producing it. Not sure if you can share your prompts and maybe...