bedrock-access-gateway icon indicating copy to clipboard operation
bedrock-access-gateway copied to clipboard

Fix the bedrock inference profile missing issue for sonnet 3.7

Open wang2nd opened this issue 10 months ago • 3 comments

identify inference_profile type from the foundation model list response itself

Issue #, if available:

Description of changes:

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

wang2nd avatar Feb 26 '25 19:02 wang2nd

Thanks for the contribution. But I don't see any bugs so far using sonnet 3.7.

Can you please describe what issue (bug) you faced and why we need this fix?

daixba avatar Feb 27 '25 01:02 daixba

I could not see sonnet 3.7 interference profile listed in the models api without changes, even after I checked out the main and rebuilt the server again.

wang2nd avatar Mar 03 '25 16:03 wang2nd

You can try to redeploy this solution and you should be able to use the Sonnet 3.7.

If you just deployed recently, try run curl -s $OPENAI_BASE_URL/models -H "Authorization: Bearer $OPENAI_API_KEY" | jq .data to refresh the model list.

daixba avatar Mar 07 '25 03:03 daixba