Fix the bedrock inference profile missing issue for sonnet 3.7
identify inference_profile type from the foundation model list response itself
Issue #, if available:
Description of changes:
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.
Thanks for the contribution. But I don't see any bugs so far using sonnet 3.7.
Can you please describe what issue (bug) you faced and why we need this fix?
I could not see sonnet 3.7 interference profile listed in the models api without changes, even after I checked out the main and rebuilt the server again.
You can try to redeploy this solution and you should be able to use the Sonnet 3.7.
If you just deployed recently, try run curl -s $OPENAI_BASE_URL/models -H "Authorization: Bearer $OPENAI_API_KEY" | jq .data to refresh the model list.