bedrock-access-gateway icon indicating copy to clipboard operation
bedrock-access-gateway copied to clipboard

when the parameter 'messages' length exceeds 144, there will be no response.

Open dakai6677 opened this issue 9 months ago • 1 comments

the input token count is around 16000 model is 'anthropic.claude-3-sonnet-20240229-v1:0'

curl http://Bedroc-Proxy-xxxx.us-east-1.elb.amazonaws.com/api/v1/chat/completions
-H "Content-Type: application/json"
-H "Authorization: Bearer xxxx"
-d @/home/ec2-user/param.json

dakai6677 avatar May 27 '24 08:05 dakai6677