langchaingo icon indicating copy to clipboard operation
langchaingo copied to clipboard

Getting 500 with Gemini-pro with longer request body

Open arkadyb opened this issue 1 year ago • 1 comments

Hi, i am trying to ask the model to summarize a random the document, however the response comes back with 500 from google api. With the context window limit of 1million token, is there any limitation on an individual request or the part length?

The request body is attached. gemini-request-body.json

Thanks,

arkadyb avatar Apr 22 '24 11:04 arkadyb

Thanks for your report. There are several layers of software involved here; are you able to reproduce this issue when using the Google AI Go SDK directly? And if yes, are you able to reproduce it by using curl?

eliben avatar May 23 '24 17:05 eliben