Kathy Yu comments

Repositories
Issues
Comments

Results 1 comments of


                                            Kathy Yu

Internal Server Error When Sending Predict Requests to Vertex AI Endpoint with Mixtrail 8x7b instruct Model

Thank you @MangoHiller for bring this to our attention. We were able to reproduce your error with long prompts, which led to high memory usage. We found that the error...