google-cloud-java icon indicating copy to clipboard operation
google-cloud-java copied to clipboard

flaky test: vertexai.it.ITChatSessionIntegrationTest

Open zhumin8 opened this issue 6 months ago • 3 comments

Came across this failure, seems flaky.

full log

14:11:07:524 [ERROR] Tests run: 4, Failures: 0, Errors: 4, Skipped: 0, Time elapsed: 3.670 s <<< FAILURE! -- in com.google.cloud.vertexai.it.ITChatSessionIntegrationTest
14:11:07:524 [ERROR] com.google.cloud.vertexai.it.ITChatSessionIntegrationTest.sendMessageMixedStreamAndUnary_historyOfFour -- Time elapsed: 2.785 s <<< ERROR!
com.google.api.gax.rpc.NotFoundException: io.grpc.StatusRuntimeException: NOT_FOUND: Publisher Model `projects/cloud-java-ci-test/locations/us-central1/publishers/google/models/gemini-pro` was not found or your project does not have access to it. Please ensure you are using a valid model version. For more information, see: https://cloud.google.com/vertex-ai/generative-ai/docs/learn/model-versions

zhumin8 avatar Jun 04 '25 18:06 zhumin8

@jaycee-li Can you take a look?

suztomo avatar Jun 13 '25 18:06 suztomo

The error message indicates the deprecated gemini-pro model was used. I recall @diegomarquezp updated all models for Vertex AI tests in May. Should this issue still be occurring? When was this error last observed?

jaycee-li avatar Jun 16 '25 17:06 jaycee-li

They were updated to the current one in 1.x

https://github.com/googleapis/google-cloud-java/pull/11550 -> solves missing model problem (the model references were updated)

However, it looks like not any GCP project can access these models. From https://cloud.google.com/vertex-ai/generative-ai/docs/learn/model-versions#key-terms:

Access to legacy stable models might be restricted for new projects. See Legacy stable models.

diegomarquezp avatar Jun 16 '25 19:06 diegomarquezp

Because the original "model not found" problem is solved. I'm marking this as fixed.

suztomo avatar Jul 28 '25 14:07 suztomo