Flaky Test: ITGenerativeModelIntegrationTest:generateContentStream_withPlainText_nonEmptyCandidateList

[ldetmer]

This test was failing in some of the kokoro nightly builds

JUnit Vintage:ITGenerativeModelIntegrationTest:generateContentStream_withPlainText_nonEmptyCandidateList MethodSource [className = 'com.google.cloud.vertexai.it.ITGenerativeModelIntegrationTest', methodName = 'generateContentStream_withPlainText_nonEmptyCandidateList', methodParameterTypes = ''] => com.google.api.gax.rpc.InternalException: io.grpc.StatusRuntimeException: INTERNAL: Internal error encountered. com.google.api.gax.rpc.ApiExceptionFactory.createException(ApiExceptionFactory.java:110) com.google.api.gax.rpc.ApiExceptionFactory.createException(ApiExceptionFactory.java:41) com.google.api.gax.grpc.GrpcApiExceptionFactory.create(GrpcApiExceptionFactory.java:86) com.google.api.gax.grpc.GrpcApiExceptionFactory.create(GrpcApiExceptionFactory.java:66) com.google.api.gax.grpc.ExceptionResponseObserver.onErrorImpl(ExceptionResponseObserver.java:82) [...] Suppressed: java.lang.RuntimeException: Asynchronous task failed com.google.api.gax.rpc.ServerStreamIterator.hasNext(ServerStreamIterator.java:105) com.google.cloud.vertexai.generativeai.ResponseStreamIteratorWithHistory.hasNext(ResponseStreamIteratorWithHistory.java:37) com.google.cloud.vertexai.it.ITGenerativeModelIntegrationTest.assertNonEmptyAndLogTextContentOfResponseStream(ITGenerativeModelIntegrationTest.java:122) com.google.cloud.vertexai.it.ITGenerativeModelIntegrationTest.generateContentStream_withPlainText_nonEmptyCandidateList(ITGenerativeModelIntegrationTest.java:222) [email protected]/java.lang.reflect.Method.invoke(Method.java:568) Caused by: io.grpc.StatusRuntimeException: INTERNAL: Internal error encountered. io.grpc.Status.asRuntimeException(Status.java:533) [...]