DevoxxGenieIDEAPlugin icon indicating copy to clipboard operation
DevoxxGenieIDEAPlugin copied to clipboard

Groq streaming doesn't work with Langchain4J

Open stephanj opened this issue 1 year ago • 1 comments

This is most likely a bug in Langchain4J...

stephanj avatar May 28 '24 13:05 stephanj

It gives a NPE on response.content() in InternalOpenAiHelper

    static Response<AiMessage> removeTokenUsage(Response<AiMessage> response) {
        return Response.from(response.content(), null, response.finishReason());
    }

stephanj avatar May 30 '24 06:05 stephanj