continue icon indicating copy to clipboard operation
continue copied to clipboard

Published 20 hours ago • verified publisher icon continuedev

fallback for non-sse response

Open raja-jamwal opened this issue 1 year ago • 3 comments

Description

  • Solution for https://github.com/nomic-ai/gpt4all/issues/2174, gpt4all doesn't support SSE, this is a fallback in case the response is non-SSE.

Checklist

  • [x] The base branch of this PR is dev, rather than main
  • [x] The relevant docs, if any, have been updated or created

Screenshots

continue.dev loading from gpt4all

Screenshot 2024-08-25 at 12 33 55 PM

gpt4all logs

Screenshot 2024-08-25 at 12 39 57 PM

Testing

  • start gpt4all with the server mode.
  • in continue.dev use it as an OpenAI compatible provider.
  • ask something, it should respond.

raja-jamwal avatar Aug 25 '24 07:08 raja-jamwal