gpt4all icon indicating copy to clipboard operation
gpt4all copied to clipboard

added support for chat.completion to return sse response

Open raja-jamwal opened this issue 1 year ago • 2 comments

Describe your changes

  • I was trying to use gpt4all with continue.dev but continue.dev expects SSE responses.
  • Added changes to return SSE response.
  • Tested with the publically available version of continue.dev and postman to validate the SSE response.

see this issue https://github.com/nomic-ai/gpt4all/issues/2174

Issue ticket number and link

Checklist before requesting a review

  • [x] I have performed a self-review of my code.
  • [ ] If it is a core feature, I have added thorough tests.
  • [ ] I have added thorough documentation for my code.
  • [ ] I have tagged PR with relevant project labels. I acknowledge that a PR without labels may be dismissed.
  • [x] If this PR addresses a bug, I have provided both a screenshot/video of the original bug and the working solution.

Demo

Screenshot 2024-08-25 at 1 36 05 PM

Screenshot 2024-08-25 at 1 36 32 PM

Steps to Reproduce

  • install continue.dev, set it up to use the existing local gpt4all server. Ask him something, it blanks out.
  • Use this build to ask it something, and it'll respond.

Notes

raja-jamwal avatar Aug 25 '24 08:08 raja-jamwal

@cebtenzzre Can I get a review on this?

raja-jamwal avatar Sep 08 '24 03:09 raja-jamwal

@cebtenzzre , please deal with this.

manyoso avatar Sep 10 '24 14:09 manyoso

@cebtenzzre @manyoso Can someone please review this PR? It would be awesome to finally be able to use GPT4All in all OpenAI API compatible apps (eg, not just continuedev but also OpenInterpreter).

lrq3000 avatar Nov 16 '24 12:11 lrq3000