LocalAI icon indicating copy to clipboard operation
LocalAI copied to clipboard

Published 20 hours ago • verified publisher icon mudler

API - websocket ?

Open bakman2 opened this issue 2 years ago • 0 comments

Thanks a lot for this, works flawlessly on my m2 mac with node-red.

I have not used the OpenAI API but I can imagine because they have computing power that responses are fast and a restAPI would suffice - it would be nice to have a websocket server available in addition to REST so that we can follow along with the response instead of waiting.

bakman2 avatar May 05 '23 06:05 bakman2