Api Server Example

Open e253 opened this issue 2 years ago • 5 comments

I made an example rocket.rs api server https://github.com/aurelianai/aurelian_server if anyone is interested.

Aug 25 '23 22:08 e253

I might have a more elaborate project utilizing rustformers/llm for a server that could be open sourced. Let me know if there is interest. It exposes WebSocket/SSE interfaces as well as endpoints for embedding, configurable sets of prompts and more.

Sep 09 '23 12:09 pixelspark

Would love to see it and contribute!

Sep 09 '23 17:09 e253

Would love to see it and contribute!

It took a bit longer than expected, but here it is: https://github.com/pixelspark/poly 🎉 let me know what you think @e253

Sep 30 '23 09:09 pixelspark

@philpax you might like it too

Sep 30 '23 09:09 pixelspark

That's awesome! Sorry, I was very behind on my emails. I've added it to the README - shame I couldn't mention it at the talk.

Oct 20 '23 22:10 philpax