LLM-VM icon indicating copy to clipboard operation
LLM-VM copied to clipboard

Creating a REST API for LLM-VM

Open felixhsueh opened this issue 1 year ago • 15 comments

felixhsueh avatar Sep 11 '23 12:09 felixhsueh

Maybe create an api key provisioning system too?

mmirman avatar Sep 11 '23 16:09 mmirman

Yes, we need the api key and the user needs to be registered. User registration is equivalent to applying for a trial system.

felixhsueh avatar Sep 11 '23 18:09 felixhsueh

Do we have a user registration already?

bilal-aamer avatar Sep 15 '23 12:09 bilal-aamer

i dont think so

WadeFC avatar Sep 16 '23 18:09 WadeFC

Yeah, thank you for your feedback, we love to hear any feedback and discussion.

felixhsueh avatar Sep 17 '23 12:09 felixhsueh

@zachsueh2023 True that! Thanks for helping teach the anarchy way :-)

mmirman avatar Sep 18 '23 12:09 mmirman

I've done some API management in Azure before and even did some "midair" transformations for authentication using Azure API Management tools (I think for HMAC but can't quite remember). I like working with APIs in general anyway so I can conform to any requirements as needed or do some research as to what are the best practices. I can also look into AWS or Google Cloud, if preferred.

jaywha avatar Sep 29 '23 16:09 jaywha

@jaywha we are not sure that the anarchy will use Azure, Google and AWS cloud, but you can look at rest api papers on google scholar. Yes, you can also go ahead and research these clouds so you can better contribute when anarchy decides which one to use.

felixhsueh avatar Sep 29 '23 17:09 felixhsueh

@mmirman I'd love to collaborate if someone is already working on this topic!

MananDoshi1301 avatar Oct 06 '23 19:10 MananDoshi1301

@VictorOdede what would the endpoints be? which language model call? I have done rest apis in djangorestframework

Jobhdez avatar Oct 16 '23 14:10 Jobhdez

@Jobhdez @MananDoshi1301 @jaywha I will add a few tasks around this by tomorrow. Feel free to pick them up. if you're interested.

VictorOdede avatar Oct 18 '23 08:10 VictorOdede

@VictorOdede Yes sure Vik, thanks. Would be very happy to contribute!

MananDoshi1301 avatar Oct 19 '23 19:10 MananDoshi1301

Same here! We can divide and conquer this issue 😁

jaywha avatar Oct 19 '23 19:10 jaywha

Hi, can I please work on this issue? Thank you!

lucylililiwang avatar Feb 17 '24 19:02 lucylililiwang

https://github.com/lucylililiwang/LLM-VM/blob/lucylililiwangfrom_rest-api/rest_api.py

lucylililiwang avatar Feb 18 '24 00:02 lucylililiwang