LLM-VM
LLM-VM copied to clipboard
Create HTTP/HTTPS endpoints for inference and finetuning
What should be arguments/body for these end points?
Endpoints for:
- Inference
- Finetuning
- Rebel agent
- Other
I am interested in this issue and would like to be assigned to it.
Hi, Can I please work on this issue? Thank you!
https://github.com/lucylililiwang/LLM-VM/blob/lucylililiwang-Create-endpoints-for-inference/Create-endpoints-for-inference.py
'initial comment'