llama-stack icon indicating copy to clipboard operation
llama-stack copied to clipboard

llama-stack api for QLORA finetuning (atleast meta-reference)

Open maswadkar opened this issue 11 months ago • 2 comments

🚀 The feature, motivation and pitch

I see that llama-stack is becoming very powerful set of tool which sits on top of LLM model. inference, memory, agent, scoring, eval etc can be used via APIs

but for finetuning, either today we have to go out of llama stack ecosystem to torchtune or other libraries

i strongly believe if we add API for finetuning (atleast to start with single node meta-reference), llama-stack will become one stop s

Alternatives

No response

Additional context

No response

maswadkar avatar Nov 07 '24 19:11 maswadkar