lit-llama icon indicating copy to clipboard operation
lit-llama copied to clipboard

What about a langchain wrapper for lit-llama?

Open mfranzon opened this issue 1 year ago • 4 comments

Do you think that can be useful having a custom langchain wrapper for lit-llama? Using the CustomLLM class, proposed in the langchain docs: https://python.langchain.com/en/latest/modules/models/llms/examples/custom_llm.html

Thank you :)

mfranzon avatar Apr 27 '23 09:04 mfranzon

Hey @mfranzon, that would be cool! Is it something you'd be interested in contributing?

lantiga avatar Apr 27 '23 09:04 lantiga

Sure! I would be very happy to give a try :)

mfranzon avatar Apr 27 '23 09:04 mfranzon

Any progress on this? I would also like to use it.

themantalope avatar Jun 09 '23 22:06 themantalope

@themantalope Yep, I am trying to do at my best but in this period I have to many commitments, I hope to push a PR as soon as possible.

mfranzon avatar Jun 13 '23 09:06 mfranzon