lit-llama
lit-llama copied to clipboard
What about a langchain wrapper for lit-llama?
Do you think that can be useful having a custom langchain wrapper for lit-llama? Using the CustomLLM class, proposed in the langchain docs: https://python.langchain.com/en/latest/modules/models/llms/examples/custom_llm.html
Thank you :)
Hey @mfranzon, that would be cool! Is it something you'd be interested in contributing?
Sure! I would be very happy to give a try :)
Any progress on this? I would also like to use it.
@themantalope Yep, I am trying to do at my best but in this period I have to many commitments, I hope to push a PR as soon as possible.