starcoder icon indicating copy to clipboard operation
starcoder copied to clipboard

How can I implement a custom LangChain class wrapper (LLM model/Agent) for StarCoder model?

Open mratanusarkar opened this issue 1 year ago • 3 comments

Is it possible to integrate StarCoder as an LLM Model or an Agent with LangChain, and chain it in a complex usecase? Any help / hints on the same would be appreciated!

ps: Inspired from this issue.

mratanusarkar avatar May 29 '23 11:05 mratanusarkar

like this? langchain/langchain/llms/huggingface_pipeline.py

reachlin avatar Jun 01 '23 05:06 reachlin

@reachlin langchain/langchain/llms/huggingface_pipeline.py will be integrating the StarCode as a huggingface model (LLM Model). That works, but having StarCode as an Agent or chain would be more interesting. I am looking for all types of integration between LangChain and StarCode. That would allow us to do a lot of things with code and codebases.

(Pardon my ignorance. If something like this already exists, please let me know)

mratanusarkar avatar Jun 05 '23 05:06 mratanusarkar

I guess as of now this is not possible as the support for custom LLM / self-made llm is not there.

complete-dope avatar Jun 05 '23 19:06 complete-dope