llm-chain icon indicating copy to clipboard operation
llm-chain copied to clipboard

Add dev container to repo

Open dfberry opened this issue 1 year ago • 4 comments

It would be helpful is the repo had a dev container. Happy to provide though a PR.

dfberry avatar May 05 '24 00:05 dfberry

We'd welcome a contribution.

Juzov avatar May 06 '24 07:05 Juzov

@chenwanqq can you say more about llama.cpp?

dfberry avatar May 06 '24 14:05 dfberry

@chenwanqq can you say more about llama.cpp?

Sorry, I deleted my post before because when I replied, I just did not really understand what a dev container is. Of course, a dev container setting would be very beneficial for this project. The llm-chain cannot work by itself (unless you use llm-chain-mock). It requires an llm backend. So, if you want to set up a dev container that contains everything a developer needs, you should consider which llm backend should be used. For example, if you can use llm-chain-openai, then you need to ask developers to provide their own API key. Or, this container could have a compiled llama.cpp inside, so developers can run llm locally. Hmm I think there are many possible scenarios.

chenwanqq avatar May 06 '24 14:05 chenwanqq

I can't seem to run this in just a rust container and I'm new to langchain. So basically every chain configuration (and the resulting dependency) would need to be accounted for in the dev container. There is no single base that would work. Is that what you are saying?

dfberry avatar May 06 '24 15:05 dfberry