langchain icon indicating copy to clipboard operation
langchain copied to clipboard

Published 20 hours ago • verified publisher icon langchain-ai

LlamaCpp loading time

Open reddiamond1234 opened this issue 1 year ago • 0 comments

Can I improve loading time of Llama Cpp 7b/13b? I am using LlamaCpp function with LLMChain and RetrievalQA.from_chain_type in my python code.

reddiamond1234 avatar Jun 14 '23 11:06 reddiamond1234