localGPT icon indicating copy to clipboard operation
localGPT copied to clipboard

cpp-llama-python not found.

Open NitkarshChourasia opened this issue 10 months ago • 1 comments

Whenever I try to ingest my documents. It shows me this error, WHY?

It also gives me the solution to pip install cpp-llama-python

Can someone tell me what this is used for in the current project?

NitkarshChourasia avatar Mar 31 '24 21:03 NitkarshChourasia

Yes, llama-cpp-python is required for this program to work and you download it using pip install like you mentioned. It is a Python binding for llama-cpp and supports a number of hardware acceleration backends to speed up inference. cpp = C++ which is for efficient execution.

anabellechan avatar Apr 13 '24 15:04 anabellechan