Llama-2-Open-Source-LLM-CPU-Inference
Llama-2-Open-Source-LLM-CPU-Inference copied to clipboard
kennethleungty
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
is there instructs for that - most of us AI folk have good gpus - seems silly not to use them.
I've been trying ways to get it to remember the questions and answers like how ChatGPT does it to have continuous with context chat, but keeps failing.
even I installed langchain but error is occured File "D:\ML\test\Llama-2-Open-Source-LLM-CPU-Inference\main.py", line 3, in from src.utils import setup_dbqa File "D:\ML\test\Llama-2-Open-Source-LLM-CPU-Inference\src\utils.py", line 7, in from langchain import PromptTemplate ModuleNotFoundError: No module named...
You seem to have cloned a repository without having git-lfs installed. Please install git-lfs and run `git lfs install` followed by `git lfs pull` in the folder you cloned. please...
First of all, my compliments for the project. I understood a lot and i succeded in create my private instance of LLM. Thanks a lot. I loaded many italian language...
Dear Llama-2-Open-Source-LLM-CPU-Inference developer, Greetings! I am vansinhu, a community developer and volunteer at InternLM. [InternLM](https://github.com/InternLM/InternLM) is a large language model similar to llama2, and we look forward to InternLM being...
Hi! Thanks - awesome job. I have a question - why changing config (bigger chunks, vector counts) lead to broken output? For example: VECTOR_COUNT: 3 CHUNK_SIZE: 600 CHUNK_OVERLAP: 50 Gives...
Great project here, I am wondering: What is a technique one could use to add conversation history to this method of QA Chain? I have not found any subject material...
* Using `llama-2-7b-chat.ggmlv3.q8_0.bin` downloaded today * I've setup everything running on a Dell PowerEdge 16-processor machine w/ 128GB of RAM. * Pointed to a directory that only had 4 PDFs...
Metadata
Owner
Metadata
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A