localGPT

localGPT copied to clipboard

running out of resources?

5

i have the following problem and im on a MacBook Air M2 with 16GB Ram ➜ localGPT git:(main) ✗ python run_localGPT.py --device_type cpu Running on: cpu load INSTRUCTOR_Transformer max_seq_length 512...

vipervs

LLM and InstructEmbeddings models now can be set in `constants.py`.

Vokturz

Program is running on CPU while set on GPU

6

Running on a threadripper + RTX A6000 with 48gb of VRAM. I did the installation but i went through some issues. - First one: Couldnt ingest because i got the...

vaylonn

Other llm models?

2

It's possible to run other llm models? What Is needed to modify to run by example red pajama with this? Tks for all your work c:

NoNamedCat

python ingest.py gets stuck on "load INSTRUCTOR_Transformer"

2

After running pip install -r requirements.txt and putting a new pdf into the source_documents folder. I ran python ingest.py . The first time it installed additional reequipments **but got stuck...

mindwellsolutions

AssertionError: Torch not compiled with CUDA enabled

4

receiving this error after install AssertionError: Torch not compiled with CUDA enabled

Filmz5

Running localGPT

1

I have tried running localGPT and get the follwoing error [enforce fail at ..\c10\core\impl\alloc_cpu.cpp:72] data. DefaultCPUAllocator: not enough memory: you tried to allocate 67108864 bytes. C:\AI\LocalGPT>python run_localGPT.py Running on: cuda...

bravo1800

Also i receive this warning

16

I receive this error message in a new conda environnement: C:\Users\(myname)\anaconda3\envs\privategpt\lib\site-packages\transformers\generation\utils.py:1255: UserWarning: You have modified the pretrained model configuration to control generation. This is a deprecated strategy to control generation...

lelapin123

This is the error i get when i start ingest.py

8

─────────────────────────────── Traceback (most recent call last) ────────────────────────────────╮ │ E:\localGPT\ingest.py:49 in │ │ │ │ 46 │ │ 47 │ │ 48 if __name__ == "__main__": │ │ ❱ 49 │...

Eldiablozzz

HuggingFace timeout

3

Hello, A timeout exception occurred from HuggingFace when running ingest.py. Any suggestions?  williamj

williamj77