[Question]: Regarding memory issues.

Open yuanpneg opened this issue 1 year ago • 3 comments

Describe your problem

My Linux server has 16GB of RAM. When I start parsing a file that is only 3KB, the memory gets filled up. Do I need more server memory, or is there a problem with my system?

Apr 26 '24 03:04 yuanpneg

The local embedding model needs lots of RAM.

Apr 26 '24 05:04 KevinHuSh

I'm not using a local model, I'm calling a model API.

Apr 26 '24 06:04 yuanpneg

Apr 26 '24 07:04 yuanpneg