private-gpt icon indicating copy to clipboard operation
private-gpt copied to clipboard

How to speed up ingestion

Open jonjia opened this issue 11 months ago • 1 comments

I'm curious about this and how to speed up. Is it Ollama issue? The size of my xxx.csv file is 15M. Ingestion costs 25 minutes.

IMG_9537

jonjia avatar Mar 12 '24 13:03 jonjia

If you installed Ollama recently you may want to try this: https://github.com/ollama/ollama/issues/3029#issuecomment-1987177366

RolT avatar Mar 14 '24 22:03 RolT

In the last ollama version (v.2.0), you can select how many concurrent requests and parallel you want. Please check this article :)

jaluma avatar Jul 16 '24 07:07 jaluma