Bulent Abali

> n_threads=(number of threads) same here. llm.n_threads = 1 or 8 or else makes no difference to the thread count.

> Is it about the memory usage? I don't know why I cant pass 300,000 chunks. I had a similar problem. Dropped 3000 pdf documents in the source_documents folder and...

My pdf names were mostly numerical characters, e.g. abc12278.pdf and so on. Main idea is to subset them in to batches in this case 100 of them. Nested for loops...

Can we kindly ask someone to review and merge this PR?