private-gpt icon indicating copy to clipboard operation
private-gpt copied to clipboard

Published 20 hours ago • verified publisher icon zylon-ai

Parsing PDF takes forever

Open Bardo-Konrad opened this issue 10 months ago • 1 comments

I get endless output like this

Parsing nodes: 100%|██████████████████████████████████████████████████████████████████████████| 1/1 [00:00<?, ?it/s]
Generating embeddings: 0it [00:00, ?it/s]
Parsing nodes: 100%|██████████████████████████████████████████████████████████████████████████| 1/1 [00:00<?, ?it/s]
Generating embeddings: 100%|██████████████████████████████████████████████████████████| 1/1 [00:02<00:00,  2.88s/it]
Generating embeddings: 0it [00:00, ?it/s]

For a simple 497KB pdf it's already 186s / 30.9s and counting.

What is wrong?

Bardo-Konrad avatar Mar 28 '24 20:03 Bardo-Konrad