Issue reading PDFS

[focusai]

Just to highlight that some PDFs just don't read during the ingest process. So if you think it's not working it could actually be the PDF. Possibly just the OCR during the process? Does anyone know of a solution to this? Or what would cause certain PDF files to be unreadable?

Thanks

[bschleter]

i had this issue too, they wouldn't even ingest. I got a .ds_store error, so delete a few pdfs that aren't necessarily viewable, and this allowed me to ingest and solve the issue. There might be an issue with PDF reader etc. I think this initial repo worked well because the PDFs were so simple, mostly text but I think the PDF reader struggles with PDFs with images and other elements.

[focusai]

Makes sense, thanks for sharing

[mayooear]

Yes, good point. OCR, corrupted/non-viewable PDFs and scanned PDFs are very difficult to read, so that is another cause of errors.

[dosubot[bot]]

Hi, @focusai! I'm Dosu, and I'm helping the gpt4-pdf-chatbot-langchain team manage their backlog. I wanted to let you know that we are marking this issue as stale.

Based on my understanding, you were experiencing problems with certain PDF files not being read during the ingest process. It seems that deleting PDFs that aren't necessarily viewable has solved the issue for some users. Additionally, bschleter mentioned that the PDF reader may struggle with PDFs containing images and other elements. mayooear also mentioned that OCR, corrupted/non-viewable PDFs, and scanned PDFs can cause errors.

Before we close this issue, we wanted to check if it is still relevant to the latest version of the gpt4-pdf-chatbot-langchain repository. If it is, please let us know by commenting on this issue. Otherwise, feel free to close the issue yourself, or it will be automatically closed in 7 days.

Thank you for your understanding and contribution to the gpt4-pdf-chatbot-langchain project!