IllegalStateException: Queue full

[bamthomas]

Describe the bug When indexing locally with a memory BlockingQueue we have an exception IllegalStateException: Queue full.

To Reproduce

It is a bug observed by a user with :

40.3K documents, among which 20.8K on disk and 35.65 GB of disk usage.

Expected behavior

Do not have the error.

Desktop (please complete the following information):

• Intel Xeon E5-2630 16 cores, 32 GB RAM.
• OS: Ubuntu 20.04 LTS

[bamthomas]

with a blocking queue, the capacity is 0. That means that if there is no consumer, then the queue is full even with 1 item.

https://stackoverflow.com/questions/9151871/queue-full-on-depth-of-the-blocking-queue-clarification-needed

What is weird is that we are using an ArrayBlockingQueue<Path> with an initial capacity of 1024.

Does that mean that the consumer(s) are going slower than the production and that the queue is full ? I'm going to do some tests.

[bamthomas]

I'm trying to reproduce. I have 17479 files / 82GB (11506 mp3 files).

I launched :

$ datashare -d /media/bthomas/My Passport/musique -m CLI --stage SCAN,INDEX

after indexnig I have 12282 indexed files (11406 mp3 files). Some files (most of them are .db files) launched an exception.

I've not seen any IllegalStateException: Queue full message.

Desktop (please complete the following information):

• Intel(R) Core(TM) i7-8550U CPU @ 1.80GHz (8 cores)
• Ubuntu 20.04

[marieglr]

Another user encountered this error when trying to scan PDFs for OCR (email on 23/09):

[github-actions[bot]]

This issue is stale because it has been open for 40 days with no activity.

[github-actions[bot]]

This issue is stale because it has been open for 40 days with no activity.

[github-actions[bot]]

This issue was closed because it has been inactive for 20 days since being marked as stale.