meilisearch icon indicating copy to clipboard operation
meilisearch copied to clipboard

No space left on device except there is space left on device

Open irevoire opened this issue 3 years ago • 2 comments

Doubling down on @gmourier with #2764, when I try to index his dataset, I get a « no space left on device ». Except that... There is space on the device. I have ~120Go available, and when I monitor the disk usage of meilisearch, on multiple datasets I noticed it was always crashing around 10Go of index size used. (here, the dataset takes 2Go). image

I tried to run it with --max-task-db-size 10000g --max-index-size 10000g but it doesn't change anything.

irevoire avatar Sep 09 '22 12:09 irevoire

Discussed with the team, not a bug on Meilisearch file, @irevoire needs to complete with the solution to fix this

curquiza avatar Sep 12 '22 09:09 curquiza

Ah, but I don't know the solution; it's @Kerollmops that knows

irevoire avatar Sep 12 '22 13:09 irevoire

Hey everyone!

This error is triggered in the indexation process when there is no more available disk space, it can be strange that this issue is triggered as there looks like there is available space, but the engine uses a lot of temporary file in the process. @irevoire is on a linux platform that uses another disk partition for the temporary files, and this partition was filled during the indexing process.

The first part of the solution would be to document this possible issue @meilisearch/docs-team in the FAQ, and the way to fix it is by either redefining the temporary folder or increasing its size.

Kerollmops avatar Sep 27 '22 08:09 Kerollmops

I close this issue then! Thanks @Kerollmops for the answer

curquiza avatar Sep 27 '22 10:09 curquiza