GRIB.jl icon indicating copy to clipboard operation
GRIB.jl copied to clipboard

Published 20 hours ago • verified publisher icon weech

Thread safety

Open rustyconover opened this issue 5 years ago • 2 comments

Hi,

GRIB.jl doesn't appear to be thread safe, when parsing multiple files on different threads this error is thrown:

fatal flex scanner internal error--end of buffer missed

Rusty

rustyconover avatar Nov 18 '20 14:11 rustyconover

Is there any chance you could provide a minimum working example that causes the error (in Julia)? I'm pretty sure the problem is that eccodes_jll isn't built with threading enabled. I have a recipe to fix that, but I want to make sure that fixes the error before I upload the new build recipe to Yggdrasil. I understand that threading bugs tend to be non-deterministic, so it could not be possible to write a test that catches the error.

weech avatar Nov 18 '20 17:11 weech

I merged the new build recipe to Yggdrasil that explicitly enables threading, so hopefully that fixes the problem.

weech avatar Nov 26 '20 02:11 weech