billiard
billiard copied to clipboard
Handling numpy
Hello everyone, I'm not very familiar with Celery, so I'm seeking help. Currently, I'm working with NumPy using Celery, and during a loop where I'm loading .npy files with np.load, I'm encountering a "WorkerLostError." I've already tried memory mapping, and the .npy files are quite large (about 1500 x 3000). I've been continuously monitoring my local hardware, but there's no indication of overflow. Does anyone know how to resolve this issue?