chunkdot icon indicating copy to clipboard operation
chunkdot copied to clipboard

large matrix core dump

Open cccpocker opened this issue 1 year ago • 2 comments

my device is a cpu 32 cores and memory 64g machine. The matrix shape is (2000000,512), and when i use these to get result, it makes core dump.

HREADS exceeded, adding auxiliary array for thread metadata.
OpenBLAS warning: precompiled NUM_THREADS exceeded, adding auxiliary array for thread metadata.
Segmentation fault (core dumped)

cccpocker avatar Feb 22 '24 09:02 cccpocker

Hi @cccpocker thanks for raising the issue. Seems like an OpenBLAS bug, you can read here: https://stackoverflow.com/questions/75619847/python-sklearn-openblas-error-for-kmeans and https://github.com/OpenMathLib/OpenBLAS/issues/3321

Can you post the full stack trace, in which line in the code does this happen?

rragundez avatar Feb 25 '24 01:02 rragundez

Hi @cccpocker did you manage to find the solution? I hope so!

rragundez avatar Feb 28 '24 15:02 rragundez