faiss-wheels icon indicating copy to clipboard operation
faiss-wheels copied to clipboard

Published 20 hours ago • verified publisher icon kyamagu

Segfault in macOS in the presence of other OpenMP dependent packages

Open kyamagu opened this issue 1 year ago • 2 comments

Describe the bug faiss may crash when there is another imported package that depends on libomp.

To Reproduce Import a package that depends on OpenMP on macOS, then import faiss-cpu package. Use faiss as usual.

Expected behavior Should not segfault.

Desktop (please complete the following information):

  • OS: macOS
  • Architecture: arm64
  • Python: any
  • Version: v1.7.3

Additional context https://github.com/facebookresearch/faiss/issues/2463 https://github.com/benfred/implicit/issues/613#issuecomment-1242566564 https://github.com/dmlc/xgboost/issues/7039#issuecomment-860932242 https://bugs.llvm.org/show_bug.cgi?id=50579

kyamagu avatar Apr 21 '23 00:04 kyamagu

https://github.com/pytorch/pytorch/issues/44282

kyamagu avatar Apr 21 '23 01:04 kyamagu

A dangerous workaround is to set the following environment variable.

export KMP_DUPLICATE_LIB_OK=TRUE

kyamagu avatar Jan 29 '24 05:01 kyamagu