[BUG] the binary binary_mtx, auc_thresholds = binarize(auc_mtx, num_workers = 15) get error

[honghh2018]

Describe the bug when i try to binarize the auc file in pyscenic final step, it getting error with : BLAS : Program is Terminated. Because you tried to allocate too many memory regions. BLAS : Program is Terminated. Because you tried to allocate too many memory regions. BLAS : Program is Terminated. Because you tried to allocate too many memory regions. BLAS : Program is Terminated. Because you tried to allocate too many memory regions. BLAS : Program is Terminated. Because you tried to allocate too many memory regions. ...

Mote that most errors are due to the input from the user, and therefore should be treated as questions in the Discussions. Please, only report them as bugs if you are quite certain that they are not behaving as expected. (pyscenic_20220616) [hhhong@node02 test_data]$ python test1.py ../PySCENIC/result/monocyte_macrophage_auc_mtx.csv

BLAS : Program is Terminated. Because you tried to allocate too many memory regions. BLAS : Program is Terminated. Because you tried to allocate too many memory regions. BLAS : Program is Terminated. Because you tried to allocate too many memory regions. BLAS : Program is Terminated. Because you tried to allocate too many memory regions. BLAS : Program is Terminated. Because you tried to allocate too many memory regions. BLAS : Program is Terminated. Because you tried to allocate too many memory regions. BLAS : Program is Terminated. Because you tried to allocate too many memory regions. ^CProcess ForkPoolWorker-9: Process ForkPoolWorker-4: Process ForkPoolWorker-11: Process ForkPoolWorker-2: Process ForkPoolWorker-22: Process ForkPoolWorker-15: Process ForkPoolWorker-24: Process ForkPoolWorker-23: Process ForkPoolWorker-27: Process ForkPoolWorker-26: Process ForkPoolWorker-10: Process ForkPoolWorker-25: Traceback (most recent call last): File "/share/apps/miniconda3/envs/pyscenic_20220616/lib/python3.8/multiprocessing/process.py", line 315, in _bootstrap self.run() File "/share/apps/miniconda3/envs/pyscenic_20220616/lib/python3.8/multiprocessing/process.py", line 108, in run

Steps to reproduce the behavior

1. Command run when the error occurred:

name='test' binary_mtx, auc_thresholds = binarize(auc_mtx, num_workers = 15) binary_mtx.to_csv(os.path.join(result,'{}_auc_mtx_binary.csv'.format(name)))

import os, sys, glob, argparse, re, pickle
os.environ['MKL_THREADING_LAYER'] = 'GNU'
#sys.path.remove("/home/honghh/.local/lib/python3.7/site-packages")
import scanpy as sc
import pandas as pd
from pyscenic.cli.utils import load_signatures
from pyscenic.export import export2loom, add_scenic_metadata
from pyscenic.utils import load_motifs
from pyscenic.transform import df2regulons
from pyscenic.aucell import aucell
from pyscenic.binarization import binarize
from pyscenic.rss import regulon_specificity_scores
from pyscenic.plotting import plot_binarization, plot_rss
from IPython.display import HTML, display
import seaborn as sns
import matplotlib.pyplot as plt
import matplotlib as mpl
import loompy as lp


auc_matrix_path=sys.argv[1]
auc_mtx=pd.read_csv(auc_matrix_path)

# auc_mtx.to_csv(os.path.join(result,'{}_auc_mtx.csv'.format(name)))
#
name='test'
binary_mtx, auc_thresholds = binarize(auc_mtx, num_workers = 15)
binary_mtx.to_csv(os.path.join(result,'{}_auc_mtx_binary.csv'.format(name)))


...

3. Error encountered:

...

Expected behavior A clear and concise description of what you expected to happen. how to fix this error , it weird that on different Centos7.9 machine, the binarize step can work on other machine
Please complete the following information:

• pySCENIC version: [e.g. 0.10.0, use pyscenic -h at the command line]
• '0.11.2'
• Installation method: [miniconda]
• Run environment: [e.g. Jupyter notebook, CLI, Nextflow, HPC script]
• OS: [Centos7.9]
• Package versions: [obtain using pip freeze, conda list, or skip this if using Docker/Singularity]:

...

[ghuls]

Run with less number of workers, or on a node which has more RAM available.