DNABERT_S icon indicating copy to clipboard operation
DNABERT_S copied to clipboard

These erros arise when i evalute my model, can u give me any suugestions?

Open amssljc opened this issue 1 year ago • 3 comments

The error seems not break my code running, but it disrupt me to read results.

huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
        - Avoid using `tokenizers` before the fork if possible
        - Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
        - Avoid using `tokenizers` before the fork if possible
        - Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
Exception ignored on calling ctypes callback function: <function _ThreadpoolInfo._find_modules_with_dl_iterate_phdr.<locals>.match_module_callback at 0x7f01e5cb8940>
Traceback (most recent call last):
  File "/XX/software/anaconda3/envs/DNABERT_S/lib/python3.9/site-packages/threadpoolctl.py", line 400, in match_module_callback
    self._make_module_from_path(filepath)
  File "/XX/software/anaconda3/envs/DNABERT_S/lib/python3.9/site-packages/threadpoolctl.py", line 515, in _make_module_from_path
    module = module_class(filepath, prefix, user_api, internal_api)
  File "/XX/software/anaconda3/envs/DNABERT_S/lib/python3.9/site-packages/threadpoolctl.py", line 606, in __init__
    self.version = self.get_version()
  File "/XX/software/anaconda3/envs/DNABERT_S/lib/python3.9/site-packages/threadpoolctl.py", line 646, in get_version
    config = get_config().split()
AttributeError: 'NoneType' object has no attribute 'split'
Exception ignored on calling ctypes callback function: <function _ThreadpoolInfo._find_modules_with_dl_iterate_phdr.<locals>.match_module_callback at 0x7f01e5cb8940>
Traceback (most recent call last):
  File "/XX/software/anaconda3/envs/DNABERT_S/lib/python3.9/site-packages/threadpoolctl.py", line 400, in match_module_callback
    self._make_module_from_path(filepath)
  File "/XX/software/anaconda3/envs/DNABERT_S/lib/python3.9/site-packages/threadpoolctl.py", line 515, in _make_module_from_path
    module = module_class(filepath, prefix, user_api, internal_api)
  File "/XX/software/anaconda3/envs/DNABERT_S/lib/python3.9/site-packages/threadpoolctl.py", line 606, in __init__
    self.version = self.get_version()
  File "/XX/software/anaconda3/envs/DNABERT_S/lib/python3.9/site-packages/threadpoolctl.py", line 646, in get_version
    config = get_config().split()
AttributeError: 'NoneType' object has no attribute 'split'
Exception ignored on calling ctypes callback function: <function _ThreadpoolInfo._find_modules_with_dl_iterate_phdr.<locals>.match_module_callback at 0x7f01e5cb8940>
Traceback (most recent call last):
  File "/XX/software/anaconda3/envs/DNABERT_S/lib/python3.9/site-packages/threadpoolctl.py", line 400, in match_module_callback
    self._make_module_from_path(filepath)
  File "/XX/software/anaconda3/envs/DNABERT_S/lib/python3.9/site-packages/threadpoolctl.py", line 515, in _make_module_from_path
    module = module_class(filepath, prefix, user_api, internal_api)
  File "/XX/software/anaconda3/envs/DNABERT_S/lib/python3.9/site-packages/threadpoolctl.py", line 606, in __init__
    self.version = self.get_version()
  File "/XX/software/anaconda3/envs/DNABERT_S/lib/python3.9/site-packages/threadpoolctl.py", line 646, in get_version
    config = get_config().split()
AttributeError: 'NoneType' object has no attribute 'split'

amssljc avatar May 13 '24 09:05 amssljc

What are the comments you were running when encountering this issue?

Zhihan1996 avatar May 13 '24 20:05 Zhihan1996

What are the comments you were running when encountering this issue?

Thanks for your reply! Solved it by using the following command:

pip install --upgrade threadpoolctl

amssljc avatar May 14 '24 01:05 amssljc

It worked with threadpoolctl-3.5.0

amssljc avatar May 14 '24 01:05 amssljc

Cool. Thanks for sharing your solution.

Zhihan1996 avatar May 28 '24 06:05 Zhihan1996