optimum icon indicating copy to clipboard operation
optimum copied to clipboard

NameError: name '_SENTENCE_TRANSFORMERS_TASKS_TO_MODEL_LOADERS' is not defined

Open purejomo opened this issue 1 year ago • 1 comments

System Info

python 3.10.14
torch 2.4.0+cu121
optimum  1.21.4  
onnx                      1.16.2  
onnxruntime               1.19.0    
transformers              4.43.4  

optimum-cli export onnx --model distilbert/distilbert-base-uncased-distilled-squad distilbert_base_uncased_squad_onnx/

when I try to do simple example above, this error happened.

.../optimum/exporters/tasks.py", line 268, in TasksManager
"sentence_transformers": get_model_loaders_to_tasks(_SENTENCE_TRANSFORMERS_TASKS_TO_MODEL_LOADERS),
NameError: name '_SENTENCE_TRANSFORMERS_TASKS_TO_MODEL_LOADERS' is not defined

In "task.py" file, I touhgt _SENTENCE_TRANSFORMERS_TASKS_TO_MODEL_LOADERS is defined already.

image image

Who can help?

@philschmid @michaelbenayoun @JingyaHuang, @echarlaix

Information

  • [X] The official example scripts
  • [ ] My own modified scripts

Tasks

  • [X] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
  • [ ] My own task or dataset (give details below)

Reproduction (minimal, reproducible, runnable)

python 3.10.14 torch 2.4.0+cu121 optimum 1.21.4
onnx 1.16.2
onnxruntime 1.19.0
transformers 4.43.4

Expected behavior

error should be figured out. I'm trying to convert hf-llama model to onnx for graph optimization

purejomo avatar Aug 25 '24 16:08 purejomo

Hi @purejomo,

I was unfortunately not able to reproduce the error you're describing. Yes _SENTENCE_TRANSFORMERS_TASKS_TO_MODEL_LOADERS is defined in https://github.com/huggingface/optimum/blob/v1.21.4/optimum/exporters/tasks.py#L201-L204, could it be that in your case is_torch_available https://github.com/huggingface/optimum/blob/v1.21.4/optimum/exporters/tasks.py#L156 returns False?

echarlaix avatar Aug 26 '24 08:08 echarlaix