ColossalAI-Examples icon indicating copy to clipboard operation
ColossalAI-Examples copied to clipboard

cannot import name 'OPTForCausalLM'

Open upwindflys opened this issue 2 years ago • 0 comments
trafficstars

🐛 Describe the bug

I tried to run the command in this link https://github.com/hpcaitech/ColossalAI-Examples/tree/main/language/opt, but errors occured.

Traceback (most recent call last):
  File "run_clm.py", line 44, in <module>
    from transformers import (CONFIG_MAPPING, MODEL_MAPPING, AutoConfig, OPTForCausalLM, AutoTokenizer, SchedulerType,
ImportError: cannot import name 'OPTForCausalLM'

Environment

python 3.6 CUDA 10.2 transformers 4.18.0

upwindflys avatar Jan 04 '23 06:01 upwindflys