ColossalAI-Examples
ColossalAI-Examples copied to clipboard
cannot import name 'OPTForCausalLM'
trafficstars
🐛 Describe the bug
I tried to run the command in this link https://github.com/hpcaitech/ColossalAI-Examples/tree/main/language/opt, but errors occured.
Traceback (most recent call last):
File "run_clm.py", line 44, in <module>
from transformers import (CONFIG_MAPPING, MODEL_MAPPING, AutoConfig, OPTForCausalLM, AutoTokenizer, SchedulerType,
ImportError: cannot import name 'OPTForCausalLM'
Environment
python 3.6 CUDA 10.2 transformers 4.18.0