LMFlow icon indicating copy to clipboard operation
LMFlow copied to clipboard

Error when finetune huggingface model lamma-7B-hf

Open Yue-stat opened this issue 2 years ago • 1 comments

I got the following error when I fine tune decapoda-research-llama-7b-hf or pinkmanlove-llama-7b-hf

TypeError: Descriptors cannot not be created directly.
If this call came from a _pb2.py file, your generated code is out of date and 
must be regenerated with protoc >= 3.19.0.
If you cannot immediately regenerate your protos, some other possible 
workarounds are:
 1. Downgrade the protobuf package to 3.20.x or lower.
 2. Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION=python (but this will use 
pure-Python parsing and will be much slower).

But when I change the model to --model_name_or_path facebook/galactica-1.3b, everything goes well. Thank you!

Yue-stat avatar May 01 '23 08:05 Yue-stat

Seems that there are some issues with the dependency. Could you re-install lmflow and see whether it will be solved? Thank you!

shizhediao avatar May 01 '23 09:05 shizhediao

This issue has been marked as stale because it has not had recent activity. If you think this still needs to be addressed please feel free to reopen this issue. Thanks

shizhediao avatar Sep 30 '23 19:09 shizhediao