LMFlow
LMFlow copied to clipboard
Error when finetune huggingface model lamma-7B-hf
I got the following error when I fine tune decapoda-research-llama-7b-hf or pinkmanlove-llama-7b-hf
TypeError: Descriptors cannot not be created directly.
If this call came from a _pb2.py file, your generated code is out of date and
must be regenerated with protoc >= 3.19.0.
If you cannot immediately regenerate your protos, some other possible
workarounds are:
1. Downgrade the protobuf package to 3.20.x or lower.
2. Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION=python (but this will use
pure-Python parsing and will be much slower).
But when I change the model to --model_name_or_path facebook/galactica-1.3b, everything goes well. Thank you!
Seems that there are some issues with the dependency.
Could you re-install lmflow and see whether it will be solved?
Thank you!
This issue has been marked as stale because it has not had recent activity. If you think this still needs to be addressed please feel free to reopen this issue. Thanks