Trangle Heshvp
Trangle Heshvp
There is also this inconsistency issue. Here is my case ``` python from transformers import AutoTokenizer from transformers.tokenization_utils import AddedToken model_name_or_path = "mistralai/Mistral-7B-v0.1" fast_tk = AutoTokenizer.from_pretrained( model_name_or_path , use_fast=True, padding_side="left",...
> And please upgrade to 4.36.2 This problem occurs in training with multiple machines and multiple cards. Perhaps 4.36.2 did not solve this problem either, as 4.36.1 has already attempted...
in trainer.py line 2555 ``` python elif self.is_local_process_zero(): # Clean up the remaining staging checkpoint folders on other nodes if staging_output_dir != output_dir and os.path.exists(staging_output_dir): shutil.rmtree(staging_output_dir) ``` should change to...
notice
@BrettLL Sorry, I do not have enough machine to train this model.
On the way!
> Thanks for verifying @MangoFF. > > What I'll do is we can keep this issue open as a reference for others. If you have issues with either: > >...
the code the author used, added extend operator, so you need to add these files into the source codes or set path, then recompile it.