Deepak Ahire
Results
3
comments of
Deepak Ahire
Please re-open the issue
@airaria Can you please tell me how to perform the Pre-training stahe 1 using the file `run_clm_pt_with_peft.py`? Do we have to comment out the PEFT code, i.e., comment out: 1....
> > `pip install -v flash-attn==2.1.1` doesn't help either > > Did you try `--no-build-isolation`? Not working either