Deepak Ahire

Results 3 comments of Deepak Ahire

@airaria Can you please tell me how to perform the Pre-training stahe 1 using the file `run_clm_pt_with_peft.py`? Do we have to comment out the PEFT code, i.e., comment out: 1....

> > `pip install -v flash-attn==2.1.1` doesn't help either > > Did you try `--no-build-isolation`? Not working either