Gopal Trital
Results
1
issues of
Gopal Trital
Hi, We'are trying to use DPO to align our fine-tuned Falcon-7B model. We actually already have fine-tuned falcon-7b model, so I used SFT on a small sample ~1000 observations, and...