aprilehannibal comments

Repositories
Issues
Comments

Results 5 comments of


                                            aprilehannibal

OOM error and fsdp support

> > Hi @Unrealluver Are you still facing this issue? > > Thanks, I have found the reason. I'm facing the same issue. Could you please share how you resolved...

[Question] pretain 7B loss doesn't change

I wonder the LLM you used for pretraining is the "lmsys/vicuna-7b-delta-v1.1" or the origin "llama 7b" weight. @haotian-liu

[Question] pretain 7B loss doesn't change

OK, got it! Thanks a lot!

[Question] finetune dataset

ok, thanks

[Question] Difference between 13b-v0 and 13b-v1-1

> If you want to reproduce our results on the paper (e.g. ScienceQA), I would recommend using V0 first, as it is the model we used to train/evaluate the numbers...