dmammfl comments

Repositories
Issues
Comments

Results 1 comments of


                                            dmammfl

Is there a plan for supporting full fine-tuning 70B model?

Thanks for replying! I have 2 nodes with 4x 80GB A100, and currently used "accelerate" for llama-2 70B fine-tuning + multi-node FSDP. So, I'm wondering that is there a multi-node...