NanoCode012

icon indicating a website link https://www.linkedin.com/in/chanvichet-vong

icon location A student learning to code.

Results 163 comments of NanoCode012

Is is possible to train 70b model on 8*A100 80G with full fine tunning?

I recall that you may be able to with deepspeed 3 and cpu offload

Is is possible to train 70b model on 8*A100 80G with full fine tunning?

Have you already tried reducing the batch size and use 8bit optim?

Pruning/Sparsity Tutorial

Is there a guideline on how much we should prune by? What are the benefits to doing this?