May I ask if pruning of qwen2-72b and llama 3.1-70b is supported?

Open lingq1 opened this issue 1 year ago • 2 comments

Is pruning of large models similar to 70B supported?

Dec 06 '24 02:12 lingq1

Hi @lingq1, I think it should work as long as we have sufficient GPU RAM. If not, we can run the pruning on CPU.

Dec 06 '24 17:12 VainF

Hi @lingq1, I think it should work as long as we have sufficient GPU RAM. If not, we can run the pruning on CPU.

ths

Dec 09 '24 01:12 lingq1