Jiaquan Wang

run 70b error:RuntimeError: shape '[1, 4096, 64, 128]' is invalid for input of size 4194304

2

After setting up the environment as instructed, I successfully pruned llama2-7b using Wanda without any issues. However, when attempting to prune llama2-70b, the following error occurred: Traceback (most recent call...