YangShuaiTHU

> Hi，@YangShuaiTHU, Could you tell us what model you used? I test loading/saving in UT:tests/CI/test_weight_only_gpu.py, it is OK. BTW, we used Transformers version is 4.34.1 Thanks for your reply! The...

> Hi, i guess this issue may caused by the shape of compressed-weight is not match with the raw-weight-shape. e.g. model.layers.0.self_attn.q_proj.weight may need 5120*5120*sizeof(float) bytes data, but after woq compress,...