DeepSpeedExamples
DeepSpeedExamples copied to clipboard
[Question]a bout compression.helper.convert_conv1d_to_linear
hi,when i use compression (zero_quant method), I found that we need to change conv1d to linear in GPT model. I just want to figure out this action. could you tail me why do this action ?
model = convert_conv1d_to_linear(model, Conv1D)
