DeepSpeedExamples icon indicating copy to clipboard operation
DeepSpeedExamples copied to clipboard

[Question]a bout compression.helper.convert_conv1d_to_linear

Open xk503775229 opened this issue 3 years ago • 0 comments

hi,when i use compression (zero_quant method), I found that we need to change conv1d to linear in GPT model. I just want to figure out this action. could you tail me why do this action ?

model = convert_conv1d_to_linear(model, Conv1D)

image

xk503775229 avatar Sep 06 '22 02:09 xk503775229