ChatYuan-large-v2模型加载失败

[oushu1zhangxiangxuan1]

实际结果 / Actual Result

flagging username: cb77933e5363447487319b5beab7afe0

Explicitly passing a `revision` is encouraged when loading a model with custom code to ensure no malicious code has been contributed in a newer revision.
Explicitly passing a `revision` is encouraged when loading a model with custom code to ensure no malicious code has been contributed in a newer revision.
ERROR 2023-05-10 15:10:32,435-1d: The device_map provided does not give any device for the following parameters: shared.weight, encoder.embed_tokens.weight, encoder.block.0.layer.0.SelfAttention.q.weight, encoder.block.0.layer.0.SelfAttention.k.weight, encoder.block.0.layer.0.SelfAttention.v.weight, encoder.block.0.layer.0.SelfAttention.o.weight, encoder.block.0.layer.0.SelfAttention.relative_attention_bias.weight, encoder.block.0.layer.0.layer_norm.weight, encoder.block.0.layer.1.DenseReluDense.wi_0.weight, encoder.block.0.layer.1.DenseReluDense.wi_1.weight, encoder.block.0.layer.1.DenseReluDense.wo.weight, encoder.block.0.layer.1.layer_norm.weight, encoder.block.1.layer.0.SelfAttention.q.weight, encoder.block.1.layer.0.SelfAttention.k.weight, encoder.block.1.layer.0.SelfAttention.v.weight, encoder.block.1.layer.0.SelfAttention.o.weight, encoder.block.1.layer.0.layer_norm.weight, encoder.block.1.layer.1.DenseReluDense.wi_0.weight, encoder.block.1.layer.1.DenseReluDense.wi_1.weight, encoder.block.1.layer.1.DenseReluDense.wo.weight, encoder.block.1.layer.1.layer_norm.weight, encoder.block.2.layer.0.SelfAttention.q.weight, encoder.block.2.layer.0.SelfAttention.k.weight, encoder.block.2.layer.0.SelfAttention.v.weight, encoder.block.2.layer.0.SelfAttention.o.weight, encoder.block.2.layer.0.layer_norm.weight, encoder.block.2.layer.1.DenseReluDense.wi_0.weight, encoder.block.2.layer.1.DenseReluDense.wi_1.weight, encoder.block.2.layer.1.DenseReluDense.wo.weight, encoder.block.2.layer.1.layer_norm.weight, encoder.block.3.layer.0.SelfAttention.q.weight, encoder.block.3.layer.0.SelfAttention.k.weight, encoder.block.3.layer.0.SelfAttention.v.weight, encoder.block.3.layer.0.SelfAttention.o.weight, encoder.block.3.layer.0.layer_norm.weight, encoder.block.3.layer.1.DenseReluDense.wi_0.weight, encoder.block.3.layer.1.DenseReluDense.wi_1.weight, encoder.block.3.layer.1.DenseReluDense.wo.weight, encoder.block.3.layer.1.layer_norm.weight, encoder.block.4.layer.0.SelfAttention.q.weight, encoder.block.4.layer.0.SelfAttention.k.weight, encoder.block.4.layer.0.SelfAttention.v.weight, encoder.block.4.layer.0.SelfAttention.o.weight, encoder.block.4.layer.0.layer_norm.weight, encoder.block.4.layer.1.DenseReluDense.wi_0.weight, encoder.block.4.layer.1.DenseReluDense.wi_1.weight, encoder.block.4.layer.1.DenseReluDense.wo.weight, encoder.block.4.layer.1.layer_norm.weight, encoder.block.5.layer.0.SelfAttention.q.weight, encoder.block.5.layer.0.SelfAttention.k.weight, encoder.block.5.layer.0.SelfAttention.v.weight, encoder.block.5.layer.0.SelfAttention.o.weight, encoder.block.5.layer.0.layer_norm.weight, encoder.block.5.layer.1.DenseReluDense.wi_0.weight, encoder.block.5.layer.1.DenseReluDense.wi_1.weight, encoder.block.5.layer.1.DenseReluDense.wo.weight, encoder.block.5.layer.1.layer_norm.weight, encoder.block.6.layer.0.SelfAttention.q.weight, encoder.block.6.layer.0.SelfAttention.k.weight, encoder.block.6.layer.0.SelfAttention.v.weight, encoder.block.6.layer.0.SelfAttention.o.weight, encoder.block.6.layer.0.layer_norm.weight, encoder.block.6.layer.1.DenseReluDense.wi_0.weight, encoder.block.6.layer.1.DenseReluDense.wi_1.weight, encoder.block.6.layer.1.DenseReluDense.wo.weight, encoder.block.6.layer.1.layer_norm.weight, encoder.block.7.layer.0.SelfAttention.q.weight, encoder.block.7.layer.0.SelfAttention.k.weight, encoder.block.7.layer.0.SelfAttention.v.weight, encoder.block.7.layer.0.SelfAttention.o.weight, encoder.block.7.layer.0.layer_norm.weight, encoder.block.7.layer.1.DenseReluDense.wi_0.weight, encoder.block.7.layer.1.DenseReluDense.wi_1.weight, encoder.block.7.layer.1.DenseReluDense.wo.weight, encoder.block.7.layer.1.layer_norm.weight, encoder.block.8.layer.0.SelfAttention.q.weight, encoder.block.8.layer.0.SelfAttention.k.weight, encoder.block.8.layer.0.SelfAttention.v.weight, encoder.block.8.layer.0.SelfAttention.o.weight, encoder.block.8.layer.0.layer_norm.weight, encoder.block.8.layer.1.DenseReluDense.wi_0.weight, encoder.block.8.layer.1.DenseReluDense.wi_1.weight, encoder.block.8.layer.1.DenseReluDense.wo.weight, encoder.block.8.layer.1.layer_norm.weight, encoder.block.9.layer.0.SelfAttention.q.weight, encoder.block.9.layer.0.SelfAttention.k.weight, encoder.block.9.layer.0.SelfAttention.v.weight, encoder.block.9.layer.0.SelfAttention.o.weight, encoder.block.9.layer.0.layer_norm.weight, encoder.block.9.layer.1.DenseReluDense.wi_0.weight, encoder.block.9.layer.1.DenseReluDense.wi_1.weight, encoder.block.9.layer.1.DenseReluDense.wo.weight, encoder.block.9.layer.1.layer_norm.weight, encoder.block.10.layer.0.SelfAttention.q.weight, encoder.block.10.layer.0.SelfAttention.k.weight, encoder.block.10.layer.0.SelfAttention.v.weight, encoder.block.10.layer.0.SelfAttention.o.weight, encoder.block.10.layer.0.layer_norm.weight, encoder.block.10.layer.1.DenseReluDense.wi_0.weight, encoder.block.10.layer.1.DenseReluDense.wi_1.weight, encoder.block.10.layer.1.DenseReluDense.wo.weight, encoder.block.10.layer.1.layer_norm.weight, encoder.block.11.layer.0.SelfAttention.q.weight, encoder.block.11.layer.0.SelfAttention.k.weight, encoder.block.11.layer.0.SelfAttention.v.weight, encoder.block.11.layer.0.SelfAttention.o.weight, encoder.block.11.layer.0.layer_norm.weight, encoder.block.11.layer.1.DenseReluDense.wi_0.weight, encoder.block.11.layer.1.DenseReluDense.wi_1.weight, encoder.block.11.layer.1.DenseReluDense.wo.weight, encoder.block.11.layer.1.layer_norm.weight, encoder.block.12.layer.0.SelfAttention.q.weight, encoder.block.12.layer.0.SelfAttention.k.weight, encoder.block.12.layer.0.SelfAttention.v.weight, encoder.block.12.layer.0.SelfAttention.o.weight, encoder.block.12.layer.0.layer_norm.weight, encoder.block.12.layer.1.DenseReluDense.wi_0.weight, encoder.block.12.layer.1.DenseReluDense.wi_1.weight, encoder.block.12.layer.1.DenseReluDense.wo.weight, encoder.block.12.layer.1.layer_norm.weight, encoder.block.13.layer.0.SelfAttention.q.weight, encoder.block.13.layer.0.SelfAttention.k.weight, encoder.block.13.layer.0.SelfAttention.v.weight, encoder.block.13.layer.0.SelfAttention.o.weight, encoder.block.13.layer.0.layer_norm.weight, encoder.block.13.layer.1.DenseReluDense.wi_0.weight, encoder.block.13.layer.1.DenseReluDense.wi_1.weight, encoder.block.13.layer.1.DenseReluDense.wo.weight, encoder.block.13.layer.1.layer_norm.weight, encoder.block.14.layer.0.SelfAttention.q.weight, encoder.block.14.layer.0.SelfAttention.k.weight, encoder.block.14.layer.0.SelfAttention.v.weight, encoder.block.14.layer.0.SelfAttention.o.weight, encoder.block.14.layer.0.layer_norm.weight, encoder.block.14.layer.1.DenseReluDense.wi_0.weight, encoder.block.14.layer.1.DenseReluDense.wi_1.weight, encoder.block.14.layer.1.DenseReluDense.wo.weight, encoder.block.14.layer.1.layer_norm.weight, encoder.block.15.layer.0.SelfAttention.q.weight, encoder.block.15.layer.0.SelfAttention.k.weight, encoder.block.15.layer.0.SelfAttention.v.weight, encoder.block.15.layer.0.SelfAttention.o.weight, encoder.block.15.layer.0.layer_norm.weight, encoder.block.15.layer.1.DenseReluDense.wi_0.weight, encoder.block.15.layer.1.DenseReluDense.wi_1.weight, encoder.block.15.layer.1.DenseReluDense.wo.weight, encoder.block.15.layer.1.layer_norm.weight, encoder.block.16.layer.0.SelfAttention.q.weight, encoder.block.16.layer.0.SelfAttention.k.weight, encoder.block.16.layer.0.SelfAttention.v.weight, encoder.block.16.layer.0.SelfAttention.o.weight, encoder.block.16.layer.0.layer_norm.weight, encoder.block.16.layer.1.DenseReluDense.wi_0.weight, encoder.block.16.layer.1.DenseReluDense.wi_1.weight, encoder.block.16.layer.1.DenseReluDense.wo.weight, encoder.block.16.layer.1.layer_norm.weight, encoder.block.17.layer.0.SelfAttention.q.weight, encoder.block.17.layer.0.SelfAttention.k.weight, encoder.block.17.layer.0.SelfAttention.v.weight, encoder.block.17.layer.0.SelfAttention.o.weight, encoder.block.17.layer.0.layer_norm.weight, encoder.block.17.layer.1.DenseReluDense.wi_0.weight, encoder.block.17.layer.1.DenseReluDense.wi_1.weight, encoder.block.17.layer.1.DenseReluDense.wo.weight, encoder.block.17.layer.1.layer_norm.weight, encoder.block.18.layer.0.SelfAttention.q.weight, encoder.block.18.layer.0.SelfAttention.k.weight, encoder.block.18.layer.0.SelfAttention.v.weight, encoder.block.18.layer.0.SelfAttention.o.weight, encoder.block.18.layer.0.layer_norm.weight, encoder.block.18.layer.1.DenseReluDense.wi_0.weight, encoder.block.18.layer.1.DenseReluDense.wi_1.weight, encoder.block.18.layer.1.DenseReluDense.wo.weight, encoder.block.18.layer.1.layer_norm.weight, encoder.block.19.layer.0.SelfAttention.q.weight, encoder.block.19.layer.0.SelfAttention.k.weight, encoder.block.19.layer.0.SelfAttention.v.weight, encoder.block.19.layer.0.SelfAttention.o.weight, encoder.block.19.layer.0.layer_norm.weight, encoder.block.19.layer.1.DenseReluDense.wi_0.weight, encoder.block.19.layer.1.DenseReluDense.wi_1.weight, encoder.block.19.layer.1.DenseReluDense.wo.weight, encoder.block.19.layer.1.layer_norm.weight, encoder.block.20.layer.0.SelfAttention.q.weight, encoder.block.20.layer.0.SelfAttention.k.weight, encoder.block.20.layer.0.SelfAttention.v.weight, encoder.block.20.layer.0.SelfAttention.o.weight, encoder.block.20.layer.0.layer_norm.weight, encoder.block.20.layer.1.DenseReluDense.wi_0.weight, encoder.block.20.layer.1.DenseReluDense.wi_1.weight, encoder.block.20.layer.1.DenseReluDense.wo.weight, encoder.block.20.layer.1.layer_norm.weight, encoder.block.21.layer.0.SelfAttention.q.weight, encoder.block.21.layer.0.SelfAttention.k.weight, encoder.block.21.layer.0.SelfAttention.v.weight, encoder.block.21.layer.0.SelfAttention.o.weight, encoder.block.21.layer.0.layer_norm.weight, encoder.block.21.layer.1.DenseReluDense.wi_0.weight, encoder.block.21.layer.1.DenseReluDense.wi_1.weight, encoder.block.21.layer.1.DenseReluDense.wo.weight, encoder.block.21.layer.1.layer_norm.weight, encoder.block.22.layer.0.SelfAttention.q.weight, encoder.block.22.layer.0.SelfAttention.k.weight, encoder.block.22.layer.0.SelfAttention.v.weight, encoder.block.22.layer.0.SelfAttention.o.weight, encoder.block.22.layer.0.layer_norm.weight, encoder.block.22.layer.1.DenseReluDense.wi_0.weight, encoder.block.22.layer.1.DenseReluDense.wi_1.weight, encoder.block.22.layer.1.DenseReluDense.wo.weight, encoder.block.22.layer.1.layer_norm.weight, encoder.block.23.layer.0.SelfAttention.q.weight, encoder.block.23.layer.0.SelfAttention.k.weight, encoder.block.23.layer.0.SelfAttention.v.weight, encoder.block.23.layer.0.SelfAttention.o.weight, encoder.block.23.layer.0.layer_norm.weight, encoder.block.23.layer.1.DenseReluDense.wi_0.weight, encoder.block.23.layer.1.DenseReluDense.wi_1.weight, encoder.block.23.layer.1.DenseReluDense.wo.weight, encoder.block.23.layer.1.layer_norm.weight, encoder.final_layer_norm.weight, decoder.embed_tokens.weight, decoder.block.0.layer.0.SelfAttention.q.weight, decoder.block.0.layer.0.SelfAttention.k.weight, decoder.block.0.layer.0.SelfAttention.v.weight, decoder.block.0.layer.0.SelfAttention.o.weight, decoder.block.0.layer.0.SelfAttention.relative_attention_bias.weight, decoder.block.0.layer.0.layer_norm.weight, decoder.block.0.layer.1.EncDecAttention.q.weight, decoder.block.0.layer.1.EncDecAttention.k.weight, decoder.block.0.layer.1.EncDecAttention.v.weight, decoder.block.0.layer.1.EncDecAttention.o.weight, decoder.block.0.layer.1.layer_norm.weight, decoder.block.0.layer.2.DenseReluDense.wi_0.weight, decoder.block.0.layer.2.DenseReluDense.wi_1.weight, decoder.block.0.layer.2.DenseReluDense.wo.weight, decoder.block.0.layer.2.layer_norm.weight, decoder.block.1.layer.0.SelfAttention.q.weight, decoder.block.1.layer.0.SelfAttention.k.weight, decoder.block.1.layer.0.SelfAttention.v.weight, decoder.block.1.layer.0.SelfAttention.o.weight, decoder.block.1.layer.0.layer_norm.weight, decoder.block.1.layer.1.EncDecAttention.q.weight, decoder.block.1.layer.1.EncDecAttention.k.weight, decoder.block.1.layer.1.EncDecAttention.v.weight, decoder.block.1.layer.1.EncDecAttention.o.weight, decoder.block.1.layer.1.layer_norm.weight, decoder.block.1.layer.2.DenseReluDense.wi_0.weight, decoder.block.1.layer.2.DenseReluDense.wi_1.weight, decoder.block.1.layer.2.DenseReluDense.wo.weight, decoder.block.1.layer.2.layer_norm.weight, decoder.block.2.layer.0.SelfAttention.q.weight, decoder.block.2.layer.0.SelfAttention.k.weight, decoder.block.2.layer.0.SelfAttention.v.weight, decoder.block.2.layer.0.SelfAttention.o.weight, decoder.block.2.layer.0.layer_norm.weight, decoder.block.2.layer.1.EncDecAttention.q.weight, decoder.block.2.layer.1.EncDecAttention.k.weight, decoder.block.2.layer.1.EncDecAttention.v.weight, decoder.block.2.layer.1.EncDecAttention.o.weight, decoder.block.2.layer.1.layer_norm.weight, decoder.block.2.layer.2.DenseReluDense.wi_0.weight, decoder.block.2.layer.2.DenseReluDense.wi_1.weight, decoder.block.2.layer.2.DenseReluDense.wo.weight, decoder.block.2.layer.2.layer_norm.weight, decoder.block.3.layer.0.SelfAttention.q.weight, decoder.block.3.layer.0.SelfAttention.k.weight, decoder.block.3.layer.0.SelfAttention.v.weight, decoder.block.3.layer.0.SelfAttention.o.weight, decoder.block.3.layer.0.layer_norm.weight, decoder.block.3.layer.1.EncDecAttention.q.weight, decoder.block.3.layer.1.EncDecAttention.k.weight, decoder.block.3.layer.1.EncDecAttention.v.weight, decoder.block.3.layer.1.EncDecAttention.o.weight, decoder.block.3.layer.1.layer_norm.weight, decoder.block.3.layer.2.DenseReluDense.wi_0.weight, decoder.block.3.layer.2.DenseReluDense.wi_1.weight, decoder.block.3.layer.2.DenseReluDense.wo.weight, decoder.block.3.layer.2.layer_norm.weight, decoder.block.4.layer.0.SelfAttention.q.weight, decoder.block.4.layer.0.SelfAttention.k.weight, decoder.block.4.layer.0.SelfAttention.v.weight, decoder.block.4.layer.0.SelfAttention.o.weight, decoder.block.4.layer.0.layer_norm.weight, decoder.block.4.layer.1.EncDecAttention.q.weight, decoder.block.4.layer.1.EncDecAttention.k.weight, decoder.block.4.layer.1.EncDecAttention.v.weight, decoder.block.4.layer.1.EncDecAttention.o.weight, decoder.block.4.layer.1.layer_norm.weight, decoder.block.4.layer.2.DenseReluDense.wi_0.weight, decoder.block.4.layer.2.DenseReluDense.wi_1.weight, decoder.block.4.layer.2.DenseReluDense.wo.weight, decoder.block.4.layer.2.layer_norm.weight, decoder.block.5.layer.0.SelfAttention.q.weight, decoder.block.5.layer.0.SelfAttention.k.weight, decoder.block.5.layer.0.SelfAttention.v.weight, decoder.block.5.layer.0.SelfAttention.o.weight, decoder.block.5.layer.0.layer_norm.weight, decoder.block.5.layer.1.EncDecAttention.q.weight, decoder.block.5.layer.1.EncDecAttention.k.weight, decoder.block.5.layer.1.EncDecAttention.v.weight, decoder.block.5.layer.1.EncDecAttention.o.weight, decoder.block.5.layer.1.layer_norm.weight, decoder.block.5.layer.2.DenseReluDense.wi_0.weight, decoder.block.5.layer.2.DenseReluDense.wi_1.weight, decoder.block.5.layer.2.DenseReluDense.wo.weight, decoder.block.5.layer.2.layer_norm.weight, decoder.block.6.layer.0.SelfAttention.q.weight, decoder.block.6.layer.0.SelfAttention.k.weight, decoder.block.6.layer.0.SelfAttention.v.weight, decoder.block.6.layer.0.SelfAttention.o.weight, decoder.block.6.layer.0.layer_norm.weight, decoder.block.6.layer.1.EncDecAttention.q.weight, decoder.block.6.layer.1.EncDecAttention.k.weight, decoder.block.6.layer.1.EncDecAttention.v.weight, decoder.block.6.layer.1.EncDecAttention.o.weight, decoder.block.6.layer.1.layer_norm.weight, decoder.block.6.layer.2.DenseReluDense.wi_0.weight, decoder.block.6.layer.2.DenseReluDense.wi_1.weight, decoder.block.6.layer.2.DenseReluDense.wo.weight, decoder.block.6.layer.2.layer_norm.weight, decoder.block.7.layer.0.SelfAttention.q.weight, decoder.block.7.layer.0.SelfAttention.k.weight, decoder.block.7.layer.0.SelfAttention.v.weight, decoder.block.7.layer.0.SelfAttention.o.weight, decoder.block.7.layer.0.layer_norm.weight, decoder.block.7.layer.1.EncDecAttention.q.weight, decoder.block.7.layer.1.EncDecAttention.k.weight, decoder.block.7.layer.1.EncDecAttention.v.weight, decoder.block.7.layer.1.EncDecAttention.o.weight, decoder.block.7.layer.1.layer_norm.weight, decoder.block.7.layer.2.DenseReluDense.wi_0.weight, decoder.block.7.layer.2.DenseReluDense.wi_1.weight, decoder.block.7.layer.2.DenseReluDense.wo.weight, decoder.block.7.layer.2.layer_norm.weight, decoder.block.8.layer.0.SelfAttention.q.weight, decoder.block.8.layer.0.SelfAttention.k.weight, decoder.block.8.layer.0.SelfAttention.v.weight, decoder.block.8.layer.0.SelfAttention.o.weight, decoder.block.8.layer.0.layer_norm.weight, decoder.block.8.layer.1.EncDecAttention.q.weight, decoder.block.8.layer.1.EncDecAttention.k.weight, decoder.block.8.layer.1.EncDecAttention.v.weight, decoder.block.8.layer.1.EncDecAttention.o.weight, decoder.block.8.layer.1.layer_norm.weight, decoder.block.8.layer.2.DenseReluDense.wi_0.weight, decoder.block.8.layer.2.DenseReluDense.wi_1.weight, decoder.block.8.layer.2.DenseReluDense.wo.weight, decoder.block.8.layer.2.layer_norm.weight, decoder.block.9.layer.0.SelfAttention.q.weight, decoder.block.9.layer.0.SelfAttention.k.weight, decoder.block.9.layer.0.SelfAttention.v.weight, decoder.block.9.layer.0.SelfAttention.o.weight, decoder.block.9.layer.0.layer_norm.weight, decoder.block.9.layer.1.EncDecAttention.q.weight, decoder.block.9.layer.1.EncDecAttention.k.weight, decoder.block.9.layer.1.EncDecAttention.v.weight, decoder.block.9.layer.1.EncDecAttention.o.weight, decoder.block.9.layer.1.layer_norm.weight, decoder.block.9.layer.2.DenseReluDense.wi_0.weight, decoder.block.9.layer.2.DenseReluDense.wi_1.weight, decoder.block.9.layer.2.DenseReluDense.wo.weight, decoder.block.9.layer.2.layer_norm.weight, decoder.block.10.layer.0.SelfAttention.q.weight, decoder.block.10.layer.0.SelfAttention.k.weight, decoder.block.10.layer.0.SelfAttention.v.weight, decoder.block.10.layer.0.SelfAttention.o.weight, decoder.block.10.layer.0.layer_norm.weight, decoder.block.10.layer.1.EncDecAttention.q.weight, decoder.block.10.layer.1.EncDecAttention.k.weight, decoder.block.10.layer.1.EncDecAttention.v.weight, decoder.block.10.layer.1.EncDecAttention.o.weight, decoder.block.10.layer.1.layer_norm.weight, decoder.block.10.layer.2.DenseReluDense.wi_0.weight, decoder.block.10.layer.2.DenseReluDense.wi_1.weight, decoder.block.10.layer.2.DenseReluDense.wo.weight, decoder.block.10.layer.2.layer_norm.weight, decoder.block.11.layer.0.SelfAttention.q.weight, decoder.block.11.layer.0.SelfAttention.k.weight, decoder.block.11.layer.0.SelfAttention.v.weight, decoder.block.11.layer.0.SelfAttention.o.weight, decoder.block.11.layer.0.layer_norm.weight, decoder.block.11.layer.1.EncDecAttention.q.weight, decoder.block.11.layer.1.EncDecAttention.k.weight, decoder.block.11.layer.1.EncDecAttention.v.weight, decoder.block.11.layer.1.EncDecAttention.o.weight, decoder.block.11.layer.1.layer_norm.weight, decoder.block.11.layer.2.DenseReluDense.wi_0.weight, decoder.block.11.layer.2.DenseReluDense.wi_1.weight, decoder.block.11.layer.2.DenseReluDense.wo.weight, decoder.block.11.layer.2.layer_norm.weight, decoder.block.12.layer.0.SelfAttention.q.weight, decoder.block.12.layer.0.SelfAttention.k.weight, decoder.block.12.layer.0.SelfAttention.v.weight, decoder.block.12.layer.0.SelfAttention.o.weight, decoder.block.12.layer.0.layer_norm.weight, decoder.block.12.layer.1.EncDecAttention.q.weight, decoder.block.12.layer.1.EncDecAttention.k.weight, decoder.block.12.layer.1.EncDecAttention.v.weight, decoder.block.12.layer.1.EncDecAttention.o.weight, decoder.block.12.layer.1.layer_norm.weight, decoder.block.12.layer.2.DenseReluDense.wi_0.weight, decoder.block.12.layer.2.DenseReluDense.wi_1.weight, decoder.block.12.layer.2.DenseReluDense.wo.weight, decoder.block.12.layer.2.layer_norm.weight, decoder.block.13.layer.0.SelfAttention.q.weight, decoder.block.13.layer.0.SelfAttention.k.weight, decoder.block.13.layer.0.SelfAttention.v.weight, decoder.block.13.layer.0.SelfAttention.o.weight, decoder.block.13.layer.0.layer_norm.weight, decoder.block.13.layer.1.EncDecAttention.q.weight, decoder.block.13.layer.1.EncDecAttention.k.weight, decoder.block.13.layer.1.EncDecAttention.v.weight, decoder.block.13.layer.1.EncDecAttention.o.weight, decoder.block.13.layer.1.layer_norm.weight, decoder.block.13.layer.2.DenseReluDense.wi_0.weight, decoder.block.13.layer.2.DenseReluDense.wi_1.weight, decoder.block.13.layer.2.DenseReluDense.wo.weight, decoder.block.13.layer.2.layer_norm.weight, decoder.block.14.layer.0.SelfAttention.q.weight, decoder.block.14.layer.0.SelfAttention.k.weight, decoder.block.14.layer.0.SelfAttention.v.weight, decoder.block.14.layer.0.SelfAttention.o.weight, decoder.block.14.layer.0.layer_norm.weight, decoder.block.14.layer.1.EncDecAttention.q.weight, decoder.block.14.layer.1.EncDecAttention.k.weight, decoder.block.14.layer.1.EncDecAttention.v.weight, decoder.block.14.layer.1.EncDecAttention.o.weight, decoder.block.14.layer.1.layer_norm.weight, decoder.block.14.layer.2.DenseReluDense.wi_0.weight, decoder.block.14.layer.2.DenseReluDense.wi_1.weight, decoder.block.14.layer.2.DenseReluDense.wo.weight, decoder.block.14.layer.2.layer_norm.weight, decoder.block.15.layer.0.SelfAttention.q.weight, decoder.block.15.layer.0.SelfAttention.k.weight, decoder.block.15.layer.0.SelfAttention.v.weight, decoder.block.15.layer.0.SelfAttention.o.weight, decoder.block.15.layer.0.layer_norm.weight, decoder.block.15.layer.1.EncDecAttention.q.weight, decoder.block.15.layer.1.EncDecAttention.k.weight, decoder.block.15.layer.1.EncDecAttention.v.weight, decoder.block.15.layer.1.EncDecAttention.o.weight, decoder.block.15.layer.1.layer_norm.weight, decoder.block.15.layer.2.DenseReluDense.wi_0.weight, decoder.block.15.layer.2.DenseReluDense.wi_1.weight, decoder.block.15.layer.2.DenseReluDense.wo.weight, decoder.block.15.layer.2.layer_norm.weight, decoder.block.16.layer.0.SelfAttention.q.weight, decoder.block.16.layer.0.SelfAttention.k.weight, decoder.block.16.layer.0.SelfAttention.v.weight, decoder.block.16.layer.0.SelfAttention.o.weight, decoder.block.16.layer.0.layer_norm.weight, decoder.block.16.layer.1.EncDecAttention.q.weight, decoder.block.16.layer.1.EncDecAttention.k.weight, decoder.block.16.layer.1.EncDecAttention.v.weight, decoder.block.16.layer.1.EncDecAttention.o.weight, decoder.block.16.layer.1.layer_norm.weight, decoder.block.16.layer.2.DenseReluDense.wi_0.weight, decoder.block.16.layer.2.DenseReluDense.wi_1.weight, decoder.block.16.layer.2.DenseReluDense.wo.weight, decoder.block.16.layer.2.layer_norm.weight, decoder.block.17.layer.0.SelfAttention.q.weight, decoder.block.17.layer.0.SelfAttention.k.weight, decoder.block.17.layer.0.SelfAttention.v.weight, decoder.block.17.layer.0.SelfAttention.o.weight, decoder.block.17.layer.0.layer_norm.weight, decoder.block.17.layer.1.EncDecAttention.q.weight, decoder.block.17.layer.1.EncDecAttention.k.weight, decoder.block.17.layer.1.EncDecAttention.v.weight, decoder.block.17.layer.1.EncDecAttention.o.weight, decoder.block.17.layer.1.layer_norm.weight, decoder.block.17.layer.2.DenseReluDense.wi_0.weight, decoder.block.17.layer.2.DenseReluDense.wi_1.weight, decoder.block.17.layer.2.DenseReluDense.wo.weight, decoder.block.17.layer.2.layer_norm.weight, decoder.block.18.layer.0.SelfAttention.q.weight, decoder.block.18.layer.0.SelfAttention.k.weight, decoder.block.18.layer.0.SelfAttention.v.weight, decoder.block.18.layer.0.SelfAttention.o.weight, decoder.block.18.layer.0.layer_norm.weight, decoder.block.18.layer.1.EncDecAttention.q.weight, decoder.block.18.layer.1.EncDecAttention.k.weight, decoder.block.18.layer.1.EncDecAttention.v.weight, decoder.block.18.layer.1.EncDecAttention.o.weight, decoder.block.18.layer.1.layer_norm.weight, decoder.block.18.layer.2.DenseReluDense.wi_0.weight, decoder.block.18.layer.2.DenseReluDense.wi_1.weight, decoder.block.18.layer.2.DenseReluDense.wo.weight, decoder.block.18.layer.2.layer_norm.weight, decoder.block.19.layer.0.SelfAttention.q.weight, decoder.block.19.layer.0.SelfAttention.k.weight, decoder.block.19.layer.0.SelfAttention.v.weight, decoder.block.19.layer.0.SelfAttention.o.weight, decoder.block.19.layer.0.layer_norm.weight, decoder.block.19.layer.1.EncDecAttention.q.weight, decoder.block.19.layer.1.EncDecAttention.k.weight, decoder.block.19.layer.1.EncDecAttention.v.weight, decoder.block.19.layer.1.EncDecAttention.o.weight, decoder.block.19.layer.1.layer_norm.weight, decoder.block.19.layer.2.DenseReluDense.wi_0.weight, decoder.block.19.layer.2.DenseReluDense.wi_1.weight, decoder.block.19.layer.2.DenseReluDense.wo.weight, decoder.block.19.layer.2.layer_norm.weight, decoder.block.20.layer.0.SelfAttention.q.weight, decoder.block.20.layer.0.SelfAttention.k.weight, decoder.block.20.layer.0.SelfAttention.v.weight, decoder.block.20.layer.0.SelfAttention.o.weight, decoder.block.20.layer.0.layer_norm.weight, decoder.block.20.layer.1.EncDecAttention.q.weight, decoder.block.20.layer.1.EncDecAttention.k.weight, decoder.block.20.layer.1.EncDecAttention.v.weight, decoder.block.20.layer.1.EncDecAttention.o.weight, decoder.block.20.layer.1.layer_norm.weight, decoder.block.20.layer.2.DenseReluDense.wi_0.weight, decoder.block.20.layer.2.DenseReluDense.wi_1.weight, decoder.block.20.layer.2.DenseReluDense.wo.weight, decoder.block.20.layer.2.layer_norm.weight, decoder.block.21.layer.0.SelfAttention.q.weight, decoder.block.21.layer.0.SelfAttention.k.weight, decoder.block.21.layer.0.SelfAttention.v.weight, decoder.block.21.layer.0.SelfAttention.o.weight, decoder.block.21.layer.0.layer_norm.weight, decoder.block.21.layer.1.EncDecAttention.q.weight, decoder.block.21.layer.1.EncDecAttention.k.weight, decoder.block.21.layer.1.EncDecAttention.v.weight, decoder.block.21.layer.1.EncDecAttention.o.weight, decoder.block.21.layer.1.layer_norm.weight, decoder.block.21.layer.2.DenseReluDense.wi_0.weight, decoder.block.21.layer.2.DenseReluDense.wi_1.weight, decoder.block.21.layer.2.DenseReluDense.wo.weight, decoder.block.21.layer.2.layer_norm.weight, decoder.block.22.layer.0.SelfAttention.q.weight, decoder.block.22.layer.0.SelfAttention.k.weight, decoder.block.22.layer.0.SelfAttention.v.weight, decoder.block.22.layer.0.SelfAttention.o.weight, decoder.block.22.layer.0.layer_norm.weight, decoder.block.22.layer.1.EncDecAttention.q.weight, decoder.block.22.layer.1.EncDecAttention.k.weight, decoder.block.22.layer.1.EncDecAttention.v.weight, decoder.block.22.layer.1.EncDecAttention.o.weight, decoder.block.22.layer.1.layer_norm.weight, decoder.block.22.layer.2.DenseReluDense.wi_0.weight, decoder.block.22.layer.2.DenseReluDense.wi_1.weight, decoder.block.22.layer.2.DenseReluDense.wo.weight, decoder.block.22.layer.2.layer_norm.weight, decoder.block.23.layer.0.SelfAttention.q.weight, decoder.block.23.layer.0.SelfAttention.k.weight, decoder.block.23.layer.0.SelfAttention.v.weight, decoder.block.23.layer.0.SelfAttention.o.weight, decoder.block.23.layer.0.layer_norm.weight, decoder.block.23.layer.1.EncDecAttention.q.weight, decoder.block.23.layer.1.EncDecAttention.k.weight, decoder.block.23.layer.1.EncDecAttention.v.weight, decoder.block.23.layer.1.EncDecAttention.o.weight, decoder.block.23.layer.1.layer_norm.weight, decoder.block.23.layer.2.DenseReluDense.wi_0.weight, decoder.block.23.layer.2.DenseReluDense.wi_1.weight, decoder.block.23.layer.2.DenseReluDense.wo.weight, decoder.block.23.layer.2.layer_norm.weight, decoder.final_layer_norm.weight
INFO  2023-05-10 15:10:32,436-1d: 模型未成功加载，请到页面左上角"模型配置"选项卡中重新选择后点击"加载模型"按钮

环境信息 / Environment Information

• langchain-ChatGLM 版本/commit 号：e8b2ddea51e7813682b422e3bbb6c54e200646d9
• 是否使用 Docker 部署（是/否）：否
• 使用的模型（ChatGLM-6B / ClueAI/ChatYuan-large-v2 等）：ClueAI/ChatYuan-large-v2
• 使用的 Embedding 模型（GanymedeNil/text2vec-large-chinese 等）：GanymedeNil/text2vec-large-chinese
• 操作系统及版本 / Operating system and version: Linux 3.10.0-514.el7.x86_64 #1 SMP Tue Nov 22 16:42:41 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
• Python 版本 / Python version: Python 3.8.13
• 其他相关环境信息 / Other relevant environment information:

附加信息 / Additional Information 添加与问题相关的任何其他信息 / Add any other information related to the issue.

[ykk648]

check https://github.com/imClumsyPanda/langchain-ChatGLM/pull/312, 自己改device_map