lmdeploy icon indicating copy to clipboard operation
lmdeploy copied to clipboard

Published 20 hours ago • verified publisher icon InternLM

[Bug] Aborted (core dumped)

Open suwenzhuo opened this issue 6 months ago • 1 comments

Checklist

  • [x] 1. I have searched related issues but cannot get the expected help.
  • [ ] 2. The bug has not been fixed in the latest version.
  • [ ] 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.

Describe the bug

环境： A100 mldeploy==0.5.3 模型Llama3.1-8B-Chinese-Chat

Aborted (core dumped)

Reproduction

我在运行下面的代码时出现问题 from lmdeploy import pipeline, TurbomindEngineConfig engine_config = TurbomindEngineConfig(quant_policy=8) pipe = pipeline("/root/model/Llama3.1-8B-Chinese-Chat", backend_config=engine_config, log_level='DEBUG') response = pipe(["Hi, pls intro yourself", "Shanghai is"]) print(response)

Environment

A100
mldeploy==0.5.3
模型Llama3.1-8B-Chinese-Chat

Error traceback

问题：
2024-09-02 10:29:22,080 - lmdeploy - INFO - Using turbomind engine
2024-09-02 10:29:22,080 - lmdeploy - INFO - input backend=turbomind, backend_config=TurbomindEngineConfig(model_name=None, model_format=None, tp=1, session_len=None, max_batch_size=128, cache_max_entry_count=0.8, cache_block_seq_len=64, enable_prefix_caching=False, quant_policy=8, rope_scaling_factor=0.0, use_logn_attn=False, download_dir=None, revision=None, max_prefill_token_num=8192, num_tokens_per_iter=0, max_prefill_iters=1)
2024-09-02 10:29:22,080 - lmdeploy - INFO - input chat_template_config=None
2024-09-02 10:29:24,541 - lmdeploy - INFO - updated chat_template_onfig=ChatTemplateConfig(model_name='llama3_1', system=None, meta_instruction=None, eosys=None, user=None, eoh=None, assistant=None, eoa=None, separator=None, capability=None, stop_words=None)
2024-09-02 10:29:24,541 - lmdeploy - INFO - model_source: hf_model
2024-09-02 10:29:26,787 - lmdeploy - INFO - model_config:

[llama]
model_name = llama3_1
model_arch = LlamaForCausalLM
tensor_para_size = 1
head_num = 32
kv_head_num = 8
vocab_size = 128256
num_layer = 32
inter_size = 14336
norm_eps = 1e-05
attn_bias = 0
start_id = 128000
end_id = 128009
session_len = 131080
weight_type = bf16
rotary_embedding = 128
rope_theta = 500000.0
size_per_head = 128
group_size = 0
max_batch_size = 128
max_prefill_token_num = 8192
max_context_token_num = 1
step_length = 1
cache_max_entry_count = 0.8
cache_block_seq_len = 64
cache_chunk_size = -1
enable_prefix_caching = False
num_tokens_per_iter = 8192
max_prefill_iters = 17
use_context_fmha = 1
quant_policy = 8
max_position_embeddings = 131072
original_max_position_embeddings = 8192
rope_scaling_type = llama3
rope_scaling_factor = 8.0
use_dynamic_ntk = 0
low_freq_factor = 1.0
high_freq_factor = 4.0
use_logn_attn = 0
lora_policy = 
lora_r = 0
lora_scale = 0.0
lora_max_wo_r = 0
lora_rank_pattern = 
lora_scale_pattern = 


[TM][DEBUG] Set logger level by DEBUG
[TM][WARNING] [LlamaTritonModel] `max_context_token_num` = 131080.
[TM][INFO] Model: 
head_num: 32
kv_head_num: 8
size_per_head: 128
inter_size: 14336
num_layer: 32
vocab_size: 128256
attn_bias: 0
max_batch_size: 128
max_prefill_token_num: 8192
max_context_token_num: 131080
session_len: 131080
step_length: 1
cache_max_entry_count: 0.8
cache_block_seq_len: 64
cache_chunk_size: -1
enable_prefix_caching: 0
use_context_fmha: 1
start_id: 128000
tensor_para_size: 1
pipeline_para_size: 1
enable_custom_all_reduce: 0
model_name: llama3_1
model_dir: 
quant_policy: 8
group_size: 0

[TM][DEBUG] Set logger level by DEBUG
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: tok_embeddings.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: output.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.0.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.0.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.0.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.0.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.0.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.0.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.0.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.0.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.0.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.0.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.0.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.0.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.0.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.0.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.1.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.1.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.1.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.1.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.1.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.1.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.1.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.1.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.1.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.1.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.1.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.1.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.1.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.1.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.2.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.2.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.2.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.2.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.2.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.2.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.2.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.2.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.2.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.2.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.2.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.2.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.2.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.2.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.3.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.3.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.3.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.3.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.3.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.3.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.3.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.3.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.3.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.3.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.3.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.3.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.3.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.3.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.4.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.4.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.4.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.4.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.4.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.4.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.4.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.4.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.4.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.4.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.4.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.4.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.4.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.4.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.5.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.5.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.5.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.5.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.5.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.5.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.5.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.5.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.5.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.5.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.5.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.5.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.5.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.5.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.6.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.6.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.6.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.6.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.6.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.6.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.6.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.6.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.6.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.6.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.6.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.6.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.6.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.6.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.7.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.7.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.7.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.7.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.7.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.7.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.7.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.7.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.7.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.7.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.7.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.7.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.7.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.7.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.8.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.8.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.8.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.8.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.8.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.8.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.8.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.8.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.8.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.8.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.8.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.8.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.8.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.8.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.9.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.9.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.9.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.9.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.9.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.9.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.9.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.9.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.9.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.9.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.9.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.9.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.9.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.9.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.10.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.10.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.10.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.10.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.10.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.10.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.10.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.10.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.10.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.10.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.10.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.10.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.10.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.10.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.11.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.11.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.11.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.11.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.11.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.11.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.11.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.11.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.11.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.11.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.11.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.11.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.11.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.11.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.12.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.12.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.12.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.12.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.12.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.12.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.12.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.12.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.12.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.12.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.12.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.12.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.12.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.12.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.13.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.13.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.13.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.13.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.13.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.13.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.13.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.13.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.13.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.13.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.13.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.13.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.13.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.13.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.14.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.14.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.14.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.14.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.14.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.14.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.14.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.14.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.14.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.14.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.14.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.14.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.14.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.14.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.15.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.15.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.15.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.15.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.15.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.15.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.15.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.15.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.15.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.15.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.15.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.15.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.15.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.15.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.16.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.16.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.16.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.16.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.16.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.16.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.16.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.16.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.16.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.16.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.16.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.16.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.16.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.16.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.17.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.17.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.17.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.17.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.17.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.17.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.17.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.17.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.17.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.17.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.17.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.17.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.17.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.17.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.18.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.18.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.18.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.18.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.18.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.18.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.18.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.18.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.18.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.18.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.18.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.18.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.18.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.18.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.19.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.19.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.19.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.19.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.19.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.19.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.19.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.19.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.19.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.19.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.19.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.19.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.19.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.19.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.20.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.20.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.20.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.20.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.20.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.20.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.20.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.20.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.20.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.20.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.20.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.20.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.20.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.20.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.21.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.21.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.21.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.21.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.21.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.21.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.21.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.21.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.21.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.21.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.21.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.21.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.21.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.21.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.22.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.22.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.22.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.22.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.22.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.22.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.22.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.22.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.22.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.22.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.22.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.22.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.22.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.22.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.23.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.23.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.23.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.23.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.23.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.23.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.23.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.23.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.23.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.23.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.23.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.23.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.23.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.23.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.24.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.24.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.24.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.24.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.24.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.24.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.24.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.24.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.24.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.24.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.24.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.24.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.24.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.24.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.25.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.25.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.25.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.25.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.25.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.25.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.25.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.25.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.25.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.25.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.25.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.25.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.25.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.25.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.26.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.26.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.26.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.26.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.26.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.26.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.26.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.26.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.26.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.26.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.26.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.26.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.26.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.26.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.27.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.27.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.27.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.27.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.27.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.27.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.27.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.27.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.27.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.27.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.27.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.27.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.27.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.27.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.28.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.28.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.28.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.28.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.28.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.28.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.28.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.28.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.28.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.28.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.28.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.28.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.28.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.28.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.29.attention_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.29.ffn_norm.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.29.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.29.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.29.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.29.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.29.feed_forward.w2.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.29.feed_forward.w3.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.29.feed_forward.w1.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.29.attention.wo.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.29.attention.w_qkv.0.weight
[TM][DEBUG] bool turbomind::TensorMap::isExist(const string&) const for key: layers.29.ffn_norm.weight

suwenzhuo avatar Sep 02 '24 02:09 suwenzhuo