LLM-TPU
LLM-TPU copied to clipboard
常见问题的Q11,[a53lite runtimellerror] get function send api error, ret2,有没有其他的排错思路?
我的bm-smi版本 sophon-driver sophon-libsophon sophon-libsophon-dev 这些都是0.5.1版本的。
另外我打印了我的Bmodel,应该是没什么问题的。常见问题中的Q11所有方法差不多都试了。其中聊天的上下文挺短的,就是让他生成一个冒泡排序,请问还有什么其他排错思路嘛?
linaro@bm1684:/data$ model_tool --info rwkv6-1b6_bf16_1dev.bmodel
bmodel version: B.2.2+v1.8.beta.0-331-g9ce86277c-20240822
chip: BM1684X
create time: Thu Aug 22 17:17:44 2024
kernel_module name: libbm1684x_kernel_module.so
kernel_module size: 2704256
kernel_module md5: b1a3be79d383ae55916e67b482035021
cpuop_module name: libbm1684x_kernel_module.so
cpuop_module size: 0
cpuop_module md5: d41d8cd98f00b204e9800998ecf8427e
==========================================
net 0: [embedding] static
------------
stage 0, core num: 1
input: input_ids, [1, 1], int32, scale: 1, zero point: 0
output: hidden_dim_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 1: [lm_head] static
------------
stage 0, core num: 1
input: hidden_dim, [1, 2048], bfloat16, scale: 1, zero point: 0
output: m_logits_MatMul_f32, [1, 65536], float32, scale: 1, zero point: 0
==========================================
net 2: [greedy_head] dynamic
------------
stage 0, core num: 1
input: m_logits, [max:1, max:65536], float32, scale: 1, zero point: 0
output: token_TopK, [1, 1], int32, scale: 1, zero point: 0
==========================================
net 3: [penalty_sample_head] static
------------
stage 0, core num: 1
subnet number: 3
input: m_logits, [1, 65536], float32, scale: 1, zero point: 0
input: input_ids, [1, 4096], int32, scale: 1, zero point: 0
input: top_p, [1], float32, scale: 1, zero point: 0
input: temperature, [1], float32, scale: 1, zero point: 0
input: penalty, [1], float32, scale: 1, zero point: 0
output: probs_Softmax, [1, 50], float32, scale: 1, zero point: 0
output: token_TopK, [1, 50], int32, scale: 1, zero point: 0
==========================================
net 4: [block_0] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 5: [block_1] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 6: [block_2] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 7: [block_3] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 8: [block_4] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 9: [block_5] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 10: [block_6] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 11: [block_7] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 12: [block_8] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 13: [block_9] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 14: [block_10] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 15: [block_11] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 16: [block_12] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 17: [block_13] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 18: [block_14] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 19: [block_15] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 20: [block_16] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 21: [block_17] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 22: [block_18] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 23: [block_19] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 24: [block_20] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 25: [block_21] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 26: [block_22] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 27: [block_23] static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
device mem size: 3287437096 (weight: 3237699584, instruct: 4046632, runtime: 45690880)
host mem size: 0 (weight: 0, runtime: 0)
请问还有什么其他排错思路嘛?
上面被delete的comment包好了一个压缩包链接,说能Fix我的问题,被github风控检测了 ,还好发的是exe,我是linux没法装,估计是木马程序!!!
嗯呢大家小心
rwkv6这个模型支持起来比较困难,我抽空康康,我先close了