LLM-TPU icon indicating copy to clipboard operation
LLM-TPU copied to clipboard

常见问题的Q11,[a53lite runtimellerror] get function send api error, ret2,有没有其他的排错思路?

Open loredunk opened this issue 1 year ago • 1 comments

image

我的bm-smi版本 sophon-driver sophon-libsophon sophon-libsophon-dev 这些都是0.5.1版本的。

另外我打印了我的Bmodel,应该是没什么问题的。常见问题中的Q11所有方法差不多都试了。其中聊天的上下文挺短的,就是让他生成一个冒泡排序,请问还有什么其他排错思路嘛?

linaro@bm1684:/data$ model_tool --info rwkv6-1b6_bf16_1dev.bmodel
bmodel version: B.2.2+v1.8.beta.0-331-g9ce86277c-20240822
chip: BM1684X
create time: Thu Aug 22 17:17:44 2024

kernel_module name: libbm1684x_kernel_module.so
kernel_module size: 2704256
kernel_module md5: b1a3be79d383ae55916e67b482035021
cpuop_module name: libbm1684x_kernel_module.so
cpuop_module size: 0
cpuop_module md5: d41d8cd98f00b204e9800998ecf8427e
==========================================
net 0: [embedding]  static
------------
stage 0, core num: 1
input: input_ids, [1, 1], int32, scale: 1, zero point: 0
output: hidden_dim_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 1: [lm_head]  static
------------
stage 0, core num: 1
input: hidden_dim, [1, 2048], bfloat16, scale: 1, zero point: 0
output: m_logits_MatMul_f32, [1, 65536], float32, scale: 1, zero point: 0
==========================================
net 2: [greedy_head]  dynamic
------------
stage 0, core num: 1
input: m_logits, [max:1, max:65536], float32, scale: 1, zero point: 0
output: token_TopK, [1, 1], int32, scale: 1, zero point: 0
==========================================
net 3: [penalty_sample_head]  static
------------
stage 0, core num: 1
subnet number: 3
input: m_logits, [1, 65536], float32, scale: 1, zero point: 0
input: input_ids, [1, 4096], int32, scale: 1, zero point: 0
input: top_p, [1], float32, scale: 1, zero point: 0
input: temperature, [1], float32, scale: 1, zero point: 0
input: penalty, [1], float32, scale: 1, zero point: 0
output: probs_Softmax, [1, 50], float32, scale: 1, zero point: 0
output: token_TopK, [1, 50], int32, scale: 1, zero point: 0
==========================================
net 4: [block_0]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 5: [block_1]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 6: [block_2]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 7: [block_3]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 8: [block_4]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 9: [block_5]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 10: [block_6]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 11: [block_7]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 12: [block_8]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 13: [block_9]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 14: [block_10]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 15: [block_11]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 16: [block_12]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 17: [block_13]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 18: [block_14]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 19: [block_15]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 20: [block_16]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 21: [block_17]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 22: [block_18]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 23: [block_19]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 24: [block_20]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 25: [block_21]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 26: [block_22]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 27: [block_23]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0


device mem size: 3287437096 (weight: 3237699584, instruct: 4046632, runtime: 45690880)
host mem size: 0 (weight: 0, runtime: 0)

请问还有什么其他排错思路嘛?

loredunk avatar Aug 27 '24 02:08 loredunk

上面被delete的comment包好了一个压缩包链接,说能Fix我的问题,被github风控检测了 ,还好发的是exe,我是linux没法装,估计是木马程序!!!

loredunk avatar Aug 28 '24 01:08 loredunk

嗯呢大家小心

rwkv6这个模型支持起来比较困难,我抽空康康,我先close了

chuxiaoyi2023 avatar Dec 04 '24 12:12 chuxiaoyi2023