使用fastdeploy的推理流程出现报错

[David19970306]

---

温馨提示：根据社区不完全统计，按照模板提问，可以加快回复和解决问题的速度

---

环境

• 【FastDeploy版本】： 说明具体的版本，如fastdeploy-linux-gpu-0.8.0
• 【编译命令】如果您是自行编译的FastDeploy，请说明您的编译方式（参数命令）
• 我的数据shape==（1，20，560）
• tcmalloc: large alloc 1099511627776 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 989560438784 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 890604355584 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 801543880704 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 721389486080 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 649250537472 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 584325464064 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 525892911104 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 473303613440 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 425973252096 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 383375900672 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 345038290944 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 310534438912 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 279480991744 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 251532886016 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 226379595776 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 203741626368 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 183367467008 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 165030723584 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 148527644672 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 133674876928 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 120307384320 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 108276645888 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 97448976384 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 87704076288 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 78933663744 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 71040294912 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 63936266240 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 57542639616 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 51788374016 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 46609530880 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 41948577792 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 37753724928 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 33978351616 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 30580514816 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 27522465792 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 24770215936 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 22293192704 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 20063879168 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 18057486336 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 16251740160 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 14626562048 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 13163905024 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 11847516160 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 10662764544 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 9596485632 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 tcmalloc: large alloc 8636841984 bytes == (nil) @ 0x44c6ee 0x46a9f4 0x46ad4c 0x7f6b223669d5 2023-08-11 15:03:33.055375155 [E:onnxruntime:, sequential_executor.cc:368 Execute] Non-zero status code returned while running Range node. Name:'/encoder/make_pad_mask/Range' Status Message: /onnxruntime_src/onnxruntime/core/framework/bfc_arena.cc:342 void* onnxruntime::BFCArena::AllocateRawInternal(size_t, bool) Failed to allocate memory for requested buffer of size 7270363648

[ERROR] fastdeploy/runtime/backends/ort/ort_backend.cc(333)::Infer Failed to Infer: Non-zero status code returned while running Range node. Name:'/encoder/make_pad_mask/Range' Status Message: /onnxruntime_src/onnxruntime/core/framework/bfc_arena.cc:342 void* onnxruntime::BFCArena::AllocateRawInternal(size_t, bool) Failed to allocate memory for requested buffer of size 7270363648

• 【系统平台】: Linux
• 【编译语言】： C++

[rainyfly]

具体是在什么环境进行推理的呢，以及用的是哪个模型