ycycyc

+1 QAEnsemble.log: terminate called after throwing an instance of 'std::runtime_error'
 what(): [FT][ERROR] Assertion fail: /home/local/llama_inference/llm_serve/fastertransformer_backend/build/_deps/repo-ft-src/src/fastertransformer/triton_backend/llama/LlamaTritonModel.cc:89 

[af64e462bb34:00106] *** Process received signal ***
[af64e462bb34:00106] Signal: Aborted (6)
[af64e462bb34:00106] Signal code: (-6)
[af64e462bb34:00106]...

+1