fastertransformer_backend icon indicating copy to clipboard operation
fastertransformer_backend copied to clipboard

Published 20 hours ago • verified publisher icon triton-inference-server

run end_to_end_test_llama.py error

Open SherronBurtint opened this issue 2 years ago • 0 comments

Running python3 tools/end_to_end_test_llama.py, an error was prompted, [400] HTTP end point doesn't support models with decoupled transaction policy

SherronBurtint avatar May 26 '23 02:05 SherronBurtint