fastertransformer_backend icon indicating copy to clipboard operation
fastertransformer_backend copied to clipboard

Published 20 hours ago • verified publisher icon triton-inference-server

triton support using factertransfer backend for flan-ul2 and flan-ul2-alpaca-lora

Open ma-siddiqui opened this issue 2 years ago • 0 comments

How we can run triton with fastertransfer backend for flan-ul2-alpaca-lora?

Please share the steps. how to do this?

ma-siddiqui avatar May 27 '23 10:05 ma-siddiqui