text-generation-inference topic
List
text-generation-inference repositories
optimum-benchmark
201
Stars
33
Forks
Watchers
A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.
