optimum topic
List
optimum repositories
optimum-transformers
125
Stars
7
Forks
Watchers
Accelerated NLP pipelines for fast inference on CPU and GPU. Built with Transformers, Optimum and ONNX Runtime.
optimum-benchmark
240
Stars
43
Forks
Watchers
🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.
thermiq_mqtt-ha
23
Stars
19
Forks
Watchers
Home Assistant integration of ThermIQ-MQTT, providing control and logging of Thermia heatpumps
GPTQModel
902
Stars
130
Forks
902
Watchers
LLM model quantization (compression) toolkit with hw acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.