ptq topic

More readable and flexible yolov5 with more backbone(gcn, resnet, shufflenet, moblienet, efficientnet, hrnet, swin-transformer, etc) and (cbam，dcn and so on), and tensorrt

Bobo-y

Brevitas: neural network quantization in PyTorch

Xilinx

Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. This project provides researchers, developers, and engineers adva...

sony

Deep Learning Model Optimization Using by TensorRT API, window

yester31

[EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".

ModelTC

[ICML 2024] Outlier-Efficient Hopfield Layers for Large Transformer-Based Models

MAGICS-LAB

mi-optimize is a versatile tool designed for the quantization and evaluation of large language models (LLMs). The library's seamless integration of various quantization methods and evaluation techniqu...

TsingmaoAI