pruning-algorithms topic

Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

neuralmagic

A research library for pytorch-based neural network pruning, compression, and more.

lucaslie

Model optimizer used in Adlik.

Adlik

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.

horseee

A curated list for Efficient Large Language Models

horseee

[AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models

CASIA-IVA-Lab

Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models

arcee-ai