efficient-inference topic

Cheng-Hao Tu, Jia-Hong Lee, Yi-Ming Chan and Chu-Song Chen, "Pruning Depthwise Separable Convolutions for MobileNet Compression," International Joint Conference on Neural Networks, IJCNN 2020, July 20...

ivclab

[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

SqueezeAILab

Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)

raymin0223

On-device LLM Inference Powered by X-Bit Quantization

Picovoice

[NeurIPS 2024] AsyncDiff: Parallelizing Diffusion Models by Asynchronous Denoising

czg1225

[ICLR24] AutoVP: An Automated Visual Prompting Framework and Benchmark

IBM

[EMNLP 2025 Main] Video Compression Commander: Plug-and-Play Inference Acceleration for Video Large Language Models

xuyang-liu16

The official implementation of "Diversity-Guided MLP Reduction for Efficient Large Vision Transformers"

visresearch

The official implementation of "Learning Compact Vision Tokens for Efficient Large Multimodal Models"

visresearch