text-generation-inference icon indicating copy to clipboard operation
text-generation-inference copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Support AQLM model

Open lihan opened this issue 10 months ago • 2 comments

Feature request

Is it possible to add AQLM support?

Transformers now supporting this.

Motivation

Allow more models to be served by TGI

Your contribution

Helping you to test

lihan avatar Apr 03 '24 05:04 lihan

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

github-actions[bot] avatar May 04 '24 01:05 github-actions[bot]

necessary feature

Nehc avatar May 07 '24 06:05 Nehc

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

github-actions[bot] avatar Jun 23 '24 01:06 github-actions[bot]