text-generation-inference icon indicating copy to clipboard operation
text-generation-inference copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Support for Assisted Generation

Open sujithjoseph opened this issue 1 year ago • 0 comments

Feature request

Can this API support Assisted Generation feature from https://huggingface.co/blog/assisted-generation?

Motivation

Better Latency.

Your contribution

Yes..

sujithjoseph avatar May 11 '23 17:05 sujithjoseph