PaddleNLP icon indicating copy to clipboard operation
PaddleNLP copied to clipboard

Published 20 hours ago • verified publisher icon PaddlePaddle

[Inference] Support speculative decoding

Open Wanglongzhi2001 opened this issue 10 months ago • 4 comments

PR types

New features

PR changes

Others

Description

Support speculative decoding. Need https://github.com/PaddlePaddle/Paddle/pull/63666 be merged.

Wanglongzhi2001 avatar Apr 19 '24 06:04 Wanglongzhi2001