PainlessInferenceAcceleration icon indicating copy to clipboard operation
PainlessInferenceAcceleration copied to clipboard

Published 20 hours ago • verified publisher icon alipay

论文里看到Table 8 Inference Latency with Lookahead for vLLM.

Open zjjznw123 opened this issue 5 months ago • 0 comments

请问vLLM+lookahead这部分代码有吗？还是要改这个代码，如果需要改，怎么改呢，才能结合vllm

zjjznw123 avatar Sep 03 '24 08:09 zjjznw123