speculative-decoding topic

List speculative-decoding repositories

RSD

53
Stars
6
Forks
53
Watchers

[ICML 2025] Reward-guided Speculative Decoding (RSD) for efficiency and effectiveness.

verified publisher icon BaohaoLiao

PipeInfer

31
Stars
5
Forks
31
Watchers

PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation

verified publisher icon AutonomicPerfectionist