FasterDecoding

icon location United States of America icon location Think deeper, decode faster

Results 4 repositories owned by FasterDecoding

Medusa

2.2k
Stars
151
Forks
Watchers

Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

verified publisher icon FasterDecoding

REST

163
Stars
10
Forks
Watchers

REST: Retrieval-Based Speculative Decoding, NAACL 2024

verified publisher icon FasterDecoding

TEAL

75
Stars
2
Forks
Watchers

verified publisher icon FasterDecoding

SnapKV

176
Stars
6
Forks
Watchers

verified publisher icon FasterDecoding