Yash Jain
Results
1
issues of
Yash Jain
# Add Speculative Decoding to picoGPT This PR implements speculative decoding to improve text generation performance in picoGPT. The implementation uses a smaller draft model (124M) to predict multiple tokens...