Yucheng-Qi
Results
3
comments of
Yucheng-Qi
Running into this as well
@LiuXiaoxuanPKU Thanks a lot for the super helpful info! I am very interested in the Dynamic Speculative Decoding mentioned above, and also found that the existing vllm framework cannot load...
@LiuXiaoxuanPKU Thanks for your response, and best wishes to you as well!