brotherchen

Results 1 comments of brotherchen

amazing works ! I would like to know whether lookahead decoding technology is in the planning of vllm, because it can speed up reasoning without the need for an additional...