rtp-llm icon indicating copy to clipboard operation
rtp-llm copied to clipboard
verified publisher icon alibaba

feature: new mtp framework

Open Vinkle-hzt opened this issue 2 months ago • 0 comments

bring a new speculative decoding framework, support one & multi steps mtp&eagle

Worklist

  • [x] ut
  • [x] smoke test
  • [x] metrics

Vinkle-hzt avatar Oct 31 '25 08:10 Vinkle-hzt