HuiSeomKim

sbert based mpnet model(related issue #33)

12

### Model description Hello! Thanks for this great work :) Previously, I implemented [mpnet-rs](https://github.com/NewBornRustacean/mpnet-rs) and found a related issue(feature request) #33 If there is no on-going work for the mpnet...

[feature suggestion] self speculative decoding

7

Good morning(or afternoon/ evening)! There is a methodology called **self speculative decoding** among the techniques to enhance the speed of LLM inference. Would it be possible to implement this feature...