mindcraft icon indicating copy to clipboard operation
mindcraft copied to clipboard
verified publisher icon kolbytn

Implementing Together AI and LM Studio ( incl. Speculative Decoding )

Open mrelmida opened this issue 8 months ago • 0 comments

I implemented Together AI and LM Studio. For LM Studio, I used the SDK from LM Studio to also implement the speculative decoding feature.

mrelmida avatar May 01 '25 15:05 mrelmida