NewBornRustacean

Hello! Thanks for your comment! I didn't get any follow up, but I'm just about to start to code. It might take some time to refactor. I'll open draft PR...

Oh sorry man... I've been so busy with work lately that I haven't had a moment to spare. It's already been almost a month. I'm really sorry for keeping you...

@kozistr awesome! I'll check it out on GPU. thanks 👍

Thanks! @jafioti I'm gonna start with two graphs as you suggested. btw, where do you think is the right place for this feature to be merged? creating `generation.rs` either in...

Good morning! @jafioti According to [original implementation](https://github.com/dilab-zju/self-speculative-decoding/blob/main/modeling_llama.py) of the paper(draft & verify:Lossless Large Language Model Acceleration via Self-Speculative Decoding), the skipped layers are chosen in advance(gaussian process; I think this...

Thanks for your comment! Actually, I've been so busy with work for the past few weeks that I haven't been able to get much done. This week is a holiday...

Hello @jafioti ! I'm looking around this issue. Is there any progress? The way I see, you're planning to build a new, **distilled** symbolic computation crate(am I get it well?)....

@nilgoyette @JulianDicken @JamboChen Hello! I just opened draft PR for this issue! #1483 any comments would be very helpful :) please take a look 🔢

what's up! as a newbie(a new contributor) to ndarray, it was really helpful for me to read materials like this PR: #1440 especially this kind of figure to understand structures/desgins...