SpQR How to test inference speed?

How to test inference speed?

Open JianbangZ opened this issue 1 year ago • 4 comments

Anyway we can test the speedup effect?

Jun 13 '23 21:06 JianbangZ

Hi, @JianbangZ. At the moment we have not released the inference code. We intend to release in the nearest future.

Jun 14 '23 08:06 Godofnothing

I crave for this inference code. We crave for this inference code. EVERYONE crave for this inference code. Man, please!

Jun 19 '23 14:06 havietisov

Yes, looking forward to this inference code release.

Do you need any help with it?

Jun 19 '23 18:06 evolu8

so where is the inference code? Its about two months.

Aug 18 '23 07:08 MeJerry215