nunchaku icon indicating copy to clipboard operation
nunchaku copied to clipboard

Published 20 hours ago • verified publisher icon mit-han-lab

Implement batch

Open Bluear7878 opened this issue 8 months ago • 1 comments

I implemented the Batch function. Could you please review the implementation? @ita9naiwa

Bluear7878 avatar Apr 08 '25 03:04 Bluear7878

Hi @Bluear7878 @ita9naiwa, thank you very much for your effort! We have another implementation (https://github.com/mit-han-lab/nunchaku/commit/dbbd3ac86df054b424e15a6a63e03914598ab0fb) of batch inference in the dev branch. Please switch to that one if possible.

sxtyzhangzk avatar Apr 08 '25 06:04 sxtyzhangzk