bolt icon indicating copy to clipboard operation
bolt copied to clipboard

Published 20 hours ago • verified publisher icon huawei-noah

batch inference

Open lishaojun412 opened this issue 3 years ago • 1 comments

Is bolt support batch inference , could I inference 2 or more sentence at the same time ?

lishaojun412 avatar Nov 08 '21 07:11 lishaojun412

some operators may have problem. If you encounter problem, you can propose at github or QQ chat group.

yuxianzhi avatar Nov 16 '21 06:11 yuxianzhi