about the infer_size

Open Elijah-Yi opened this issue 1 year ago • 0 comments

thansk for your great work, I would like to ask, what is the optimal size of inference?

Nov 13 '24 14:11 Elijah-Yi