RobinJYM

Results 2 comments of


                                            RobinJYM

Question about the relation between ` --max_input_len --max_output_len` at building time and `input_output_len` at benchmark .

same error and only occurs when batch=16

How to identify the rest toke latency?

Any Insights?