Jiun-Hao Jhan comments

Repositories
Issues
Comments

Results 2 comments of


                                            Jiun-Hao Jhan

Inference Time on your site?

Thanks for your reply. How many GPUs do you use?

Inference Time on your site?

Sorry for not expressing clearly. How many GPUs do you use for inference in 100ms per token? I'd like to figure out the configuration, like the machine, models, and number...