djl-spring-boot-starter icon indicating copy to clipboard operation
djl-spring-boot-starter copied to clipboard

Published 20 hours ago • verified publisher icon deepjavalibrary

DJL Spring Boot Starter performance

Open funkaikai opened this issue 9 months ago • 1 comments

hi, We are trying to use the DJL (Deep Java Library) framework and have conducted benchmark tests on different servers, finding that the throughput performance varies on different machines. One can reach a throughput of 60/s, which is a latest Windows machine with i7-13700H. Another machine can reach a throughput of 10/s, which is a 2019 MacBook Pro with i9.

1.I would like to know about the approximate time consumption of model prediction for our reference. 2.As you may know, which companies are currently using it in a production environment?

funkaikai avatar May 17 '24 09:05 funkaikai