Prediction throuhput

Open matanox opened this issue 7 years ago • 0 comments

Just curious what throughput people are getting for prediction requests; I can get up to 380 requests per second under highly concurrent load with a clojure based http server wrapper, using a non-quantized fasttext classification model.

Mar 23 '18 13:03 matanox