simple_tensorflow_serving icon indicating copy to clipboard operation
simple_tensorflow_serving copied to clipboard

Published 20 hours ago • verified publisher icon tobegit3hub

batching feature

Open wykdg opened this issue 4 years ago • 0 comments

Is there a feature of batch merge calculation to improve GPU utilization? There is a batch merge in tensorflow-serving, which is very helpful for development and deployment. thanks

wykdg avatar Mar 12 '20 10:03 wykdg